2024-09-19T08:43:04.201 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:43:04.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:43:04.317 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911880' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNu3hTSrVCSqmiRijzG8CqOikX30IFZ1uBJYtPBAZ5h4lMo2xjjt3Ly5e2isTnODnkpdqs/qmsOY9skTLmU3UQM= smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCvTmKY9Ykh+DTyArf+41zTUtU2jH1ZeF+h3DVxGYBgB+IjJmA35jH2jXT6VBuED/OaIQG2Ok/qRAXSlOEJnIrw= smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGZjvU6dpa4d1k+s6TSRCW7rSs9PeOUHo9itbiBHIQ9FIybXQjgyVe7B+b9YF5R2WKjOZb/0Lnb4/CaKA5+zi0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T08:43:04.318 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:43:04.318 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:43:04.318 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:43:04.320 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:43:04.341 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:43:04.341 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:43:04.341 INFO:teuthology.packaging:ref: None 2024-09-19T08:43:04.342 INFO:teuthology.packaging:tag: None 2024-09-19T08:43:04.342 INFO:teuthology.packaging:branch: squid 2024-09-19T08:43:04.342 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:43:04.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:43:04.548 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:43:04.550 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:43:04.556 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:43:04.556 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:43:04.577 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:43:04.596 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:43:04.603 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:43:04.626 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:38:07.201114', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNu3hTSrVCSqmiRijzG8CqOikX30IFZ1uBJYtPBAZ5h4lMo2xjjt3Ly5e2isTnODnkpdqs/qmsOY9skTLmU3UQM='} 2024-09-19T08:43:04.645 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:38:07.202490', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCvTmKY9Ykh+DTyArf+41zTUtU2jH1ZeF+h3DVxGYBgB+IjJmA35jH2jXT6VBuED/OaIQG2Ok/qRAXSlOEJnIrw='} 2024-09-19T08:43:04.663 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:38:07.203631', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGZjvU6dpa4d1k+s6TSRCW7rSs9PeOUHo9itbiBHIQ9FIybXQjgyVe7B+b9YF5R2WKjOZb/0Lnb4/CaKA5+zi0='} 2024-09-19T08:43:04.663 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:43:04.668 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T08:43:04.668 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T08:43:04.669 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T08:43:04.669 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:43:04.794 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feb26203490>, signals=[15]) 2024-09-19T08:43:04.794 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:43:04.800 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:43:04.800 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T08:43:04.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:04.880 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-09-19T08:43:04.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:04.957 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2024-09-19T08:43:04.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:43:05.033 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:43:05.038 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-09-19T08:43:05.057 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-09-19T08:43:05.057 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-09-19T08:43:05.115 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-09-19T08:43:05.115 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-09-19T08:43:05.115 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:43:05.116 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:43:05.117 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-09-19T08:43:05.140 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-09-19T08:43:05.158 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-09-19T08:43:05.158 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-09-19T08:43:05.215 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-09-19T08:43:05.215 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-09-19T08:43:05.215 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-09-19T08:43:05.215 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:43:05.215 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-09-19T08:43:05.215 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:43:05.215 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:43:05.216 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-09-19T08:43:05.216 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:43:05.216 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:43:05.216 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:43:05.216 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:43:05.216 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:43:05.216 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:43:05.216 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-09-19T08:43:05.248 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-09-19T08:43:05.266 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-09-19T08:43:05.267 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-09-19T08:43:05.324 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-09-19T08:43:05.324 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-09-19T08:43:05.324 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-09-19T08:43:05.324 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:43:05.324 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-09-19T08:43:05.324 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:43:05.325 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:43:05.325 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-09-19T08:43:05.325 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:43:05.325 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:43:05.325 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:43:05.325 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:43:05.325 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:43:05.325 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:43:05.325 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-09-19T08:43:05.357 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:43:05.365 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:43:05.370 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:43:05.371 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:43:05.373 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:43:05.376 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:43:05.393 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:43:05.398 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:43:05.398 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:43:05.431 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:43:05.433 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:43:05.463 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:43:05.537 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:43:05.551 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:43:05.551 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T08:43:05.551 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T08:43:05.551 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:43:05.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:43:05.569 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-19T08:43:05.627 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:43:05.627 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.14.0-503.el9.x86_64 2024-09-19T08:43:05.627 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2024-09-19T08:43:10.488 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.3 MB 00:03 2024-09-19T08:43:12.506 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-19T08:43:17.115 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-19T08:43:18.566 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 19 kB 00:00 2024-09-19T08:43:19.445 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T08:43:24.976 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T08:43:26.932 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:43:26.933 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:43:27.034 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:43:27.047 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:43:27.048 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-19T08:43:27.048 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T08:43:27.048 INFO:teuthology.orchestra.run.smithi001.stdout:Install 4 Packages 2024-09-19T08:43:27.048 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:43:27.048 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 79 M 2024-09-19T08:43:27.048 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 126 M 2024-09-19T08:43:27.048 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-19T08:43:27.605 INFO:teuthology.orchestra.run.smithi001.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 123 kB/s | 36 kB 00:00 2024-09-19T08:43:31.489 INFO:teuthology.orchestra.run.smithi001.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 8.3 MB/s | 35 MB 00:04 2024-09-19T08:43:41.543 INFO:teuthology.orchestra.run.smithi001.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 1.1 MB/s | 16 MB 00:14 2024-09-19T08:44:01.867 INFO:teuthology.orchestra.run.smithi001.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 854 kB/s | 29 MB 00:34 2024-09-19T08:44:01.867 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:44:01.867 INFO:teuthology.orchestra.run.smithi001.stdout:Total 2.3 MB/s | 79 MB 00:34 2024-09-19T08:44:02.578 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-19T08:44:02.962 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-19T08:44:02.962 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-19T08:44:03.943 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-19T08:44:03.943 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-19T08:44:06.514 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-19T08:44:07.153 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:44:07.241 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:44:09.977 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:44:10.103 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:44:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:44:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:20.390 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:59.645 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:44:59.686 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:45:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:45:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:45:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:45:00.074 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:45:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:45:00.901 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:45:00.901 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-19T08:45:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:45:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:45:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:45:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:45:00.902 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:45:00.902 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-19T08:45:01.242 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:45:01.329 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:45:01.330 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:45:01.330 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:45:01.330 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:45:01.330 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:45:01.330 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T08:45:01.330 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:45:01.330 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:45:01.389 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:45:01.389 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:45:01.389 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.06 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 82.el9 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Group : Unspecified 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 8274670 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:45:01.422 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : builder@centos.org 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : CentOS 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2024-09-19T08:45:01.423 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:45:01.424 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:45:01.425 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:45:01.425 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:45:01.425 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:45:02.181 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-09-19T08:45:03.498 INFO:teuthology.orchestra.run.smithi001.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:45:03.525 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-09-19T08:45:03.527 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-19T08:45:03.583 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.IoDZb3i9yl 2024-09-19T08:45:03.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IoDZb3i9yl 2024-09-19T08:45:03.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.IoDZb3i9yl 2024-09-19T08:45:03.805 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.IoDZb3i9yl is 6KB 2024-09-19T08:45:03.853 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.IoDZb3i9yl 2024-09-19T08:45:03.868 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:45:03.931 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:45:03.931 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:45:03.931 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:45:03.931 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:45:03.932 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:45:04.088 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-09-19T08:45:34.091 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T08:45:34.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T08:45:34.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:45:52.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-09-19T08:46:01.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T08:46:01.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:47:01.578 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T08:47:13.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T08:47:13.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:47:13.863 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-19T08:47:14.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T08:47:14.245 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:47:14.246 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-19T08:47:14.262 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:47:14.263 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:47:14.263 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:47:14.263 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:47:15.264 DEBUG:teuthology.parallel:result is None 2024-09-19T08:47:15.264 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T08:47:15.271 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T08:47:15.271 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:47:15.274 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:47:15.276 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:47:15.295 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T08:47:15.303 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T08:47:15.308 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T08:47:15.309 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:47:15.333 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:47:15.336 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:47:15.367 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T08:47:15.373 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T08:47:15.373 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:47:15.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:47:15.416 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:47:15.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:47:15.435 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:47:15.438 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:47:15.460 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:47:15.497 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:47:15.515 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:47:15.538 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:47:15.550 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:47:15.558 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:47:15.573 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:47:15.574 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T08:47:15.582 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T08:47:15.582 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:47:15.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:47:15.586 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:47:15.614 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T08:47:15.624 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T08:47:15.624 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:47:15.654 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:47:15.657 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:47:15.674 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:47:15.756 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:47:15.808 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:47:15.895 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:47:15.941 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:47:15.941 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:47:16.012 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:47:16.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:47:16.109 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:47:16.195 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:47:16.239 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:47:16.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:47:16.306 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:47:16.351 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:47:16.401 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:47:16.485 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:47:16.530 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:47:16.530 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:47:16.598 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-09-19T08:47:16.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-09-19T08:47:16.603 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2024-09-19T08:47:16.642 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:47:16.650 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:47:16.678 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:47:17.147 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T08:47:17.154 INFO:teuthology.task.internal:Starting timer... 2024-09-19T08:47:17.154 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T08:47:17.205 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T08:47:17.212 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T08:47:17.213 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-09-19T08:47:17.291 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-09-19T08:47:17.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-09-19T08:47:17.350 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-09-19T08:47:17.353 DEBUG:teuthology.orchestra.run.smithi064:> sudo service auditd rotate 2024-09-19T08:47:17.414 INFO:teuthology.orchestra.run.smithi064.stdout:Rotating logs: 2024-09-19T08:47:17.416 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T08:47:17.416 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-09-19T08:47:17.449 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-09-19T08:47:17.449 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-09-19T08:47:17.472 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-09-19T08:47:17.473 DEBUG:teuthology.orchestra.run.smithi064:> /usr/sbin/getenforce 2024-09-19T08:47:17.493 INFO:teuthology.orchestra.run.smithi064.stdout:Permissive 2024-09-19T08:47:17.493 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi064.front.sepia.ceph.com': 'permissive'} 2024-09-19T08:47:17.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:47:17.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:47:17.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:47:17.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:47:17.550 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:47:17.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:47:17.580 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T08:47:17.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:47:17.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:47:17.653 DEBUG:teuthology.orchestra.run.smithi064:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:47:17.691 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T08:47:17.701 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T08:47:17.713 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T08:47:17.715 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi022.front.sepia.ceph.com,smithi064.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T08:51:27.992 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi064.front.sepia.ceph.com')] 2024-09-19T08:51:27.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T08:51:27.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:51:28.075 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-19T08:51:28.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T08:51:28.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-19T08:51:28.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:51:28.231 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-19T08:51:28.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-19T08:51:28.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-09-19T08:51:28.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:51:28.393 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-09-19T08:51:28.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-09-19T08:51:28.474 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T08:51:28.485 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T08:51:28.485 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:51:28.486 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:51:28.488 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:51:28.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:51:28.490 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:51:28.491 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:51:28.517 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:51:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:51:28.532 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:51:28.534 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:51:28.545 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:51:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-09-19T08:51:28.559 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-09-19T08:51:28.560 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:51:28.570 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-09-19T08:51:28.570 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-09-19T08:51:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:51:28.585 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:51:28.586 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: ntpd: command not found 2024-09-19T08:51:28.597 INFO:teuthology.orchestra.run.smithi064.stdout:506 Cannot talk to daemon 2024-09-19T08:51:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:51:28.599 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:51:28.611 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:51:28.625 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:51:28.656 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:51:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:51:28.660 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:51:28.660 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-19T08:51:28.660 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.660 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.660 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.660 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.662 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:51:28.662 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-19T08:51:28.662 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.662 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.662 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.662 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.682 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:51:28.685 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:51:28.685 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-09-19T08:51:28.685 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.685 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.685 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.685 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:51:28.686 INFO:teuthology.run_tasks:Running task install... 2024-09-19T08:51:28.694 DEBUG:teuthology.task.install:project ceph 2024-09-19T08:51:28.695 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T08:51:28.695 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:51:28.695 INFO:teuthology.task.install:Using flavor: default 2024-09-19T08:51:28.700 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T08:51:28.701 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T08:51:28.701 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:51:28.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:28.704 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:51:28.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:28.705 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:51:28.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:51:28.857 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:51:28.857 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:51:28.861 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:51:28.861 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:51:28.864 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:51:28.864 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:51:28.978 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:51:28.979 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:51:28.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:51:28.993 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:51:28.993 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:51:28.993 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:51:29.000 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:51:29.000 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:51:29.000 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:51:29.006 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:51:29.007 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:51:29.019 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:51:29.019 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:51:29.026 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:51:29.026 DEBUG:teuthology.orchestra.run.smithi064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:51:29.074 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:51:29.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:51:29.092 DEBUG:teuthology.orchestra.run.smithi064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:51:29.152 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:51:29.159 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:51:29.167 DEBUG:teuthology.orchestra.run.smithi064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:51:29.218 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-09-19T08:51:29.220 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-09-19T08:51:29.224 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-09-19T08:51:29.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-09-19T08:51:29.230 INFO:teuthology.orchestra.run.smithi064.stdout:check_obsoletes = 1 2024-09-19T08:51:29.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum clean all 2024-09-19T08:51:29.456 INFO:teuthology.orchestra.run.smithi022.stdout:45 files removed 2024-09-19T08:51:29.463 INFO:teuthology.orchestra.run.smithi064.stdout:45 files removed 2024-09-19T08:51:29.465 INFO:teuthology.orchestra.run.smithi001.stdout:45 files removed 2024-09-19T08:51:29.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:51:29.490 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:51:29.492 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:51:30.037 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-19T08:51:30.053 INFO:teuthology.orchestra.run.smithi064.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-19T08:51:30.066 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-19T08:51:30.321 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T08:51:30.345 INFO:teuthology.orchestra.run.smithi064.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T08:51:30.359 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-19T08:51:30.596 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T08:51:30.621 INFO:teuthology.orchestra.run.smithi064.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T08:51:30.659 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 7.3 kB/s | 1.9 kB 00:00 2024-09-19T08:51:31.063 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-19T08:51:31.210 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-19T08:51:31.830 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 6.9 MB/s | 8.3 MB 00:01 2024-09-19T08:51:33.053 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T08:51:34.356 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-19T08:51:37.845 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.5 MB 00:00 2024-09-19T08:51:39.315 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.5 MB 00:01 2024-09-19T08:51:39.354 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 19 kB 00:00 2024-09-19T08:51:40.402 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T08:51:40.647 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-19T08:51:40.815 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-19T08:51:41.836 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T08:51:46.017 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-19T08:51:46.247 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.5 MB 00:01 2024-09-19T08:51:47.409 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-19T08:51:48.056 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-19T08:51:48.288 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:51:48.289 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:51:48.303 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:51:48.304 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:51:48.305 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:51:48.306 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:51:48.308 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:51:48.311 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:51:48.312 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:51:48.380 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:51:48.394 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:51:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:51:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:51:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:51:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:51:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:51:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:51:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:51:48.395 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:51:48.396 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:51:48.397 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:51:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:51:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:51:48.398 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-09-19T08:51:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:51:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:51:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:51:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:51:48.398 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:51:48.399 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:51:48.400 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:51:48.401 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:51:48.402 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:51:48.403 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:51:48.404 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:51:48.405 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout:Install 148 Packages 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 8 Packages 2024-09-19T08:51:48.407 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:51:48.408 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 226 M 2024-09-19T08:51:48.408 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-19T08:51:48.884 INFO:teuthology.orchestra.run.smithi001.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-19T08:51:49.076 INFO:teuthology.orchestra.run.smithi001.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-19T08:51:49.118 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-19T08:51:49.168 INFO:teuthology.orchestra.run.smithi001.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T08:51:49.269 INFO:teuthology.orchestra.run.smithi001.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T08:51:49.361 INFO:teuthology.orchestra.run.smithi001.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-19T08:51:49.444 INFO:teuthology.orchestra.run.smithi001.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 8.7 MB/s | 2.4 MB 00:00 2024-09-19T08:51:49.631 INFO:teuthology.orchestra.run.smithi064.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:51:49.632 INFO:teuthology.orchestra.run.smithi064.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:51:49.646 INFO:teuthology.orchestra.run.smithi064.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:51:49.647 INFO:teuthology.orchestra.run.smithi064.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:51:49.648 INFO:teuthology.orchestra.run.smithi064.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:51:49.649 INFO:teuthology.orchestra.run.smithi064.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:51:49.651 INFO:teuthology.orchestra.run.smithi064.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:51:49.654 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:51:49.655 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:51:49.686 INFO:teuthology.orchestra.run.smithi001.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-19T08:51:49.722 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout:====================================================================================== 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout:====================================================================================== 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:51:49.737 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:51:49.738 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:51:49.739 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:51:49.740 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:51:49.741 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:51:49.742 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:51:49.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:51:49.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:51:49.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:51:49.746 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:51:49.747 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout:Installing weak dependencies: 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:51:49.748 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-09-19T08:51:49.749 INFO:teuthology.orchestra.run.smithi064.stdout:====================================================================================== 2024-09-19T08:51:49.749 INFO:teuthology.orchestra.run.smithi064.stdout:Install 148 Packages 2024-09-19T08:51:49.749 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 8 Packages 2024-09-19T08:51:49.749 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:51:49.749 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 226 M 2024-09-19T08:51:49.749 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-09-19T08:51:49.920 INFO:teuthology.orchestra.run.smithi001.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T08:51:49.961 INFO:teuthology.orchestra.run.smithi001.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 608 kB/s | 25 kB 00:00 2024-09-19T08:51:50.329 INFO:teuthology.orchestra.run.smithi001.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 17 MB/s | 11 MB 00:00 2024-09-19T08:51:50.335 INFO:teuthology.orchestra.run.smithi064.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 28 kB/s | 6.6 kB 00:00 2024-09-19T08:51:50.387 INFO:teuthology.orchestra.run.smithi001.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T08:51:50.554 INFO:teuthology.orchestra.run.smithi001.stdout:(12/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 15 MB/s | 17 MB 00:01 2024-09-19T08:51:50.579 INFO:teuthology.orchestra.run.smithi001.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 141 kB/s | 27 kB 00:00 2024-09-19T08:51:50.621 INFO:teuthology.orchestra.run.smithi001.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 476 kB/s | 32 kB 00:00 2024-09-19T08:51:50.644 INFO:teuthology.orchestra.run.smithi064.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.8 MB/s | 896 kB 00:00 2024-09-19T08:51:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T08:51:50.722 INFO:teuthology.orchestra.run.smithi001.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.6 MB/s | 163 kB 00:00 2024-09-19T08:51:50.728 INFO:teuthology.orchestra.run.smithi064.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.7 MB/s | 145 kB 00:00 2024-09-19T08:51:50.764 INFO:teuthology.orchestra.run.smithi001.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.3 MB/s | 127 kB 00:00 2024-09-19T08:51:50.814 INFO:teuthology.orchestra.run.smithi001.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 5.4 MB/s | 506 kB 00:00 2024-09-19T08:51:50.914 INFO:teuthology.orchestra.run.smithi001.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 451 kB/s | 45 kB 00:00 2024-09-19T08:51:50.989 INFO:teuthology.orchestra.run.smithi001.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T08:51:51.065 INFO:teuthology.orchestra.run.smithi001.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T08:51:51.149 INFO:teuthology.orchestra.run.smithi001.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.8 MB/s | 320 kB 00:00 2024-09-19T08:51:51.226 INFO:teuthology.orchestra.run.smithi001.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T08:51:51.283 INFO:teuthology.orchestra.run.smithi001.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T08:51:51.336 INFO:teuthology.orchestra.run.smithi064.stdout:(4/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T08:51:51.349 INFO:teuthology.orchestra.run.smithi001.stdout:(25/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 9.1 MB/s | 5.3 MB 00:00 2024-09-19T08:51:51.375 INFO:teuthology.orchestra.run.smithi001.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 928 kB/s | 85 kB 00:00 2024-09-19T08:51:51.386 INFO:teuthology.orchestra.run.smithi064.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.6 MB/s | 2.4 MB 00:00 2024-09-19T08:51:51.434 INFO:teuthology.orchestra.run.smithi001.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T08:51:51.479 INFO:teuthology.orchestra.run.smithi064.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-19T08:51:51.509 INFO:teuthology.orchestra.run.smithi001.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 425 kB/s | 32 kB 00:00 2024-09-19T08:51:51.567 INFO:teuthology.orchestra.run.smithi001.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-19T08:51:51.592 INFO:teuthology.orchestra.run.smithi001.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T08:51:51.621 INFO:teuthology.orchestra.run.smithi064.stdout:(7/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 5.4 MB 00:01 2024-09-19T08:51:51.951 INFO:teuthology.orchestra.run.smithi001.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.3 MB/s | 3.6 MB 00:00 2024-09-19T08:51:52.043 INFO:teuthology.orchestra.run.smithi001.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.7 MB/s | 249 kB 00:00 2024-09-19T08:51:52.135 INFO:teuthology.orchestra.run.smithi001.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-19T08:51:52.160 INFO:teuthology.orchestra.run.smithi001.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 422 kB/s | 49 kB 00:00 2024-09-19T08:51:52.202 INFO:teuthology.orchestra.run.smithi001.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 246 kB/s | 16 kB 00:00 2024-09-19T08:51:52.228 INFO:teuthology.orchestra.run.smithi001.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T08:51:52.263 INFO:teuthology.orchestra.run.smithi064.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.4 MB/s | 4.7 MB 00:00 2024-09-19T08:51:52.278 INFO:teuthology.orchestra.run.smithi001.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 10 MB/s | 765 kB 00:00 2024-09-19T08:51:52.303 INFO:teuthology.orchestra.run.smithi001.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 243 kB/s | 18 kB 00:00 2024-09-19T08:51:52.313 INFO:teuthology.orchestra.run.smithi064.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 506 kB/s | 25 kB 00:00 2024-09-19T08:51:52.404 INFO:teuthology.orchestra.run.smithi001.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-09-19T08:51:52.462 INFO:teuthology.orchestra.run.smithi001.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T08:51:52.512 INFO:teuthology.orchestra.run.smithi001.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-19T08:51:52.563 INFO:teuthology.orchestra.run.smithi001.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-19T08:51:52.605 INFO:teuthology.orchestra.run.smithi001.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T08:51:52.647 INFO:teuthology.orchestra.run.smithi001.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-19T08:51:52.696 INFO:teuthology.orchestra.run.smithi064.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 17 MB 00:01 2024-09-19T08:51:52.747 INFO:teuthology.orchestra.run.smithi064.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T08:51:52.797 INFO:teuthology.orchestra.run.smithi064.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 541 kB/s | 27 kB 00:00 2024-09-19T08:51:52.847 INFO:teuthology.orchestra.run.smithi064.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 633 kB/s | 32 kB 00:00 2024-09-19T08:51:52.914 INFO:teuthology.orchestra.run.smithi064.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 751 kB 00:00 2024-09-19T08:51:52.965 INFO:teuthology.orchestra.run.smithi064.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T08:51:53.015 INFO:teuthology.orchestra.run.smithi064.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T08:51:53.074 INFO:teuthology.orchestra.run.smithi064.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 8.5 MB/s | 506 kB 00:00 2024-09-19T08:51:53.080 INFO:teuthology.orchestra.run.smithi001.stdout:(45/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 16 MB/s | 49 MB 00:03 2024-09-19T08:51:53.106 INFO:teuthology.orchestra.run.smithi001.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 272 kB/s | 125 kB 00:00 2024-09-19T08:51:53.148 INFO:teuthology.orchestra.run.smithi001.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-09-19T08:51:53.198 INFO:teuthology.orchestra.run.smithi001.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-09-19T08:51:53.249 INFO:teuthology.orchestra.run.smithi001.stdout:(49/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-19T08:51:53.291 INFO:teuthology.orchestra.run.smithi064.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 6.3 MB/s | 11 MB 00:01 2024-09-19T08:51:53.302 INFO:teuthology.orchestra.run.smithi001.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-19T08:51:53.324 INFO:teuthology.orchestra.run.smithi001.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-19T08:51:53.332 INFO:teuthology.orchestra.run.smithi064.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T08:51:53.366 INFO:teuthology.orchestra.run.smithi001.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 787 kB/s | 33 kB 00:00 2024-09-19T08:51:53.408 INFO:teuthology.orchestra.run.smithi064.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-19T08:51:53.433 INFO:teuthology.orchestra.run.smithi001.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-19T08:51:53.433 INFO:teuthology.orchestra.run.smithi064.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 1.3 MB/s | 136 kB 00:00 2024-09-19T08:51:53.458 INFO:teuthology.orchestra.run.smithi001.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-19T08:51:53.458 INFO:teuthology.orchestra.run.smithi064.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T08:51:53.475 INFO:teuthology.orchestra.run.smithi001.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-19T08:51:53.483 INFO:teuthology.orchestra.run.smithi064.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T08:51:53.492 INFO:teuthology.orchestra.run.smithi001.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 332 kB/s | 11 kB 00:00 2024-09-19T08:51:53.517 INFO:teuthology.orchestra.run.smithi064.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T08:51:53.525 INFO:teuthology.orchestra.run.smithi001.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-19T08:51:53.542 INFO:teuthology.orchestra.run.smithi064.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T08:51:53.550 INFO:teuthology.orchestra.run.smithi001.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T08:51:53.568 INFO:teuthology.orchestra.run.smithi064.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T08:51:53.618 INFO:teuthology.orchestra.run.smithi064.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T08:51:53.669 INFO:teuthology.orchestra.run.smithi064.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 638 kB/s | 32 kB 00:00 2024-09-19T08:51:53.719 INFO:teuthology.orchestra.run.smithi064.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T08:51:53.734 INFO:teuthology.orchestra.run.smithi001.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-19T08:51:53.759 INFO:teuthology.orchestra.run.smithi001.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-19T08:51:53.785 INFO:teuthology.orchestra.run.smithi001.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-19T08:51:53.810 INFO:teuthology.orchestra.run.smithi001.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T08:51:53.861 INFO:teuthology.orchestra.run.smithi064.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 3.1 MB 00:00 2024-09-19T08:51:53.885 INFO:teuthology.orchestra.run.smithi001.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-19T08:51:53.911 INFO:teuthology.orchestra.run.smithi001.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-19T08:51:53.936 INFO:teuthology.orchestra.run.smithi001.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-19T08:51:53.937 INFO:teuthology.orchestra.run.smithi064.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 16 MB/s | 3.6 MB 00:00 2024-09-19T08:51:53.986 INFO:teuthology.orchestra.run.smithi064.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T08:51:54.038 INFO:teuthology.orchestra.run.smithi064.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 963 kB/s | 49 kB 00:00 2024-09-19T08:51:54.088 INFO:teuthology.orchestra.run.smithi064.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 327 kB/s | 16 kB 00:00 2024-09-19T08:51:54.139 INFO:teuthology.orchestra.run.smithi064.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T08:51:54.144 INFO:teuthology.orchestra.run.smithi001.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.8 MB/s | 3.0 MB 00:00 2024-09-19T08:51:54.214 INFO:teuthology.orchestra.run.smithi064.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 10 MB/s | 765 kB 00:00 2024-09-19T08:51:54.264 INFO:teuthology.orchestra.run.smithi064.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 364 kB/s | 18 kB 00:00 2024-09-19T08:51:54.381 INFO:teuthology.orchestra.run.smithi064.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 684 kB/s | 80 kB 00:00 2024-09-19T08:51:54.532 INFO:teuthology.orchestra.run.smithi064.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-19T08:51:54.565 INFO:teuthology.orchestra.run.smithi064.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-19T08:51:54.578 INFO:teuthology.orchestra.run.smithi001.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-19T08:51:54.616 INFO:teuthology.orchestra.run.smithi064.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-19T08:51:54.691 INFO:teuthology.orchestra.run.smithi064.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-19T08:51:54.716 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-19T08:51:54.717 INFO:teuthology.orchestra.run.smithi064.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-19T08:51:54.741 INFO:teuthology.orchestra.run.smithi064.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T08:51:54.767 INFO:teuthology.orchestra.run.smithi064.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T08:51:54.792 INFO:teuthology.orchestra.run.smithi064.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T08:51:54.817 INFO:teuthology.orchestra.run.smithi064.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T08:51:54.837 INFO:teuthology.orchestra.run.smithi001.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-19T08:51:54.912 INFO:teuthology.orchestra.run.smithi001.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-19T08:51:54.943 INFO:teuthology.orchestra.run.smithi064.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-09-19T08:51:54.985 INFO:teuthology.orchestra.run.smithi064.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-19T08:51:55.027 INFO:teuthology.orchestra.run.smithi064.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-09-19T08:51:55.052 INFO:teuthology.orchestra.run.smithi064.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 323 kB/s | 22 kB 00:00 2024-09-19T08:51:55.077 INFO:teuthology.orchestra.run.smithi064.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-19T08:51:55.106 INFO:teuthology.orchestra.run.smithi064.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-19T08:51:55.153 INFO:teuthology.orchestra.run.smithi064.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-19T08:51:55.203 INFO:teuthology.orchestra.run.smithi064.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-19T08:51:55.229 INFO:teuthology.orchestra.run.smithi064.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-19T08:51:55.229 INFO:teuthology.orchestra.run.smithi001.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-09-19T08:51:55.254 INFO:teuthology.orchestra.run.smithi064.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T08:51:55.279 INFO:teuthology.orchestra.run.smithi064.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-19T08:51:55.313 INFO:teuthology.orchestra.run.smithi064.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T08:51:55.355 INFO:teuthology.orchestra.run.smithi064.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-19T08:51:55.371 INFO:teuthology.orchestra.run.smithi001.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.4 MB/s | 4.9 MB 00:01 2024-09-19T08:51:55.388 INFO:teuthology.orchestra.run.smithi064.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2024-09-19T08:51:55.414 INFO:teuthology.orchestra.run.smithi064.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-19T08:51:55.429 INFO:teuthology.orchestra.run.smithi001.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:51:55.439 INFO:teuthology.orchestra.run.smithi064.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T08:51:55.464 INFO:teuthology.orchestra.run.smithi064.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T08:51:55.490 INFO:teuthology.orchestra.run.smithi064.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-19T08:51:55.596 INFO:teuthology.orchestra.run.smithi001.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-09-19T08:51:55.607 INFO:teuthology.orchestra.run.smithi064.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-19T08:51:55.647 INFO:teuthology.orchestra.run.smithi001.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T08:51:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-19T08:51:55.732 INFO:teuthology.orchestra.run.smithi064.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T08:51:55.738 INFO:teuthology.orchestra.run.smithi001.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-19T08:51:55.766 INFO:teuthology.orchestra.run.smithi064.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-19T08:51:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T08:51:55.864 INFO:teuthology.orchestra.run.smithi001.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-19T08:51:55.866 INFO:teuthology.orchestra.run.smithi064.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-19T08:51:55.906 INFO:teuthology.orchestra.run.smithi001.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-19T08:51:55.908 INFO:teuthology.orchestra.run.smithi064.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-19T08:51:55.948 INFO:teuthology.orchestra.run.smithi001.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-19T08:51:55.984 INFO:teuthology.orchestra.run.smithi064.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-19T08:51:56.023 INFO:teuthology.orchestra.run.smithi001.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T08:51:56.026 INFO:teuthology.orchestra.run.smithi064.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T08:51:56.073 INFO:teuthology.orchestra.run.smithi001.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-19T08:51:56.101 INFO:teuthology.orchestra.run.smithi064.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-09-19T08:51:56.543 INFO:teuthology.orchestra.run.smithi064.stdout:(76/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 12 MB/s | 49 MB 00:04 2024-09-19T08:51:56.568 INFO:teuthology.orchestra.run.smithi064.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 451 kB/s | 245 kB 00:00 2024-09-19T08:51:56.594 INFO:teuthology.orchestra.run.smithi064.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 504 kB/s | 248 kB 00:00 2024-09-19T08:51:56.619 INFO:teuthology.orchestra.run.smithi064.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T08:51:56.632 INFO:teuthology.orchestra.run.smithi001.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.4 MB/s | 5.8 MB 00:01 2024-09-19T08:51:56.644 INFO:teuthology.orchestra.run.smithi064.stdout:(80/156): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-09-19T08:51:56.669 INFO:teuthology.orchestra.run.smithi064.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-19T08:51:56.695 INFO:teuthology.orchestra.run.smithi064.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-19T08:51:56.720 INFO:teuthology.orchestra.run.smithi064.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-19T08:51:56.724 INFO:teuthology.orchestra.run.smithi001.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-19T08:51:56.745 INFO:teuthology.orchestra.run.smithi064.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T08:51:56.771 INFO:teuthology.orchestra.run.smithi064.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T08:51:56.796 INFO:teuthology.orchestra.run.smithi064.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-19T08:51:56.824 INFO:teuthology.orchestra.run.smithi001.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-19T08:51:56.883 INFO:teuthology.orchestra.run.smithi001.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T08:51:56.925 INFO:teuthology.orchestra.run.smithi001.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T08:51:56.946 INFO:teuthology.orchestra.run.smithi064.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-09-19T08:51:56.972 INFO:teuthology.orchestra.run.smithi064.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 905 kB/s | 159 kB 00:00 2024-09-19T08:51:56.979 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:51:56.981 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:51:56.995 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:51:56.996 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:51:56.997 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:51:56.998 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:51:57.000 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:51:57.003 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:51:57.004 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:51:57.005 INFO:teuthology.orchestra.run.smithi064.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-19T08:51:57.025 INFO:teuthology.orchestra.run.smithi001.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-19T08:51:57.030 INFO:teuthology.orchestra.run.smithi064.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-09-19T08:51:57.056 INFO:teuthology.orchestra.run.smithi064.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T08:51:57.073 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-19T08:51:57.096 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-19T08:51:57.096 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-09-19T08:51:57.096 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-19T08:51:57.096 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-19T08:51:57.096 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:51:57.096 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:51:57.097 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:51:57.098 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:51:57.099 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:51:57.100 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:51:57.101 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:51:57.102 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:51:57.103 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:51:57.104 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:51:57.105 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:51:57.106 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:51:57.107 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:51:57.107 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:51:57.107 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:51:57.107 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:51:57.107 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:51:57.107 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:51:57.107 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:51:57.107 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:51:57.108 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-19T08:51:57.109 INFO:teuthology.orchestra.run.smithi022.stdout:Install 148 Packages 2024-09-19T08:51:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 8 Packages 2024-09-19T08:51:57.110 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:51:57.110 INFO:teuthology.orchestra.run.smithi064.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-19T08:51:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 226 M 2024-09-19T08:51:57.111 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-19T08:51:57.125 INFO:teuthology.orchestra.run.smithi001.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-19T08:51:57.173 INFO:teuthology.orchestra.run.smithi064.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.6 MB/s | 5.1 MB 00:00 2024-09-19T08:51:57.198 INFO:teuthology.orchestra.run.smithi064.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-09-19T08:51:57.223 INFO:teuthology.orchestra.run.smithi064.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T08:51:57.225 INFO:teuthology.orchestra.run.smithi001.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-19T08:51:57.249 INFO:teuthology.orchestra.run.smithi064.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-19T08:51:57.274 INFO:teuthology.orchestra.run.smithi064.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-09-19T08:51:57.292 INFO:teuthology.orchestra.run.smithi001.stdout:(89/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-09-19T08:51:57.309 INFO:teuthology.orchestra.run.smithi001.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-19T08:51:57.326 INFO:teuthology.orchestra.run.smithi001.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T08:51:57.360 INFO:teuthology.orchestra.run.smithi001.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-19T08:51:57.366 INFO:teuthology.orchestra.run.smithi064.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T08:51:57.391 INFO:teuthology.orchestra.run.smithi064.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-09-19T08:51:57.393 INFO:teuthology.orchestra.run.smithi001.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T08:51:57.417 INFO:teuthology.orchestra.run.smithi064.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T08:51:57.442 INFO:teuthology.orchestra.run.smithi064.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T08:51:57.467 INFO:teuthology.orchestra.run.smithi064.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-19T08:51:57.477 INFO:teuthology.orchestra.run.smithi001.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-19T08:51:57.501 INFO:teuthology.orchestra.run.smithi064.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-09-19T08:51:57.510 INFO:teuthology.orchestra.run.smithi001.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-19T08:51:57.544 INFO:teuthology.orchestra.run.smithi001.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T08:51:57.551 INFO:teuthology.orchestra.run.smithi064.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:51:57.593 INFO:teuthology.orchestra.run.smithi064.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.3 MB/s | 308 kB 00:00 2024-09-19T08:51:57.619 INFO:teuthology.orchestra.run.smithi064.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-19T08:51:57.661 INFO:teuthology.orchestra.run.smithi064.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-09-19T08:51:57.678 INFO:teuthology.orchestra.run.smithi001.stdout:(97/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-09-19T08:51:57.692 INFO:teuthology.orchestra.run.smithi022.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-19T08:51:57.703 INFO:teuthology.orchestra.run.smithi001.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-19T08:51:57.711 INFO:teuthology.orchestra.run.smithi064.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-19T08:51:57.720 INFO:teuthology.orchestra.run.smithi001.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T08:51:57.736 INFO:teuthology.orchestra.run.smithi064.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T08:51:57.762 INFO:teuthology.orchestra.run.smithi064.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T08:51:57.762 INFO:teuthology.orchestra.run.smithi001.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T08:51:57.795 INFO:teuthology.orchestra.run.smithi064.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T08:51:57.795 INFO:teuthology.orchestra.run.smithi001.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 848 kB/s | 64 kB 00:00 2024-09-19T08:51:57.812 INFO:teuthology.orchestra.run.smithi001.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-19T08:51:57.913 INFO:teuthology.orchestra.run.smithi001.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-19T08:51:57.954 INFO:teuthology.orchestra.run.smithi064.stdout:(112/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-19T08:51:57.963 INFO:teuthology.orchestra.run.smithi001.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:51:57.997 INFO:teuthology.orchestra.run.smithi001.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T08:51:58.004 INFO:teuthology.orchestra.run.smithi064.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-09-19T08:51:58.013 INFO:teuthology.orchestra.run.smithi001.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-19T08:51:58.029 INFO:teuthology.orchestra.run.smithi064.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:51:58.034 INFO:teuthology.orchestra.run.smithi022.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.6 MB/s | 896 kB 00:00 2024-09-19T08:51:58.055 INFO:teuthology.orchestra.run.smithi064.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:51:58.080 INFO:teuthology.orchestra.run.smithi064.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-19T08:51:58.089 INFO:teuthology.orchestra.run.smithi001.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-19T08:51:58.101 INFO:teuthology.orchestra.run.smithi022.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T08:51:58.114 INFO:teuthology.orchestra.run.smithi064.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-09-19T08:51:58.131 INFO:teuthology.orchestra.run.smithi001.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 629 kB/s | 26 kB 00:00 2024-09-19T08:51:58.147 INFO:teuthology.orchestra.run.smithi064.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-19T08:51:58.198 INFO:teuthology.orchestra.run.smithi001.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-19T08:51:58.214 INFO:teuthology.orchestra.run.smithi064.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-09-19T08:51:58.215 INFO:teuthology.orchestra.run.smithi001.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 578 kB/s | 49 kB 00:00 2024-09-19T08:51:58.240 INFO:teuthology.orchestra.run.smithi064.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-19T08:51:58.240 INFO:teuthology.orchestra.run.smithi001.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-19T08:51:58.265 INFO:teuthology.orchestra.run.smithi064.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-19T08:51:58.265 INFO:teuthology.orchestra.run.smithi001.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T08:51:58.290 INFO:teuthology.orchestra.run.smithi064.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-19T08:51:58.307 INFO:teuthology.orchestra.run.smithi001.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-19T08:51:58.315 INFO:teuthology.orchestra.run.smithi064.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-19T08:51:58.324 INFO:teuthology.orchestra.run.smithi001.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T08:51:58.341 INFO:teuthology.orchestra.run.smithi064.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-19T08:51:58.341 INFO:teuthology.orchestra.run.smithi001.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T08:51:58.358 INFO:teuthology.orchestra.run.smithi001.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 858 kB/s | 14 kB 00:00 2024-09-19T08:51:58.366 INFO:teuthology.orchestra.run.smithi064.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-19T08:51:58.391 INFO:teuthology.orchestra.run.smithi064.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-19T08:51:58.392 INFO:teuthology.orchestra.run.smithi001.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-19T08:51:58.417 INFO:teuthology.orchestra.run.smithi064.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-19T08:51:58.417 INFO:teuthology.orchestra.run.smithi001.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T08:51:58.442 INFO:teuthology.orchestra.run.smithi064.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-19T08:51:58.443 INFO:teuthology.orchestra.run.smithi001.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T08:51:58.467 INFO:teuthology.orchestra.run.smithi001.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T08:51:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T08:51:58.485 INFO:teuthology.orchestra.run.smithi022.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 6.2 MB/s | 2.4 MB 00:00 2024-09-19T08:51:58.493 INFO:teuthology.orchestra.run.smithi001.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:51:58.501 INFO:teuthology.orchestra.run.smithi064.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:51:58.526 INFO:teuthology.orchestra.run.smithi001.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T08:51:58.543 INFO:teuthology.orchestra.run.smithi064.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-19T08:51:58.552 INFO:teuthology.orchestra.run.smithi001.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-19T08:51:58.568 INFO:teuthology.orchestra.run.smithi064.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-19T08:51:58.577 INFO:teuthology.orchestra.run.smithi001.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-19T08:51:58.593 INFO:teuthology.orchestra.run.smithi064.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-19T08:51:58.602 INFO:teuthology.orchestra.run.smithi001.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-19T08:51:58.619 INFO:teuthology.orchestra.run.smithi064.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T08:51:58.627 INFO:teuthology.orchestra.run.smithi022.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 5.1 MB/s | 5.4 MB 00:01 2024-09-19T08:51:58.627 INFO:teuthology.orchestra.run.smithi001.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-19T08:51:58.644 INFO:teuthology.orchestra.run.smithi064.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-19T08:51:58.653 INFO:teuthology.orchestra.run.smithi001.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-19T08:51:58.669 INFO:teuthology.orchestra.run.smithi064.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-19T08:51:58.695 INFO:teuthology.orchestra.run.smithi064.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T08:51:58.703 INFO:teuthology.orchestra.run.smithi001.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-19T08:51:58.720 INFO:teuthology.orchestra.run.smithi064.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-19T08:51:58.727 INFO:teuthology.orchestra.run.smithi022.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.3 MB/s | 1.5 MB 00:00 2024-09-19T08:51:58.728 INFO:teuthology.orchestra.run.smithi001.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:51:58.745 INFO:teuthology.orchestra.run.smithi064.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T08:51:58.753 INFO:teuthology.orchestra.run.smithi001.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:51:58.770 INFO:teuthology.orchestra.run.smithi064.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T08:51:58.779 INFO:teuthology.orchestra.run.smithi001.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T08:51:58.796 INFO:teuthology.orchestra.run.smithi064.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T08:51:58.804 INFO:teuthology.orchestra.run.smithi001.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-19T08:51:58.830 INFO:teuthology.orchestra.run.smithi064.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-19T08:51:58.838 INFO:teuthology.orchestra.run.smithi001.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-19T08:51:58.855 INFO:teuthology.orchestra.run.smithi001.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-19T08:51:58.872 INFO:teuthology.orchestra.run.smithi001.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-19T08:51:58.880 INFO:teuthology.orchestra.run.smithi064.stdout:(143/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-19T08:51:58.897 INFO:teuthology.orchestra.run.smithi001.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T08:51:58.905 INFO:teuthology.orchestra.run.smithi064.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-19T08:51:58.914 INFO:teuthology.orchestra.run.smithi001.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-19T08:51:58.931 INFO:teuthology.orchestra.run.smithi064.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 395 kB/s | 20 kB 00:00 2024-09-19T08:51:58.931 INFO:teuthology.orchestra.run.smithi001.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T08:51:58.956 INFO:teuthology.orchestra.run.smithi001.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-19T08:51:58.964 INFO:teuthology.orchestra.run.smithi064.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T08:51:58.982 INFO:teuthology.orchestra.run.smithi001.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 708 kB/s | 36 kB 00:00 2024-09-19T08:51:58.990 INFO:teuthology.orchestra.run.smithi064.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-19T08:51:59.002 INFO:teuthology.orchestra.run.smithi022.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-19T08:51:59.007 INFO:teuthology.orchestra.run.smithi001.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T08:51:59.031 INFO:teuthology.orchestra.run.smithi064.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T08:51:59.032 INFO:teuthology.orchestra.run.smithi001.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T08:51:59.057 INFO:teuthology.orchestra.run.smithi001.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T08:51:59.074 INFO:teuthology.orchestra.run.smithi001.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T08:51:59.108 INFO:teuthology.orchestra.run.smithi001.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-19T08:51:59.167 INFO:teuthology.orchestra.run.smithi001.stdout:(146/156): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-19T08:51:59.223 INFO:teuthology.orchestra.run.smithi064.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T08:51:59.282 INFO:teuthology.orchestra.run.smithi064.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 31 MB/s | 1.8 MB 00:00 2024-09-19T08:51:59.324 INFO:teuthology.orchestra.run.smithi064.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 985 kB/s | 41 kB 00:00 2024-09-19T08:51:59.334 INFO:teuthology.orchestra.run.smithi001.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 1.4 MB/s | 427 kB 00:00 2024-09-19T08:51:59.366 INFO:teuthology.orchestra.run.smithi064.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 5.9 MB/s | 249 kB 00:00 2024-09-19T08:51:59.425 INFO:teuthology.orchestra.run.smithi064.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-19T08:51:59.500 INFO:teuthology.orchestra.run.smithi064.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-19T08:51:59.558 INFO:teuthology.orchestra.run.smithi064.stdout:(155/156): librados2-19.1.1-361.g2f599a46.el9.x 5.8 MB/s | 3.4 MB 00:00 2024-09-19T08:51:59.627 INFO:teuthology.orchestra.run.smithi022.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 10 MB/s | 21 MB 00:02 2024-09-19T08:51:59.651 INFO:teuthology.orchestra.run.smithi001.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 7.1 MB/s | 3.4 MB 00:00 2024-09-19T08:51:59.669 INFO:teuthology.orchestra.run.smithi022.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 608 kB/s | 25 kB 00:00 2024-09-19T08:51:59.683 INFO:teuthology.orchestra.run.smithi064.stdout:(156/156): librbd1-19.1.1-361.g2f599a46.el9.x86 4.6 MB/s | 3.2 MB 00:00 2024-09-19T08:51:59.690 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:51:59.690 INFO:teuthology.orchestra.run.smithi064.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-19T08:51:59.859 INFO:teuthology.orchestra.run.smithi001.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.0 MB/s | 3.2 MB 00:00 2024-09-19T08:51:59.953 INFO:teuthology.orchestra.run.smithi022.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 11 MB/s | 11 MB 00:00 2024-09-19T08:52:00.120 INFO:teuthology.orchestra.run.smithi022.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T08:52:00.145 INFO:teuthology.orchestra.run.smithi022.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.2 MB/s | 228 kB 00:00 2024-09-19T08:52:00.171 INFO:teuthology.orchestra.run.smithi022.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 539 kB/s | 27 kB 00:00 2024-09-19T08:52:00.196 INFO:teuthology.orchestra.run.smithi022.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 633 kB/s | 32 kB 00:00 2024-09-19T08:52:00.234 INFO:teuthology.orchestra.run.smithi001.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 4.0 MB/s | 2.3 MB 00:00 2024-09-19T08:52:00.246 INFO:teuthology.orchestra.run.smithi022.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T08:52:00.268 INFO:teuthology.orchestra.run.smithi001.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-09-19T08:52:00.271 INFO:teuthology.orchestra.run.smithi022.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T08:52:00.322 INFO:teuthology.orchestra.run.smithi022.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T08:52:00.327 INFO:teuthology.orchestra.run.smithi001.stdout:(152/156): NetworkManager-libnm-1.51.0-1.el9.x8 3.9 MB/s | 1.8 MB 00:00 2024-09-19T08:52:00.355 INFO:teuthology.orchestra.run.smithi022.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 5.9 MB/s | 506 kB 00:00 2024-09-19T08:52:00.394 INFO:teuthology.orchestra.run.smithi001.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-19T08:52:00.422 INFO:teuthology.orchestra.run.smithi022.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 678 kB/s | 45 kB 00:00 2024-09-19T08:52:00.497 INFO:teuthology.orchestra.run.smithi022.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T08:52:00.573 INFO:teuthology.orchestra.run.smithi022.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T08:52:00.673 INFO:teuthology.orchestra.run.smithi022.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-19T08:52:00.686 INFO:teuthology.orchestra.run.smithi001.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 1.4 MB 00:00 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi022.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.0 MB/s | 320 kB 00:00 2024-09-19T08:52:00.757 INFO:teuthology.orchestra.run.smithi022.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.5 MB/s | 300 kB 00:00 2024-09-19T08:52:00.782 INFO:teuthology.orchestra.run.smithi022.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.8 MB/s | 99 kB 00:00 2024-09-19T08:52:00.809 INFO:teuthology.orchestra.run.smithi022.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.6 MB/s | 85 kB 00:00 2024-09-19T08:52:00.868 INFO:teuthology.orchestra.run.smithi022.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T08:52:00.880 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-09-19T08:52:00.943 INFO:teuthology.orchestra.run.smithi022.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 425 kB/s | 32 kB 00:00 2024-09-19T08:52:01.002 INFO:teuthology.orchestra.run.smithi022.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-19T08:52:01.027 INFO:teuthology.orchestra.run.smithi022.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T08:52:01.046 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-09-19T08:52:01.046 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-09-19T08:52:01.094 INFO:teuthology.orchestra.run.smithi001.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-19T08:52:01.302 INFO:teuthology.orchestra.run.smithi022.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T08:52:01.411 INFO:teuthology.orchestra.run.smithi022.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.3 MB/s | 249 kB 00:00 2024-09-19T08:52:01.494 INFO:teuthology.orchestra.run.smithi022.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-19T08:52:01.519 INFO:teuthology.orchestra.run.smithi022.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 454 kB/s | 49 kB 00:00 2024-09-19T08:52:01.545 INFO:teuthology.orchestra.run.smithi022.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 327 kB/s | 16 kB 00:00 2024-09-19T08:52:01.595 INFO:teuthology.orchestra.run.smithi022.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T08:52:02.012 INFO:teuthology.orchestra.run.smithi022.stdout:(37/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 21 MB/s | 49 MB 00:02 2024-09-19T08:52:02.037 INFO:teuthology.orchestra.run.smithi022.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 41 kB/s | 18 kB 00:00 2024-09-19T08:52:02.063 INFO:teuthology.orchestra.run.smithi022.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 1.4 MB/s | 765 kB 00:00 2024-09-19T08:52:02.155 INFO:teuthology.orchestra.run.smithi022.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-19T08:52:02.188 INFO:teuthology.orchestra.run.smithi022.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-19T08:52:02.230 INFO:teuthology.orchestra.run.smithi022.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T08:52:02.272 INFO:teuthology.orchestra.run.smithi022.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T08:52:02.297 INFO:teuthology.orchestra.run.smithi022.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-19T08:52:02.331 INFO:teuthology.orchestra.run.smithi022.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T08:52:02.352 INFO:teuthology.orchestra.run.smithi001.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi022.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi001.stdout:Total 16 MB/s | 226 MB 00:13 2024-09-19T08:52:02.382 INFO:teuthology.orchestra.run.smithi022.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T08:52:02.476 INFO:teuthology.orchestra.run.smithi022.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-09-19T08:52:02.574 INFO:teuthology.orchestra.run.smithi022.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-19T08:52:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-19T08:52:02.633 INFO:teuthology.orchestra.run.smithi022.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 673 kB/s | 107 kB 00:00 2024-09-19T08:52:02.658 INFO:teuthology.orchestra.run.smithi022.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-19T08:52:02.683 INFO:teuthology.orchestra.run.smithi022.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-19T08:52:02.709 INFO:teuthology.orchestra.run.smithi022.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 433 kB/s | 33 kB 00:00 2024-09-19T08:52:02.750 INFO:teuthology.orchestra.run.smithi022.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-19T08:52:02.776 INFO:teuthology.orchestra.run.smithi022.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-19T08:52:02.835 INFO:teuthology.orchestra.run.smithi022.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-19T08:52:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 541 kB/s | 45 kB 00:00 2024-09-19T08:52:02.885 INFO:teuthology.orchestra.run.smithi022.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-19T08:52:02.919 INFO:teuthology.orchestra.run.smithi022.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-19T08:52:02.939 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-09-19T08:52:02.940 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-09-19T08:52:02.944 INFO:teuthology.orchestra.run.smithi022.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-19T08:52:02.969 INFO:teuthology.orchestra.run.smithi022.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-19T08:52:02.994 INFO:teuthology.orchestra.run.smithi022.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-19T08:52:03.020 INFO:teuthology.orchestra.run.smithi022.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-19T08:52:03.045 INFO:teuthology.orchestra.run.smithi022.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-19T08:52:03.070 INFO:teuthology.orchestra.run.smithi022.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-19T08:52:03.179 INFO:teuthology.orchestra.run.smithi022.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-19T08:52:03.221 INFO:teuthology.orchestra.run.smithi022.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T08:52:03.288 INFO:teuthology.orchestra.run.smithi022.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T08:52:03.313 INFO:teuthology.orchestra.run.smithi022.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T08:52:03.338 INFO:teuthology.orchestra.run.smithi022.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-19T08:52:03.397 INFO:teuthology.orchestra.run.smithi022.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-19T08:52:03.422 INFO:teuthology.orchestra.run.smithi022.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-19T08:52:03.506 INFO:teuthology.orchestra.run.smithi022.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-19T08:52:03.531 INFO:teuthology.orchestra.run.smithi022.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-09-19T08:52:03.581 INFO:teuthology.orchestra.run.smithi022.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-19T08:52:03.607 INFO:teuthology.orchestra.run.smithi022.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-19T08:52:03.625 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-19T08:52:03.648 INFO:teuthology.orchestra.run.smithi022.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-09-19T08:52:03.724 INFO:teuthology.orchestra.run.smithi022.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-19T08:52:03.749 INFO:teuthology.orchestra.run.smithi022.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-09-19T08:52:03.775 INFO:teuthology.orchestra.run.smithi022.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-19T08:52:03.795 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-19T08:52:03.795 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-19T08:52:03.800 INFO:teuthology.orchestra.run.smithi022.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi022.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-19T08:52:03.876 INFO:teuthology.orchestra.run.smithi022.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-19T08:52:03.934 INFO:teuthology.orchestra.run.smithi022.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-19T08:52:03.959 INFO:teuthology.orchestra.run.smithi022.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 507 kB/s | 42 kB 00:00 2024-09-19T08:52:03.984 INFO:teuthology.orchestra.run.smithi022.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 576 kB/s | 77 kB 00:00 2024-09-19T08:52:04.010 INFO:teuthology.orchestra.run.smithi022.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-19T08:52:04.035 INFO:teuthology.orchestra.run.smithi022.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T08:52:04.060 INFO:teuthology.orchestra.run.smithi022.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-19T08:52:04.085 INFO:teuthology.orchestra.run.smithi022.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 678 kB/s | 51 kB 00:00 2024-09-19T08:52:04.111 INFO:teuthology.orchestra.run.smithi022.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-19T08:52:04.161 INFO:teuthology.orchestra.run.smithi022.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-19T08:52:04.186 INFO:teuthology.orchestra.run.smithi022.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-19T08:52:04.228 INFO:teuthology.orchestra.run.smithi022.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T08:52:04.254 INFO:teuthology.orchestra.run.smithi022.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-09-19T08:52:04.296 INFO:teuthology.orchestra.run.smithi022.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-19T08:52:04.514 INFO:teuthology.orchestra.run.smithi022.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-19T08:52:04.514 INFO:teuthology.orchestra.run.smithi022.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-09-19T08:52:04.538 INFO:teuthology.orchestra.run.smithi022.stdout:(100/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-19T08:52:04.563 INFO:teuthology.orchestra.run.smithi022.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-19T08:52:04.589 INFO:teuthology.orchestra.run.smithi022.stdout:(102/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 382 kB/s | 96 kB 00:00 2024-09-19T08:52:04.614 INFO:teuthology.orchestra.run.smithi022.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 596 kB/s | 45 kB 00:00 2024-09-19T08:52:04.664 INFO:teuthology.orchestra.run.smithi022.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:52:04.689 INFO:teuthology.orchestra.run.smithi022.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-19T08:52:04.723 INFO:teuthology.orchestra.run.smithi022.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-19T08:52:04.748 INFO:teuthology.orchestra.run.smithi022.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 331 kB/s | 19 kB 00:00 2024-09-19T08:52:04.774 INFO:teuthology.orchestra.run.smithi022.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T08:52:04.807 INFO:teuthology.orchestra.run.smithi022.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T08:52:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T08:52:04.883 INFO:teuthology.orchestra.run.smithi022.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-19T08:52:04.917 INFO:teuthology.orchestra.run.smithi022.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-19T08:52:05.042 INFO:teuthology.orchestra.run.smithi022.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-19T08:52:05.067 INFO:teuthology.orchestra.run.smithi022.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:52:05.092 INFO:teuthology.orchestra.run.smithi022.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T08:52:05.118 INFO:teuthology.orchestra.run.smithi022.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-09-19T08:52:05.143 INFO:teuthology.orchestra.run.smithi022.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T08:52:05.168 INFO:teuthology.orchestra.run.smithi022.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T08:52:05.202 INFO:teuthology.orchestra.run.smithi022.stdout:(119/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.6 MB/s | 839 kB 00:00 2024-09-19T08:52:05.227 INFO:teuthology.orchestra.run.smithi022.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T08:52:05.253 INFO:teuthology.orchestra.run.smithi022.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T08:52:05.277 INFO:teuthology.orchestra.run.smithi022.stdout:(122/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-19T08:52:05.303 INFO:teuthology.orchestra.run.smithi022.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T08:52:05.328 INFO:teuthology.orchestra.run.smithi022.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-19T08:52:05.353 INFO:teuthology.orchestra.run.smithi022.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-19T08:52:05.379 INFO:teuthology.orchestra.run.smithi022.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-19T08:52:05.404 INFO:teuthology.orchestra.run.smithi022.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T08:52:05.487 INFO:teuthology.orchestra.run.smithi022.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-09-19T08:52:05.513 INFO:teuthology.orchestra.run.smithi022.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:52:05.546 INFO:teuthology.orchestra.run.smithi022.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T08:52:05.572 INFO:teuthology.orchestra.run.smithi022.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T08:52:05.614 INFO:teuthology.orchestra.run.smithi022.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-19T08:52:05.639 INFO:teuthology.orchestra.run.smithi022.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-19T08:52:05.664 INFO:teuthology.orchestra.run.smithi022.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T08:52:05.689 INFO:teuthology.orchestra.run.smithi022.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T08:52:05.723 INFO:teuthology.orchestra.run.smithi022.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-19T08:52:05.749 INFO:teuthology.orchestra.run.smithi022.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2024-09-19T08:52:05.799 INFO:teuthology.orchestra.run.smithi022.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-19T08:52:05.824 INFO:teuthology.orchestra.run.smithi022.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T08:52:05.849 INFO:teuthology.orchestra.run.smithi022.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 590 kB/s | 59 kB 00:00 2024-09-19T08:52:05.875 INFO:teuthology.orchestra.run.smithi022.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-09-19T08:52:05.900 INFO:teuthology.orchestra.run.smithi022.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T08:52:05.925 INFO:teuthology.orchestra.run.smithi022.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:52:05.950 INFO:teuthology.orchestra.run.smithi022.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T08:52:05.976 INFO:teuthology.orchestra.run.smithi022.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-19T08:52:06.001 INFO:teuthology.orchestra.run.smithi022.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T08:52:06.026 INFO:teuthology.orchestra.run.smithi022.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-19T08:52:06.085 INFO:teuthology.orchestra.run.smithi022.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:52:06.114 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-19T08:52:06.115 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-19T08:52:06.294 INFO:teuthology.orchestra.run.smithi022.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T08:52:06.427 INFO:teuthology.orchestra.run.smithi022.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.9 MB/s | 3.2 MB 00:00 2024-09-19T08:52:06.511 INFO:teuthology.orchestra.run.smithi022.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 492 kB/s | 41 kB 00:00 2024-09-19T08:52:06.594 INFO:teuthology.orchestra.run.smithi022.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-19T08:52:06.711 INFO:teuthology.orchestra.run.smithi022.stdout:(153/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.8 MB/s | 2.3 MB 00:00 2024-09-19T08:52:06.745 INFO:teuthology.orchestra.run.smithi022.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-09-19T08:52:06.845 INFO:teuthology.orchestra.run.smithi022.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-19T08:52:07.378 INFO:teuthology.orchestra.run.smithi022.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 2.4 MB 00:00 2024-09-19T08:52:07.384 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:52:07.384 INFO:teuthology.orchestra.run.smithi022.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-19T08:52:08.754 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-19T08:52:08.754 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-19T08:52:09.579 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-09-19T08:52:09.687 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:52:09.726 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:52:09.830 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:52:09.855 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:52:09.899 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:52:10.245 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:52:10.448 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:52:10.573 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:52:10.599 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:52:10.655 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-19T08:52:10.656 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-19T08:52:10.691 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:52:10.720 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:52:10.877 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:52:10.934 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:52:10.961 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:52:11.067 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:52:11.096 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:52:11.158 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:52:11.180 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:52:11.201 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:52:11.390 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:52:11.518 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:52:11.653 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:52:11.869 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:11.955 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:12.169 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:12.308 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:52:12.400 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:52:12.438 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:52:12.473 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:52:12.556 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-19T08:52:12.565 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:52:12.634 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:52:12.673 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:52:12.707 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:52:12.717 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:52:12.750 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:52:12.777 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:52:12.793 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:52:12.848 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:52:12.909 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:52:12.946 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:52:12.987 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:52:12.990 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:52:13.042 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:52:13.066 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:52:13.069 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:52:13.127 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:52:13.218 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:52:13.261 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:52:13.289 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:52:13.370 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:52:13.413 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:52:13.483 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:52:13.490 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:52:13.593 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:52:13.643 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:52:13.699 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:52:13.742 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:52:13.777 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:52:13.869 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:52:13.904 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:52:14.078 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:52:14.159 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:52:14.189 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:52:14.251 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:52:14.304 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:52:14.332 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:52:14.337 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:52:14.381 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:52:14.387 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:52:14.417 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:52:14.424 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:52:14.438 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:52:14.462 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:52:14.504 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:52:14.629 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:52:14.682 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:52:14.741 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:52:14.797 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:52:14.807 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:52:14.871 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:52:14.909 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:52:14.931 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:52:14.954 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:52:15.009 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:52:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:15.044 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:52:15.088 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:52:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:15.130 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:52:15.272 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:52:15.307 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:52:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:15.348 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:52:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:52:15.454 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:52:15.498 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:52:15.538 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:52:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:52:15.563 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:52:15.588 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:52:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:52:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:52:15.665 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:52:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:52:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:52:15.793 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:52:15.807 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:52:15.850 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:52:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:52:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:52:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:52:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:52:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:52:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:52:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:52:16.214 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:52:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:52:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:52:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:52:16.387 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:52:16.438 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:52:16.456 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:52:16.501 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:52:16.524 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:52:16.541 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:52:16.589 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:52:16.618 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:52:16.653 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:52:16.669 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:52:16.686 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:52:16.725 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:52:16.729 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:52:16.779 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:52:16.874 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:52:16.927 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:52:16.965 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:52:17.027 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-19T08:52:17.083 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:52:17.115 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:52:17.142 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:52:17.229 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:52:17.279 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:52:17.372 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:52:17.407 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:52:17.428 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:52:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:52:17.468 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:52:17.487 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:52:17.492 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:52:17.540 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:52:17.546 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:52:17.709 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:52:17.773 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:52:17.838 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:52:17.894 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:52:17.896 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:52:17.912 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:52:17.938 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:52:17.950 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:52:17.971 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:52:17.985 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:52:18.009 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:52:18.033 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:52:18.068 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:52:18.075 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:52:18.128 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:52:18.133 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:52:18.161 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:52:18.162 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:52:18.173 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:52:18.252 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:52:18.262 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:52:18.281 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:52:18.307 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:52:18.372 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:52:18.436 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:52:18.487 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:52:18.498 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:52:18.514 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:52:18.526 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:52:18.530 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:52:18.572 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:52:18.609 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:52:18.611 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:52:18.613 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:52:18.640 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:52:18.703 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:52:18.720 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:52:18.724 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:52:18.744 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:52:18.756 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:52:18.805 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:52:18.837 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:52:18.863 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:52:18.901 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:52:18.958 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:52:19.059 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:52:19.093 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:52:19.135 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:52:19.173 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:52:19.174 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:52:19.223 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:52:19.265 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:19.271 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:52:19.285 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:52:19.311 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:52:19.340 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:52:19.358 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:19.370 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:52:19.398 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:52:19.411 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:52:19.453 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:52:19.496 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:52:19.586 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:52:19.588 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:52:19.635 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:52:19.666 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:52:19.700 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:52:19.773 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:52:19.794 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:52:19.829 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:52:19.834 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:52:19.865 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:52:19.943 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:52:19.995 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:52:20.037 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:52:20.087 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:52:20.119 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:52:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:52:20.209 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:52:20.262 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:52:20.299 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:52:20.335 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:52:20.413 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:52:20.446 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:52:20.489 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:52:20.518 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:52:20.590 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:52:20.596 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:52:20.641 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:52:20.649 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:52:20.681 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:52:20.692 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:52:20.718 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:52:20.784 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:52:20.785 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:52:20.812 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:52:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:52:20.845 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:52:20.863 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:52:20.891 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:52:20.919 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:52:20.988 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:52:21.025 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:52:21.172 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:52:21.216 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:52:21.226 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:52:21.256 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:52:21.301 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:52:21.331 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:52:21.336 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:52:21.368 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:52:21.470 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:52:21.558 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:52:21.593 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:52:21.644 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:52:21.682 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:52:21.724 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:52:21.875 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:52:21.901 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:52:21.962 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:52:21.996 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:52:22.018 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:52:22.036 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:52:22.068 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:52:22.092 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:52:22.098 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:52:22.130 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:52:22.158 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:52:22.165 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:52:22.213 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:52:22.249 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:52:22.292 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:52:22.334 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:52:22.517 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:52:22.552 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:52:22.594 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:52:22.700 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:52:22.735 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:52:22.775 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:52:22.801 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:52:22.826 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:52:22.903 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:52:23.031 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:52:23.066 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:52:23.094 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:52:23.128 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:52:23.168 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:52:23.200 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:52:23.229 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:52:23.264 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:52:23.297 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:52:23.339 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:52:23.373 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:52:23.462 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:52:23.503 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:52:23.512 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:52:23.543 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:52:23.593 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:52:23.630 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:52:23.650 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:52:23.671 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:52:23.711 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:52:23.997 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:52:24.033 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:52:24.125 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:52:24.163 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:52:24.200 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:52:24.468 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:52:24.511 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:24.525 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:52:24.553 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:24.558 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:52:24.663 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:52:24.707 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:52:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:52:24.745 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:52:24.767 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:52:24.825 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:52:24.855 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:52:24.860 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:52:24.895 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:52:25.087 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:52:25.117 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:52:25.125 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:25.164 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:52:25.197 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:52:25.256 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:52:25.256 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:52:25.256 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:52:25.256 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:25.290 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:52:25.879 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:52:27.285 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:52:27.313 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:27.351 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:27.365 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:52:27.393 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:52:27.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:52:27.822 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:52:27.863 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:52:27.937 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:27.938 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:52:27.969 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:52:27.979 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:52:28.005 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:52:28.071 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:52:28.071 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:52:28.071 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:52:28.071 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:28.114 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:52:28.514 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:52:28.550 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:52:28.621 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:52:28.651 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:52:31.445 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:31.493 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:32.062 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:52:32.102 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:52:32.198 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:52:32.198 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:52:32.198 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:52:32.198 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:32.228 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:52:37.286 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:52:37.286 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /sys 2024-09-19T08:52:37.286 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /proc 2024-09-19T08:52:37.286 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /mnt 2024-09-19T08:52:37.286 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /var/tmp 2024-09-19T08:52:37.287 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /home 2024-09-19T08:52:37.287 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /root 2024-09-19T08:52:37.287 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /tmp 2024-09-19T08:52:37.287 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:37.469 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:52:37.484 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:52:37.485 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:37.485 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:52:37.485 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:39.014 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:52:39.040 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:52:39.040 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:39.040 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:52:39.040 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:52:39.040 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:52:39.040 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:39.289 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:52:39.313 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:52:39.313 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:39.313 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:52:39.313 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:52:39.313 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:52:39.313 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:39.774 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:52:39.797 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:52:39.797 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:39.797 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:52:39.797 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:52:39.797 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:52:39.797 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:39.904 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:52:39.963 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:52:40.027 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:52:40.221 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:52:40.275 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:52:40.356 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:52:40.446 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:52:40.559 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:52:40.559 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-09-19T08:52:40.559 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-09-19T08:52:40.559 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-09-19T08:52:40.559 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-09-19T08:52:40.559 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-09-19T08:52:40.559 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-09-19T08:52:40.560 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-09-19T08:52:40.560 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:40.589 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:52:40.642 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:52:40.674 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:52:40.701 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:52:40.752 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:52:40.785 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:52:40.785 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:40.785 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:52:40.785 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:41.130 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:52:41.158 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:52:41.190 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:52:41.254 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:52:41.281 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:52:42.314 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:52:42.342 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:52:42.342 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:42.342 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:52:42.342 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:52:42.342 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:52:42.343 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:42.389 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:52:42.424 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:52:42.581 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:52:42.605 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:52:42.606 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:43.064 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:52:43.089 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:43.196 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:52:43.253 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:52:43.325 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:52:43.439 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:52:43.475 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:52:43.529 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:52:43.586 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:52:43.587 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:52:43.672 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:52:43.744 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:52:43.761 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:52:43.768 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:52:43.792 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:52:43.792 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:43.793 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:52:43.793 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:52:43.793 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:52:43.793 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:43.853 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:52:43.864 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:52:43.912 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:52:43.964 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:52:43.966 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:52:43.998 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:52:44.018 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:52:44.025 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:52:44.271 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:52:44.272 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-09-19T08:52:44.272 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-09-19T08:52:44.272 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-09-19T08:52:44.272 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-09-19T08:52:44.272 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-09-19T08:52:44.272 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-09-19T08:52:44.272 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-09-19T08:52:44.272 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:44.448 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:52:44.464 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:52:44.464 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:44.464 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:52:44.464 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:44.505 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:52:44.532 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:52:44.564 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:52:44.630 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:52:44.655 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:52:44.993 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:52:45.030 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:52:45.053 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:52:45.053 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:45.053 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:52:45.053 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:52:45.053 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:52:45.054 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:45.098 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:52:45.120 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:52:45.120 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:45.120 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:52:45.120 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:45.165 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:52:45.187 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:52:45.187 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:45.187 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:52:45.187 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:52:45.187 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:52:45.188 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:45.507 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:52:45.530 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:52:45.530 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:45.530 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:52:45.530 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:52:45.530 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:52:45.530 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:52:45.764 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:52:45.799 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:52:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:52:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:52:46.019 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:46.019 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:52:46.019 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:52:46.020 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:52:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:52:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:52:46.291 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:46.291 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:52:46.291 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:52:46.292 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:52:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:52:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:52:46.775 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:46.775 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:52:46.775 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:52:46.775 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:52:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:46.812 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:52:46.841 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:52:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:52:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:52:46.950 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:52:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:52:47.119 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:52:47.151 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:52:47.177 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:52:47.177 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:47.177 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:52:47.177 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:52:47.177 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:52:47.177 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:52:47.226 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:52:47.238 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:52:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:52:47.326 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:52:47.340 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:52:47.397 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:52:47.415 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:52:47.573 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:52:47.613 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:52:47.644 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:52:47.671 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:52:48.050 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:52:48.081 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:52:48.110 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:52:48.175 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:52:48.201 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:52:48.376 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:52:48.412 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:52:48.437 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:52:48.437 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:48.437 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:52:48.438 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:52:48.438 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:52:48.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:48.479 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:52:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:52:48.504 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:48.504 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:52:48.504 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:48.555 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:52:48.580 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:52:48.581 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:48.581 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:52:48.581 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:52:48.581 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:52:48.581 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:48.897 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:52:48.922 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:52:48.923 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:48.923 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:52:48.923 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:52:48.923 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:52:48.923 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:52:49.310 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:52:49.353 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:52:50.328 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:52:50.367 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:52:50.378 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:52:50.395 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:52:50.428 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:52:50.459 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:52:50.486 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:52:50.505 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:52:50.673 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:52:50.682 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:52:50.705 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:52:50.724 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:52:50.729 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:52:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:52:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:52:50.729 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:52:50.729 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:50.755 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:52:50.781 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:52:50.784 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:52:50.793 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:52:50.830 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:52:50.894 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:52:50.947 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:52:51.455 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:51.495 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:51.515 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:51.923 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:52:51.950 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:52:51.974 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:52:51.974 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:51.974 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:52:51.974 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:52:51.974 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:52:51.974 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:52.017 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:52:52.040 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:52.085 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:52:52.108 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:52:52.108 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:52.108 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:52:52.108 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:52:52.108 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:52:52.108 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:52:52.427 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:52:52.450 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:52:52.450 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:52:52.450 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:52:52.451 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:52:52.451 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:52:52.451 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:52:52.508 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:52:52.550 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:52:52.634 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:52:52.669 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:52:52.695 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:52:52.721 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:52:52.721 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:52:52.813 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:52:52.814 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:52:52.906 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:52:52.931 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:52:52.936 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:52:52.936 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:52:53.116 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:52:53.116 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:52:53.200 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:52:53.291 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:52:53.768 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:52:53.810 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:52:53.851 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:52:53.882 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:52:53.910 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:52:54.107 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:52:54.156 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:52:54.186 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:52:54.216 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:52:54.262 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:52:54.934 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:54.976 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:54.998 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:52:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:52:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:52:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:52:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:52:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:52:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:52:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:52:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:52:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:52:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:52:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:52:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:52:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:52:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:52:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:52:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:52:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:52:57.265 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:52:57.306 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:52:57.347 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:52:57.379 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:52:57.406 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:52:57.602 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:52:57.644 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:52:57.676 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:52:57.704 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:52:57.783 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:52:58.366 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:58.406 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:52:59.070 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:52:59.070 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:52:59.070 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:52:59.070 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:52:59.070 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:52:59.070 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:52:59.070 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:52:59.070 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:52:59.071 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:52:59.072 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:52:59.072 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:52:59.072 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:52:59.072 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:52:59.072 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:52:59.072 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:52:59.072 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:52:59.072 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:52:59.084 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:52:59.084 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:52:59.085 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:52:59.086 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:52:59.087 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:52:59.088 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:52:59.337 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:52:59.428 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:52:59.470 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:52:59.554 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:52:59.581 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:52:59.606 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:52:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:52:59.633 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:52:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:52:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:52:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:52:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:52:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:52:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:53:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:53:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:53:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:53:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:53:01.698 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:53:01.698 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:53:01.698 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:53:01.699 INFO:teuthology.orchestra.run.smithi064.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.700 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.701 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:53:01.702 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.703 INFO:teuthology.orchestra.run.smithi064.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:53:01.704 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:53:01.705 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:53:01.706 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:53:01.707 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.708 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:53:01.709 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:53:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:53:01.711 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:53:01.712 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:53:01.712 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:53:01.712 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-09-19T08:53:02.262 DEBUG:teuthology.parallel:result is None 2024-09-19T08:53:02.500 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:53:02.500 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:53:02.501 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:53:02.502 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:53:02.503 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:53:02.516 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:53:02.517 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:53:02.518 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:53:02.519 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:53:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:53:02.521 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:53:02.522 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:53:02.523 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:53:02.524 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:53:02.525 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:53:02.526 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:53:02.527 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:53:02.527 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:53:02.527 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:53:02.527 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:53:05.406 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:53:05.406 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:53:05.406 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-09-19T08:53:05.406 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:05.406 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:05.407 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:05.407 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:05.407 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.407 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.407 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:05.407 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:05.407 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-19T08:53:05.407 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.408 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.409 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:53:05.410 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.411 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:53:05.412 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.413 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:53:05.414 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:53:05.415 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:53:05.416 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:53:05.417 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:53:05.418 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:53:05.419 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:53:05.420 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:53:05.420 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-19T08:53:05.734 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:53:05.734 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:53:05.734 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:53:05.734 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:53:05.734 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:53:05.735 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:53:05.735 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:53:05.735 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:53:05.735 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:53:05.735 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:53:05.735 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:53:05.735 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:53:05.735 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:53:05.736 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:53:05.737 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:53:05.738 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:53:05.739 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:53:05.740 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:53:05.741 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:53:05.742 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:53:05.743 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:53:05.744 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:53:05.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:53:05.746 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:53:05.747 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:53:05.748 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:53:05.829 DEBUG:teuthology.parallel:result is None 2024-09-19T08:53:08.237 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:53:08.237 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:53:08.237 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-09-19T08:53:08.237 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.238 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:53:08.240 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.241 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.242 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:53:08.243 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.244 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:53:08.245 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:53:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:53:08.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:53:08.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:53:08.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.250 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:53:08.251 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:53:08.251 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:53:08.251 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:53:08.251 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:53:08.251 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:53:08.251 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:53:08.251 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:53:08.252 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:53:08.252 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-19T08:53:08.642 DEBUG:teuthology.parallel:result is None 2024-09-19T08:53:08.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:53:08.789 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:53:08.816 INFO:teuthology.orchestra.run.smithi001.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:53:08.816 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:53:08.817 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:53:08.818 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:53:08.956 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:53:08.980 INFO:teuthology.orchestra.run.smithi022.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:53:08.980 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:53:08.980 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:53:08.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:53:09.121 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:53:09.147 INFO:teuthology.orchestra.run.smithi064.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:53:09.147 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:53:09.147 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:53:09.149 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:53:09.149 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:53:09.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:53:09.183 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:53:09.183 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:53:09.215 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:53:09.215 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:53:09.247 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:53:09.247 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:53:09.248 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:53:09.278 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:53:09.348 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:53:09.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:53:09.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:53:09.445 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:53:09.445 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:53:09.476 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:53:09.544 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:53:09.545 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:53:09.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:53:09.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:53:09.644 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:53:09.644 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:53:09.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:53:09.741 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:53:09.742 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:53:09.771 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:53:09.839 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:53:09.840 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:53:09.840 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:53:09.871 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:53:09.942 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:53:09.942 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:53:09.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:53:10.042 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:53:10.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:53:10.072 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:53:10.140 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T08:53:10.241 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T08:53:10.242 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:53:10.242 INFO:tasks.cephadm:Cluster fsid is 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:53:10.242 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T08:53:10.243 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.1', 'mon.b': '172.21.15.22', 'mon.c': '172.21.15.64'} 2024-09-19T08:53:10.243 INFO:tasks.cephadm:First mon is mon.a on smithi001 2024-09-19T08:53:10.243 INFO:tasks.cephadm:First mgr is x 2024-09-19T08:53:10.243 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T08:53:10.243 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname $(hostname -s) 2024-09-19T08:53:10.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2024-09-19T08:53:10.304 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname $(hostname -s) 2024-09-19T08:53:10.333 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T08:53:10.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:53:10.473 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T08:53:10.606 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:53:10.608 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:53:10.608 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:53:10.608 DEBUG:teuthology.orchestra.run.smithi001:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:10.994 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:53 /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:10.995 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:11.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:53 /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:11.417 DEBUG:teuthology.orchestra.run.smithi064:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:11.808 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:53 /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:11.808 DEBUG:teuthology.orchestra.run.smithi001:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:11.829 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:11.850 DEBUG:teuthology.orchestra.run.smithi064:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:53:12.197 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T08:53:12.198 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:53:12.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:53:12.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:53:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:53:13.771 INFO:teuthology.orchestra.run.smithi064.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:53:14.086 INFO:teuthology.orchestra.run.smithi001.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:53:46.147 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T08:53:46.148 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:53:46.148 INFO:teuthology.orchestra.run.smithi001.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:53:46.148 INFO:teuthology.orchestra.run.smithi001.stdout: "repo_digests": [ 2024-09-19T08:53:46.148 INFO:teuthology.orchestra.run.smithi001.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:53:46.148 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T08:53:46.148 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T08:53:47.835 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T08:53:47.836 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:53:47.836 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:53:47.836 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2024-09-19T08:53:47.836 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:53:47.836 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-19T08:53:47.836 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T08:54:03.433 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-19T08:54:03.433 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:54:03.433 INFO:teuthology.orchestra.run.smithi064.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:54:03.434 INFO:teuthology.orchestra.run.smithi064.stdout: "repo_digests": [ 2024-09-19T08:54:03.434 INFO:teuthology.orchestra.run.smithi064.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:54:03.434 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-09-19T08:54:03.434 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-19T08:54:03.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph 2024-09-19T08:54:03.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2024-09-19T08:54:03.528 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph 2024-09-19T08:54:03.556 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /etc/ceph 2024-09-19T08:54:03.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2024-09-19T08:54:03.614 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /etc/ceph 2024-09-19T08:54:03.639 INFO:tasks.cephadm:Writing seed config... 2024-09-19T08:54:03.640 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-19T08:54:03.640 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T08:54:03.640 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T08:54:03.640 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T08:54:03.641 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T08:54:03.642 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T08:54:03.643 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T08:54:03.644 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T08:54:03.644 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T08:54:03.644 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T08:54:03.644 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T08:54:03.644 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T08:54:03.645 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:54:03.645 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T08:54:03.662 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 98b2a8e0-7664-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T08:54:03.663 DEBUG:teuthology.orchestra.run.smithi001:mon.a> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T08:54:03.705 DEBUG:teuthology.orchestra.run.smithi001:mgr.x> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T08:54:03.748 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T08:54:03.749 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.1 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:03.963 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:54:03.963 INFO:teuthology.orchestra.run.smithi001.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '98b2a8e0-7664-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.1', '--skip-admin-label'] 2024-09-19T08:54:03.963 INFO:teuthology.orchestra.run.smithi001.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T08:54:03.964 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying podman|docker is present... 2024-09-19T08:54:03.989 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:54:03.989 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying lvm2 is present... 2024-09-19T08:54:03.989 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying time synchronization is in place... 2024-09-19T08:54:03.997 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:54:03.997 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:54:04.003 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:54:04.003 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T08:54:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-19T08:54:04.017 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-19T08:54:04.017 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:54:04.017 INFO:teuthology.orchestra.run.smithi001.stdout:Repeating the final host check... 2024-09-19T08:54:04.041 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:54:04.041 INFO:teuthology.orchestra.run.smithi001.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T08:54:04.041 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl is present 2024-09-19T08:54:04.041 INFO:teuthology.orchestra.run.smithi001.stdout:lvcreate is present 2024-09-19T08:54:04.048 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:54:04.048 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:54:04.054 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:54:04.054 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T08:54:04.061 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-19T08:54:04.068 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-19T08:54:04.068 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:54:04.068 INFO:teuthology.orchestra.run.smithi001.stdout:Host looks OK 2024-09-19T08:54:04.068 INFO:teuthology.orchestra.run.smithi001.stdout:Cluster fsid: 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:04.068 INFO:teuthology.orchestra.run.smithi001.stdout:Acquiring lock 140080417907712 on /run/cephadm/98b2a8e0-7664-11ef-bceb-c7b262605968.lock 2024-09-19T08:54:04.068 INFO:teuthology.orchestra.run.smithi001.stdout:Lock 140080417907712 acquired on /run/cephadm/98b2a8e0-7664-11ef-bceb-c7b262605968.lock 2024-09-19T08:54:04.069 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 3300 ... 2024-09-19T08:54:04.069 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 6789 ... 2024-09-19T08:54:04.069 INFO:teuthology.orchestra.run.smithi001.stdout:Base mon IP(s) is [172.21.15.1:3300, 172.21.15.1:6789], mon addrv is [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T08:54:04.073 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.1 metric 100 2024-09-19T08:54:04.073 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.1 metric 100 2024-09-19T08:54:04.075 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T08:54:04.076 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T08:54:04.076 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1779sec hoplimit 64 pref medium 2024-09-19T08:54:04.078 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T08:54:04.078 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T08:54:04.078 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:54:04.078 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T08:54:04.078 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-19T08:54:04.078 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:54:04.079 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-19T08:54:04.079 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-19T08:54:04.079 INFO:teuthology.orchestra.run.smithi001.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T08:54:04.080 INFO:teuthology.orchestra.run.smithi001.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T08:54:04.080 INFO:teuthology.orchestra.run.smithi001.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:54:04.531 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:54:04.531 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:54:04.532 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T08:54:04.532 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T08:54:04.532 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T08:54:04.532 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:54:04.532 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T08:54:05.461 INFO:teuthology.orchestra.run.smithi001.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:54:05.461 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:54:05.462 INFO:teuthology.orchestra.run.smithi001.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T08:54:06.434 INFO:teuthology.orchestra.run.smithi001.stdout:stat: stdout 167 167 2024-09-19T08:54:06.434 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial keys... 2024-09-19T08:54:07.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQCu5utmhpndKxAAkZUDpsg6ulaiOz/wSXLipA== 2024-09-19T08:54:08.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQCv5utm0zQ4LhAAwNLctUVaC00eHfA5CIgYPQ== 2024-09-19T08:54:09.384 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQCw5utmfzn9LBAA7CWKZ4G7nHohUtZCmDL2dA== 2024-09-19T08:54:09.385 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial monmap... 2024-09-19T08:54:10.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:54:10.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T08:54:10.592 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:10.592 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:54:10.592 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool for a [v2:172.21.15.1:3300,v1:172.21.15.1:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:54:10.592 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-09-19T08:54:10.592 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: set fsid to 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:10.592 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:54:10.592 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:54:10.592 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mon... 2024-09-19T08:54:19.891 INFO:teuthology.orchestra.run.smithi001.stdout:create mon.a on 2024-09-19T08:54:20.292 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T08:54:20.675 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T08:54:21.179 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968.target. 2024-09-19T08:54:21.179 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968.target. 2024-09-19T08:54:21.990 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:54:21.990 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T08:54:22.235 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968.target.wants/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@.service. 2024-09-19T08:54:23.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:22 smithi001 podman[30555]: 2024-09-19 08:54:22.569627348 +0000 UTC m=+0.207539693 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:54:23.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:23 smithi001 podman[30555]: 2024-09-19 08:54:23.007606757 +0000 UTC m=+0.645519093 container create b00c44264777a5ac7edae7d5485df76e2fbbb366491d473d6b887a67dee7ade7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:54:23.275 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:23 smithi001 podman[30555]: 2024-09-19 08:54:23.201681879 +0000 UTC m=+0.839594219 container init b00c44264777a5ac7edae7d5485df76e2fbbb366491d473d6b887a67dee7ade7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T08:54:23.276 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:23 smithi001 podman[30555]: 2024-09-19 08:54:23.205084215 +0000 UTC m=+0.842996552 container start b00c44264777a5ac7edae7d5485df76e2fbbb366491d473d6b887a67dee7ade7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T08:54:23.276 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:23 smithi001 ceph-mon[30574]: mkfs 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:23.276 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:23 smithi001 ceph-mon[30574]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:54:23.276 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:23 smithi001 bash[30555]: b00c44264777a5ac7edae7d5485df76e2fbbb366491d473d6b887a67dee7ade7 2024-09-19T08:54:23.292 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:54:23.292 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T08:54:23.300 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:54:23.300 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T08:54:23.300 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T08:54:23.300 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:54:23.301 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon to start... 2024-09-19T08:54:23.301 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon... 2024-09-19T08:54:23.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:23 smithi001 systemd[1]: Started Ceph mon.a for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T08:54:24.374 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout id: 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout services: 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.540535s) 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout data: 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T08:54:24.375 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.709+0000 7f39e5316640 1 Processor -- start 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.710+0000 7f39e5316640 1 -- start start 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.710+0000 7f39e5316640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e010a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.710+0000 7f39e5316640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f39e0063510 con 0x7f39e0108340 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.710+0000 7f39deffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e010a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.710+0000 7f39deffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e010a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52508/0 (socket says 172.21.15.1:52508) 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.710+0000 7f39deffd640 1 -- 172.21.15.1:0/3306353174 learned_addr learned my addr 172.21.15.1:0/3306353174 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.711+0000 7f39deffd640 1 -- 172.21.15.1:0/3306353174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e010ac70 con 0x7f39e0108340 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.713+0000 7f39deffd640 1 --2- 172.21.15.1:0/3306353174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e010a730 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009820 tx=0x7f39d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c28722b561ff08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:24.376 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.714+0000 7f39ddffb640 1 -- 172.21.15.1:0/3306353174 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d0037070 con 0x7f39e0108340 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.714+0000 7f39ddffb640 1 -- 172.21.15.1:0/3306353174 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d0032440 con 0x7f39e0108340 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.714+0000 7f39ddffb640 1 -- 172.21.15.1:0/3306353174 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d0032740 con 0x7f39e0108340 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.714+0000 7f39e5316640 1 -- 172.21.15.1:0/3306353174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 msgr2=0x7f39e010a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.714+0000 7f39e5316640 1 --2- 172.21.15.1:0/3306353174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e010a730 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009820 tx=0x7f39d002a270 comp rx=0 tx=0).stop 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.715+0000 7f39e5316640 1 -- 172.21.15.1:0/3306353174 shutdown_connections 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.715+0000 7f39e5316640 1 --2- 172.21.15.1:0/3306353174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e010a730 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.715+0000 7f39e5316640 1 -- 172.21.15.1:0/3306353174 >> 172.21.15.1:0/3306353174 conn(0x7f39e0101fa0 msgr2=0x7f39e01043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.715+0000 7f39e5316640 1 -- 172.21.15.1:0/3306353174 shutdown_connections 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.715+0000 7f39e5316640 1 -- 172.21.15.1:0/3306353174 wait complete. 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.715+0000 7f39e5316640 1 Processor -- start 2024-09-19T08:54:24.377 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.716+0000 7f39e5316640 1 -- start start 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.716+0000 7f39e5316640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e0107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.716+0000 7f39e5316640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010b1b0 con 0x7f39e0108340 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.716+0000 7f39deffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e0107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.716+0000 7f39deffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e0107bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52518/0 (socket says 172.21.15.1:52518) 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.716+0000 7f39deffd640 1 -- 172.21.15.1:0/2140527788 learned_addr learned my addr 172.21.15.1:0/2140527788 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.716+0000 7f39deffd640 1 -- 172.21.15.1:0/2140527788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e0108100 con 0x7f39e0108340 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.717+0000 7f39deffd640 1 --2- 172.21.15.1:0/2140527788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e0107bc0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f39d00090b0 tx=0x7f39d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.717+0000 7f39c7fff640 1 -- 172.21.15.1:0/2140527788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d0041070 con 0x7f39e0108340 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.717+0000 7f39c7fff640 1 -- 172.21.15.1:0/2140527788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d003c7a0 con 0x7f39e0108340 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.717+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e01062f0 con 0x7f39e0108340 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.717+0000 7f39c7fff640 1 -- 172.21.15.1:0/2140527788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d0037040 con 0x7f39e0108340 2024-09-19T08:54:24.378 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.717+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e0106830 con 0x7f39e0108340 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.717+0000 7f39c7fff640 1 -- 172.21.15.1:0/2140527788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39d0044070 con 0x7f39e0108340 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.717+0000 7f39c7fff640 1 -- 172.21.15.1:0/2140527788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39d003d3f0 con 0x7f39e0108340 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.718+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e01087a0 con 0x7f39e0108340 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.720+0000 7f39c7fff640 1 -- 172.21.15.1:0/2140527788 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f39d0046450 con 0x7f39e0108340 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.783+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f39e0194a00 con 0x7f39e0108340 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.784+0000 7f39c7fff640 1 -- 172.21.15.1:0/2140527788 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f39d0046630 con 0x7f39e0108340 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.785+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 msgr2=0x7f39e0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.785+0000 7f39e5316640 1 --2- 172.21.15.1:0/2140527788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e0107bc0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f39d00090b0 tx=0x7f39d00046c0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.785+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 shutdown_connections 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.785+0000 7f39e5316640 1 --2- 172.21.15.1:0/2140527788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39e0108340 0x7f39e0107bc0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.785+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 >> 172.21.15.1:0/2140527788 conn(0x7f39e0101fa0 msgr2=0x7f39e0102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.785+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 shutdown_connections 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:23.785+0000 7f39e5316640 1 -- 172.21.15.1:0/2140527788 wait complete. 2024-09-19T08:54:24.379 INFO:teuthology.orchestra.run.smithi001.stdout:mon is available 2024-09-19T08:54:24.380 INFO:teuthology.orchestra.run.smithi001.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T08:54:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:54:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: monmap epoch 1 2024-09-19T08:54:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: last_changed 2024-09-19T08:54:09.693383+0000 2024-09-19T08:54:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:54:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: min_mon_release 19 (squid) 2024-09-19T08:54:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: election_strategy: 1 2024-09-19T08:54:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:54:24.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: fsmap 2024-09-19T08:54:24.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:54:24.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: mgrmap e1: no daemons active 2024-09-19T08:54:24.554 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:24 smithi001 ceph-mon[30574]: from='client.? 172.21.15.1:0/2140527788' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T08:54:25.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:25.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:54:25.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:25.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T08:54:25.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:54:25.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:54:25.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:54:25.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.772+0000 7f9eedf8d640 1 Processor -- start 2024-09-19T08:54:25.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.772+0000 7f9eedf8d640 1 -- start start 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.772+0000 7f9eedf8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee810a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.772+0000 7f9eedf8d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee8063490 con 0x7f9ee81083e0 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.772+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee810a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.772+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee810a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52532/0 (socket says 172.21.15.1:52532) 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.772+0000 7f9ee77fe640 1 -- 172.21.15.1:0/4026303696 learned_addr learned my addr 172.21.15.1:0/4026303696 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.773+0000 7f9ee77fe640 1 -- 172.21.15.1:0/4026303696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee810ad10 con 0x7f9ee81083e0 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.773+0000 7f9ee77fe640 1 --2- 172.21.15.1:0/4026303696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee810a7d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009820 tx=0x7f9ed802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabf89fa9efc725e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.773+0000 7f9ee67fc640 1 -- 172.21.15.1:0/4026303696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8037070 con 0x7f9ee81083e0 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9ee67fc640 1 -- 172.21.15.1:0/4026303696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed8032440 con 0x7f9ee81083e0 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9ee67fc640 1 -- 172.21.15.1:0/4026303696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8032740 con 0x7f9ee81083e0 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9eedf8d640 1 -- 172.21.15.1:0/4026303696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 msgr2=0x7f9ee810a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9eedf8d640 1 --2- 172.21.15.1:0/4026303696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee810a7d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009820 tx=0x7f9ed802a270 comp rx=0 tx=0).stop 2024-09-19T08:54:25.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9eedf8d640 1 -- 172.21.15.1:0/4026303696 shutdown_connections 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9eedf8d640 1 --2- 172.21.15.1:0/4026303696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee810a7d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9eedf8d640 1 -- 172.21.15.1:0/4026303696 >> 172.21.15.1:0/4026303696 conn(0x7f9ee8102060 msgr2=0x7f9ee8104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9eedf8d640 1 -- 172.21.15.1:0/4026303696 shutdown_connections 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.774+0000 7f9eedf8d640 1 -- 172.21.15.1:0/4026303696 wait complete. 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.775+0000 7f9eedf8d640 1 Processor -- start 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.775+0000 7f9eedf8d640 1 -- start start 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.775+0000 7f9eedf8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee819afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.775+0000 7f9eedf8d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee810b180 con 0x7f9ee81083e0 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.775+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee819afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.775+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee819afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52542/0 (socket says 172.21.15.1:52542) 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.775+0000 7f9ee77fe640 1 -- 172.21.15.1:0/819153259 learned_addr learned my addr 172.21.15.1:0/819153259 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.775+0000 7f9ee77fe640 1 -- 172.21.15.1:0/819153259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee819b520 con 0x7f9ee81083e0 2024-09-19T08:54:25.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.776+0000 7f9ee77fe640 1 --2- 172.21.15.1:0/819153259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee819afe0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80090b0 tx=0x7f9ed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.776+0000 7f9ee4ff9640 1 -- 172.21.15.1:0/819153259 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8041070 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.776+0000 7f9ee4ff9640 1 -- 172.21.15.1:0/819153259 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed803c7a0 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.776+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee819b7b0 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.776+0000 7f9ee4ff9640 1 -- 172.21.15.1:0/819153259 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8037040 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.776+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee819e4a0 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.776+0000 7f9ee4ff9640 1 -- 172.21.15.1:0/819153259 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ed8044070 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.776+0000 7f9ee4ff9640 1 -- 172.21.15.1:0/819153259 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9ed803d3f0 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.777+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee8108840 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.779+0000 7f9ee4ff9640 1 -- 172.21.15.1:0/819153259 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9ed8046450 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.839+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9ee802d910 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.842+0000 7f9ee4ff9640 1 -- 172.21.15.1:0/819153259 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f9ed8046630 con 0x7f9ee81083e0 2024-09-19T08:54:25.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.843+0000 7f9ee4ff9640 1 -- 172.21.15.1:0/819153259 <== mon.0 v2:172.21.15.1:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f9ed8056070 con 0x7f9ee81083e0 2024-09-19T08:54:25.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.843+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 msgr2=0x7f9ee819afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:25.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.843+0000 7f9eedf8d640 1 --2- 172.21.15.1:0/819153259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee819afe0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80090b0 tx=0x7f9ed80046c0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.843+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 shutdown_connections 2024-09-19T08:54:25.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.843+0000 7f9eedf8d640 1 --2- 172.21.15.1:0/819153259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ee81083e0 0x7f9ee819afe0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:25.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.843+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 >> 172.21.15.1:0/819153259 conn(0x7f9ee8102060 msgr2=0x7f9ee8103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:25.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.844+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 shutdown_connections 2024-09-19T08:54:25.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:24.844+0000 7f9eedf8d640 1 -- 172.21.15.1:0/819153259 wait complete. 2024-09-19T08:54:25.445 INFO:teuthology.orchestra.run.smithi001.stdout:Generating new minimal ceph.conf... 2024-09-19T08:54:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:25 smithi001 ceph-mon[30574]: from='client.? 172.21.15.1:0/819153259' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:54:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:25 smithi001 ceph-mon[30574]: from='client.? 172.21.15.1:0/819153259' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T08:54:26.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:26 smithi001 ceph-mon[30574]: from='client.? 172.21.15.1:0/3911983418' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.818+0000 7efe8aab7640 1 Processor -- start 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.818+0000 7efe8aab7640 1 -- start start 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.818+0000 7efe8aab7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe8410a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.818+0000 7efe8aab7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efe840634b0 con 0x7efe841083e0 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.819+0000 7efe88853640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe8410a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.819+0000 7efe88853640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe8410a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52548/0 (socket says 172.21.15.1:52548) 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.819+0000 7efe88853640 1 -- 172.21.15.1:0/3959905705 learned_addr learned my addr 172.21.15.1:0/3959905705 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.819+0000 7efe88853640 1 -- 172.21.15.1:0/3959905705 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8410ad10 con 0x7efe841083e0 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe88853640 1 --2- 172.21.15.1:0/3959905705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe8410a7d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efe74009820 tx=0x7efe7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b6b996a7caf71c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe837fe640 1 -- 172.21.15.1:0/3959905705 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe74037070 con 0x7efe841083e0 2024-09-19T08:54:26.598 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe837fe640 1 -- 172.21.15.1:0/3959905705 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efe74032920 con 0x7efe841083e0 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe837fe640 1 -- 172.21.15.1:0/3959905705 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe74030950 con 0x7efe841083e0 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe8aab7640 1 -- 172.21.15.1:0/3959905705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 msgr2=0x7efe8410a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe8aab7640 1 --2- 172.21.15.1:0/3959905705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe8410a7d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efe74009820 tx=0x7efe7402a270 comp rx=0 tx=0).stop 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe8aab7640 1 -- 172.21.15.1:0/3959905705 shutdown_connections 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe8aab7640 1 --2- 172.21.15.1:0/3959905705 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe8410a7d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.820+0000 7efe8aab7640 1 -- 172.21.15.1:0/3959905705 >> 172.21.15.1:0/3959905705 conn(0x7efe84102060 msgr2=0x7efe84104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.821+0000 7efe8aab7640 1 -- 172.21.15.1:0/3959905705 shutdown_connections 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.821+0000 7efe8aab7640 1 -- 172.21.15.1:0/3959905705 wait complete. 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.821+0000 7efe8aab7640 1 Processor -- start 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.821+0000 7efe8aab7640 1 -- start start 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.821+0000 7efe8aab7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe84107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.821+0000 7efe8aab7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efe8410bdb0 con 0x7efe841083e0 2024-09-19T08:54:26.599 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.821+0000 7efe88853640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe84107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:26.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.821+0000 7efe88853640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe84107c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52552/0 (socket says 172.21.15.1:52552) 2024-09-19T08:54:26.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.822+0000 7efe88853640 1 -- 172.21.15.1:0/3911983418 learned_addr learned my addr 172.21.15.1:0/3911983418 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:26.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.822+0000 7efe88853640 1 -- 172.21.15.1:0/3911983418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe841081a0 con 0x7efe841083e0 2024-09-19T08:54:26.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.822+0000 7efe88853640 1 --2- 172.21.15.1:0/3911983418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe84107c60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efe740097f0 tx=0x7efe74032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:26.600 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.822+0000 7efe81ffb640 1 -- 172.21.15.1:0/3911983418 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe74037040 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.822+0000 7efe81ffb640 1 -- 172.21.15.1:0/3911983418 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efe74040070 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.822+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe84106390 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.822+0000 7efe81ffb640 1 -- 172.21.15.1:0/3911983418 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe7403a6d0 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.822+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe841068d0 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.823+0000 7efe81ffb640 1 -- 172.21.15.1:0/3911983418 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe7403a8c0 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.823+0000 7efe81ffb640 1 -- 172.21.15.1:0/3911983418 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efe74045b90 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.823+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe84108840 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.826+0000 7efe81ffb640 1 -- 172.21.15.1:0/3911983418 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efe7403ad40 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.886+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7efe84106bd0 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.886+0000 7efe81ffb640 1 -- 172.21.15.1:0/3911983418 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7efe74045de0 con 0x7efe841083e0 2024-09-19T08:54:26.601 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.887+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 msgr2=0x7efe84107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:26.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.887+0000 7efe8aab7640 1 --2- 172.21.15.1:0/3911983418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe84107c60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efe740097f0 tx=0x7efe74032d00 comp rx=0 tx=0).stop 2024-09-19T08:54:26.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.887+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 shutdown_connections 2024-09-19T08:54:26.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.887+0000 7efe8aab7640 1 --2- 172.21.15.1:0/3911983418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe841083e0 0x7efe84107c60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:26.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.887+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 >> 172.21.15.1:0/3911983418 conn(0x7efe84102060 msgr2=0x7efe84102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:26.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.887+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 shutdown_connections 2024-09-19T08:54:26.602 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:25.887+0000 7efe8aab7640 1 -- 172.21.15.1:0/3911983418 wait complete. 2024-09-19T08:54:26.602 INFO:teuthology.orchestra.run.smithi001.stdout:Restarting the monitor... 2024-09-19T08:54:26.866 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:26 smithi001 systemd[1]: Stopping Ceph mon.a for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T08:54:27.273 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:26 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a[30570]: 2024-09-19T08:54:26.866+0000 7fafe17e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:54:27.274 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:26 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a[30570]: 2024-09-19T08:54:26.866+0000 7fafe17e5640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T08:54:27.274 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:27 smithi001 podman[30818]: 2024-09-19 08:54:27.020272192 +0000 UTC m=+0.248735144 container died b00c44264777a5ac7edae7d5485df76e2fbbb366491d473d6b887a67dee7ade7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T08:54:27.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:27 smithi001 podman[30818]: 2024-09-19 08:54:27.365754558 +0000 UTC m=+0.594217505 container cleanup b00c44264777a5ac7edae7d5485df76e2fbbb366491d473d6b887a67dee7ade7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T08:54:27.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:27 smithi001 bash[30818]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:54:27.782 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:27 smithi001 podman[30830]: 2024-09-19 08:54:27.525034668 +0000 UTC m=+0.494784849 container remove b00c44264777a5ac7edae7d5485df76e2fbbb366491d473d6b887a67dee7ade7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T08:54:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:27 smithi001 systemd[1]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T08:54:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:27 smithi001 systemd[1]: Stopped Ceph mon.a for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T08:54:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:27 smithi001 systemd[1]: Starting Ceph mon.a for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T08:54:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:27 smithi001 podman[30920]: 2024-09-19 08:54:27.900735478 +0000 UTC m=+0.016348933 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:54:28.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 podman[30920]: 2024-09-19 08:54:28.342921241 +0000 UTC m=+0.458534728 container create ba7e58f53a965adb44b7f3813f6198eebd425a0f0ee4f12649e569354a10cb9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 podman[30920]: 2024-09-19 08:54:28.561688293 +0000 UTC m=+0.677301744 container init ba7e58f53a965adb44b7f3813f6198eebd425a0f0ee4f12649e569354a10cb9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 podman[30920]: 2024-09-19 08:54:28.565134745 +0000 UTC m=+0.680748191 container start ba7e58f53a965adb44b7f3813f6198eebd425a0f0ee4f12649e569354a10cb9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: pidfile_write: ignore empty --pid-file 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: load: jerasure load: lrc 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Git sha 0 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: DB SUMMARY 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: DB Session ID: FS1JMM78M11KTCXUF8W1 2024-09-19T08:54:28.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:54:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:54:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T08:54:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T08:54:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106694 ; 2024-09-19T08:54:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:54:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:54:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:54:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:54:28.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:54:28.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:54:28.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.env: 0x55663734d940 2024-09-19T08:54:28.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:54:28.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.info_log: 0x5566380cf6e0 2024-09-19T08:54:28.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:54:28.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.statistics: (nil) 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.use_fsync: 0 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:54:28.596 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.db_log_dir: 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.wal_dir: 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.write_buffer_manager: 0x5566380dedc0 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:54:28.597 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.unordered_write: 0 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.row_cache: None 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.wal_filter: None 2024-09-19T08:54:28.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.wal_compression: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:54:28.599 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:54:28.600 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_open_files: -1 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Compression algorithms supported: 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: kZSTD supported: 0 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:54:28.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.merge_operator: 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_filter: None 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:54:28.602 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5566380cf320) 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_type: 0 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_index_type: 0 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_shortening: 1 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: checksum: 4 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: no_block_cache: 0 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache: 0x5566380c31f0 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:54:28.603 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_options: 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: capacity : 536870912 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_shard_bits : 4 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: strict_capacity_limit : 0 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_compressed: (nil) 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: persistent_cache: (nil) 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size: 4096 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size_deviation: 10 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_restart_interval: 16 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_block_restart_interval: 1 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: metadata_block_size: 4096 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: partition_filters: 0 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: use_delta_encoding: 1 2024-09-19T08:54:28.604 INFO:journalctl@ceph.mon.a.smithi001.stdout: filter_policy: bloomfilter 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: whole_key_filtering: 1 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: verify_compression: 0 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: format_version: 5 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_index_compression: 1 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_align: 0 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: max_auto_readahead_size: 262144 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: prepopulate_block_cache: 0 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:54:28.605 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression: NoCompression 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.num_levels: 7 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:54:28.606 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:54:28.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:54:28.608 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:54:28.608 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:54:28.608 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:54:28.658 INFO:teuthology.orchestra.run.smithi001.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T08:54:28.851 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:54:28.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:54:28.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:54:28.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.ttl: 2592000 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:54:28.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f5cfbfaf-c447-4369-afe3-cc0f21c88dba 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736068594112, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736068595936, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101628, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99513, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14665, "raw_average_key_size": 50, "raw_value_size": 91574, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726736068, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f5cfbfaf-c447-4369-afe3-cc0f21c88dba", "db_session_id": "FS1JMM78M11KTCXUF8W1", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736068596087, "job": 1, "event": "recovery_finished"} 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5566380f0e00 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: DB pointer 0x5566381ec000 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:54:28.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** DB Stats ** 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:54:28.857 INFO:journalctl@ceph.mon.a.smithi001.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: L0 2/0 101.11 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: Sum 2/0 101.11 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 86.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:54:28.858 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative compaction: 0.00 GB write, 21.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval compaction: 0.00 GB write, 21.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache BinnedLRUCache@0x5566380c31f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: starting mon.a rank 0 at public addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] at bind addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a@-1(???) e1 preinit fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a@-1(???).mds e1 new map 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a@-1(???).mds e1 print_map 2024-09-19T08:54:28.859 INFO:journalctl@ceph.mon.a.smithi001.stdout: e1 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout: btime 2024-09-19T08:54:23:245014+0000 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout: legacy client fscid: -1 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout: No filesystems configured 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 bash[30920]: ba7e58f53a965adb44b7f3813f6198eebd425a0f0ee4f12649e569354a10cb9c 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:54:28.860 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: monmap epoch 1 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: last_changed 2024-09-19T08:54:09.693383+0000 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: min_mon_release 19 (squid) 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: election_strategy: 1 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: fsmap 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 ceph-mon[30939]: mgrmap e1: no daemons active 2024-09-19T08:54:28.861 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:28 smithi001 systemd[1]: Started Ceph mon.a for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T08:54:29.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.024+0000 7f84e06c8640 1 Processor -- start 2024-09-19T08:54:29.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.024+0000 7f84e06c8640 1 -- start start 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.025+0000 7f84e06c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d810a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.025+0000 7f84e06c8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80634b0 con 0x7f84d8108390 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.025+0000 7f84de464640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d810a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.025+0000 7f84de464640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d810a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52562/0 (socket says 172.21.15.1:52562) 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.025+0000 7f84de464640 1 -- 172.21.15.1:0/1934910590 learned_addr learned my addr 172.21.15.1:0/1934910590 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.025+0000 7f84de464640 1 -- 172.21.15.1:0/1934910590 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d810acc0 con 0x7f84d8108390 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.027+0000 7f84de464640 1 --2- 172.21.15.1:0/1934910590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d810a780 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009820 tx=0x7f84d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb63067cb6f55912 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.027+0000 7f84dd462640 1 -- 172.21.15.1:0/1934910590 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4037070 con 0x7f84d8108390 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.027+0000 7f84dd462640 1 -- 172.21.15.1:0/1934910590 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f84d4032920 con 0x7f84d8108390 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.027+0000 7f84dd462640 1 -- 172.21.15.1:0/1934910590 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4030950 con 0x7f84d8108390 2024-09-19T08:54:29.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.028+0000 7f84e06c8640 1 -- 172.21.15.1:0/1934910590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 msgr2=0x7f84d810a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.028+0000 7f84e06c8640 1 --2- 172.21.15.1:0/1934910590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d810a780 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009820 tx=0x7f84d402a270 comp rx=0 tx=0).stop 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.028+0000 7f84e06c8640 1 -- 172.21.15.1:0/1934910590 shutdown_connections 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.028+0000 7f84e06c8640 1 --2- 172.21.15.1:0/1934910590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d810a780 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.028+0000 7f84e06c8640 1 -- 172.21.15.1:0/1934910590 >> 172.21.15.1:0/1934910590 conn(0x7f84d8101f50 msgr2=0x7f84d8104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.028+0000 7f84e06c8640 1 -- 172.21.15.1:0/1934910590 shutdown_connections 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.028+0000 7f84e06c8640 1 -- 172.21.15.1:0/1934910590 wait complete. 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84e06c8640 1 Processor -- start 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84e06c8640 1 -- start start 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84e06c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84e06c8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84d810bd60 con 0x7f84d8108390 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84de464640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84de464640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d819b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52578/0 (socket says 172.21.15.1:52578) 2024-09-19T08:54:29.618 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84de464640 1 -- 172.21.15.1:0/519476092 learned_addr learned my addr 172.21.15.1:0/519476092 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84de464640 1 -- 172.21.15.1:0/519476092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d819bdf0 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84de464640 1 --2- 172.21.15.1:0/519476092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d819b8b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f84d4031000 tx=0x7f84d4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.029+0000 7f84cf7fe640 1 -- 172.21.15.1:0/519476092 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4042070 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.030+0000 7f84cf7fe640 1 -- 172.21.15.1:0/519476092 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f84d40325f0 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.030+0000 7f84cf7fe640 1 -- 172.21.15.1:0/519476092 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4037040 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.030+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d819c080 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.030+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d819ed70 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.030+0000 7f84cf7fe640 1 -- 172.21.15.1:0/519476092 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f84d4045070 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.030+0000 7f84cf7fe640 1 -- 172.21.15.1:0/519476092 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f84d4047ca0 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.031+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d81087f0 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.033+0000 7f84cf7fe640 1 -- 172.21.15.1:0/519476092 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f84d404c030 con 0x7f84d8108390 2024-09-19T08:54:29.619 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.092+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f84d819efb0 con 0x7f84d8108390 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.094+0000 7f84cf7fe640 1 -- 172.21.15.1:0/519476092 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f84d4047440 con 0x7f84d8108390 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.095+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 msgr2=0x7f84d819b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.095+0000 7f84e06c8640 1 --2- 172.21.15.1:0/519476092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d819b8b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f84d4031000 tx=0x7f84d4032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.095+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 shutdown_connections 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.095+0000 7f84e06c8640 1 --2- 172.21.15.1:0/519476092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d8108390 0x7f84d819b8b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.095+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 >> 172.21.15.1:0/519476092 conn(0x7f84d8101f50 msgr2=0x7f84d8102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.095+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 shutdown_connections 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:29.095+0000 7f84e06c8640 1 -- 172.21.15.1:0/519476092 wait complete. 2024-09-19T08:54:29.620 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T08:54:29.642 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:54:29.642 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mgr... 2024-09-19T08:54:29.642 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T08:54:29.643 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T08:54:29.887 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:54:29.887 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T08:54:30.040 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968.target.wants/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@.service. 2024-09-19T08:54:30.371 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:30 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/519476092' entity='client.admin' 2024-09-19T08:54:30.589 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:54:30.589 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T08:54:30.597 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:54:30.597 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T08:54:30.597 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T08:54:30.597 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:54:30.608 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:54:30.609 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T08:54:30.617 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:54:30.617 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T08:54:30.617 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T08:54:30.618 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T08:54:30.618 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr to start... 2024-09-19T08:54:30.618 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr... 2024-09-19T08:54:30.740 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:30 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:30.693+0000 7f2c23cd4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:54:31.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:30 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:30.853+0000 7f2c23cd4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:54:31.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:30 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:30.923+0000 7f2c23cd4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:54:31.297 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:31 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2395976195' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:31.298 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:31 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:31.082+0000 7f2c23cd4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:54:31.298 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:31 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:31.233+0000 7f2c23cd4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:54:31.720 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:31 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:31.567+0000 7f2c23cd4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:54:31.720 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:31 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:31.632+0000 7f2c23cd4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:54:31.724 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:54:31.725 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:54:31.726 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:54:31.734 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:54:31.734 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:54:31.734 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:54:31.734 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:54:31.734 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:54:23:245014+0000", 2024-09-19T08:54:31.735 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:31.736 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:54:23.245690+0000", 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.047+0000 7f4fb9132640 1 Processor -- start 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.047+0000 7f4fb9132640 1 -- start start 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.047+0000 7f4fb9132640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb410a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.047+0000 7f4fb9132640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb4063490 con 0x7f4fb41083b0 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.048+0000 7f4fb2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb410a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.048+0000 7f4fb2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb410a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52612/0 (socket says 172.21.15.1:52612) 2024-09-19T08:54:31.737 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.048+0000 7f4fb2d9d640 1 -- 172.21.15.1:0/147195535 learned_addr learned my addr 172.21.15.1:0/147195535 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.048+0000 7f4fb2d9d640 1 -- 172.21.15.1:0/147195535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb410ace0 con 0x7f4fb41083b0 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.049+0000 7f4fb2d9d640 1 --2- 172.21.15.1:0/147195535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb410a7a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009820 tx=0x7f4fa402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d2735e21e0d551 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.049+0000 7f4fb259c640 1 -- 172.21.15.1:0/147195535 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa4037070 con 0x7f4fb41083b0 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.049+0000 7f4fb259c640 1 -- 172.21.15.1:0/147195535 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4fa4032920 con 0x7f4fb41083b0 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.049+0000 7f4fb259c640 1 -- 172.21.15.1:0/147195535 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa4030950 con 0x7f4fb41083b0 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.049+0000 7f4fb9132640 1 -- 172.21.15.1:0/147195535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 msgr2=0x7f4fb410a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.049+0000 7f4fb9132640 1 --2- 172.21.15.1:0/147195535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb410a7a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009820 tx=0x7f4fa402a270 comp rx=0 tx=0).stop 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.050+0000 7f4fb9132640 1 -- 172.21.15.1:0/147195535 shutdown_connections 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.050+0000 7f4fb9132640 1 --2- 172.21.15.1:0/147195535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb410a7a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.050+0000 7f4fb9132640 1 -- 172.21.15.1:0/147195535 >> 172.21.15.1:0/147195535 conn(0x7f4fb4101f50 msgr2=0x7f4fb4104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.050+0000 7f4fb9132640 1 -- 172.21.15.1:0/147195535 shutdown_connections 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.050+0000 7f4fb9132640 1 -- 172.21.15.1:0/147195535 wait complete. 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb9132640 1 Processor -- start 2024-09-19T08:54:31.738 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb9132640 1 -- start start 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb9132640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb4107c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb9132640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb410bd20 con 0x7f4fb41083b0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb4107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb4107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52628/0 (socket says 172.21.15.1:52628) 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb2d9d640 1 -- 172.21.15.1:0/2395976195 learned_addr learned my addr 172.21.15.1:0/2395976195 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb2d9d640 1 -- 172.21.15.1:0/2395976195 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb4108170 con 0x7f4fb41083b0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.051+0000 7f4fb2d9d640 1 --2- 172.21.15.1:0/2395976195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb4107c30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4031000 tx=0x7f4fa4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.052+0000 7f4fb0d99640 1 -- 172.21.15.1:0/2395976195 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa4042070 con 0x7f4fb41083b0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.052+0000 7f4fb0d99640 1 -- 172.21.15.1:0/2395976195 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4fa40325f0 con 0x7f4fb41083b0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.052+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb4106360 con 0x7f4fb41083b0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.052+0000 7f4fb0d99640 1 -- 172.21.15.1:0/2395976195 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa4037040 con 0x7f4fb41083b0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.052+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb41068a0 con 0x7f4fb41083b0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.052+0000 7f4fb0d99640 1 -- 172.21.15.1:0/2395976195 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4fa4045070 con 0x7f4fb41083b0 2024-09-19T08:54:31.739 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.052+0000 7f4fb0d99640 1 -- 172.21.15.1:0/2395976195 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4fa4047cc0 con 0x7f4fb41083b0 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.053+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb4108810 con 0x7f4fb41083b0 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.055+0000 7f4fb0d99640 1 -- 172.21.15.1:0/2395976195 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4fa404c030 con 0x7f4fb41083b0 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.118+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4fb4106fd0 con 0x7f4fb41083b0 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.118+0000 7f4fb0d99640 1 -- 172.21.15.1:0/2395976195 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4fa4047440 con 0x7f4fb41083b0 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.120+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 msgr2=0x7f4fb4107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.120+0000 7f4fb9132640 1 --2- 172.21.15.1:0/2395976195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb4107c30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4031000 tx=0x7f4fa4032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.120+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 shutdown_connections 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.120+0000 7f4fb9132640 1 --2- 172.21.15.1:0/2395976195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fb41083b0 0x7f4fb4107c30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.120+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 >> 172.21.15.1:0/2395976195 conn(0x7f4fb4101f50 msgr2=0x7f4fb4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.120+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 shutdown_connections 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:31.120+0000 7f4fb9132640 1 -- 172.21.15.1:0/2395976195 wait complete. 2024-09-19T08:54:31.740 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (1/15)... 2024-09-19T08:54:32.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:31 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:31.827+0000 7f2c23cd4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:54:33.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:32 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:32.756+0000 7f2c23cd4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:54:33.048 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:32 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:32.826+0000 7f2c23cd4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:54:33.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:33 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:33.586+0000 7f2c23cd4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:54:33.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:33 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:33.707+0000 7f2c23cd4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:54:34.131 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:33 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:33.860+0000 7f2c23cd4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:54:34.132 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:33 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:33.926+0000 7f2c23cd4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:54:34.132 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.086+0000 7f2c23cd4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:54:34.403 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/37859417' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:34.404 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.161+0000 7f2c23cd4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:54:34.404 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.230+0000 7f2c23cd4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:54:34.404 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.404+0000 7f2c23cd4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:54:34.696 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.477+0000 7f2c23cd4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:54:34.697 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.547+0000 7f2c23cd4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:54:34.697 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.634+0000 7f2c23cd4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:54:34.697 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.696+0000 7f2c23cd4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:54:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:34.825 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:54:34.825 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:54:34.832 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:54:34.832 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:54:34.832 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:54:34.832 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:54:34.833 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:54:23:245014+0000", 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:54:34.834 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:54:23.245690+0000", 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.143+0000 7f6bb7fe3640 1 Processor -- start 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.143+0000 7f6bb7fe3640 1 -- start start 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.144+0000 7f6bb7fe3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb010a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.144+0000 7f6bb7fe3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0063490 con 0x7f6bb01083b0 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.144+0000 7f6bb5d7f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb010a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.835 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.144+0000 7f6bb5d7f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb010a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53698/0 (socket says 172.21.15.1:53698) 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.144+0000 7f6bb5d7f640 1 -- 172.21.15.1:0/2854229645 learned_addr learned my addr 172.21.15.1:0/2854229645 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.144+0000 7f6bb5d7f640 1 -- 172.21.15.1:0/2854229645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb010ace0 con 0x7f6bb01083b0 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.145+0000 7f6bb5d7f640 1 --2- 172.21.15.1:0/2854229645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb010a7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009820 tx=0x7f6ba402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531c82fa9d4567c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.145+0000 7f6bb4d7d640 1 -- 172.21.15.1:0/2854229645 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba4037070 con 0x7f6bb01083b0 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.145+0000 7f6bb4d7d640 1 -- 172.21.15.1:0/2854229645 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6ba4032920 con 0x7f6bb01083b0 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.145+0000 7f6bb4d7d640 1 -- 172.21.15.1:0/2854229645 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba4030950 con 0x7f6bb01083b0 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.146+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/2854229645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 msgr2=0x7f6bb010a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.146+0000 7f6bb7fe3640 1 --2- 172.21.15.1:0/2854229645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb010a7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009820 tx=0x7f6ba402a270 comp rx=0 tx=0).stop 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.146+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/2854229645 shutdown_connections 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.146+0000 7f6bb7fe3640 1 --2- 172.21.15.1:0/2854229645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb010a7a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.146+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/2854229645 >> 172.21.15.1:0/2854229645 conn(0x7f6bb0101f50 msgr2=0x7f6bb0104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.146+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/2854229645 shutdown_connections 2024-09-19T08:54:34.836 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.146+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/2854229645 wait complete. 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb7fe3640 1 Processor -- start 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb7fe3640 1 -- start start 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb7fe3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb7fe3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb010bd20 con 0x7f6bb01083b0 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb5d7f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb5d7f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb019b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53710/0 (socket says 172.21.15.1:53710) 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb5d7f640 1 -- 172.21.15.1:0/37859417 learned_addr learned my addr 172.21.15.1:0/37859417 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb5d7f640 1 -- 172.21.15.1:0/37859417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb019be00 con 0x7f6bb01083b0 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.147+0000 7f6bb5d7f640 1 --2- 172.21.15.1:0/37859417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb019b8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4031000 tx=0x7f6ba4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.148+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/37859417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba4042070 con 0x7f6bb01083b0 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.148+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb019c090 con 0x7f6bb01083b0 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.148+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/37859417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6ba40325f0 con 0x7f6bb01083b0 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.148+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/37859417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba4037040 con 0x7f6bb01083b0 2024-09-19T08:54:34.837 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.148+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb019ed80 con 0x7f6bb01083b0 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.148+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/37859417 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ba4045070 con 0x7f6bb01083b0 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.148+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/37859417 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6ba4047c70 con 0x7f6bb01083b0 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.149+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb0108810 con 0x7f6bb01083b0 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.151+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/37859417 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6ba404c030 con 0x7f6bb01083b0 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.214+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6bb019ef50 con 0x7f6bb01083b0 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.214+0000 7f6ba2ffd640 1 -- 172.21.15.1:0/37859417 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f6ba4047440 con 0x7f6bb01083b0 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.216+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 msgr2=0x7f6bb019b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.216+0000 7f6bb7fe3640 1 --2- 172.21.15.1:0/37859417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb019b8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4031000 tx=0x7f6ba4032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.216+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 shutdown_connections 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.216+0000 7f6bb7fe3640 1 --2- 172.21.15.1:0/37859417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb01083b0 0x7f6bb019b8c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.216+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 >> 172.21.15.1:0/37859417 conn(0x7f6bb0101f50 msgr2=0x7f6bb0102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.216+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 shutdown_connections 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:34.216+0000 7f6bb7fe3640 1 -- 172.21.15.1:0/37859417 wait complete. 2024-09-19T08:54:34.838 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (2/15)... 2024-09-19T08:54:35.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:34.760+0000 7f2c23cd4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:54:36.048 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:35.599+0000 7f2c23cd4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:54:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: Activating manager daemon x 2024-09-19T08:54:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: mgrmap e2: x(active, starting, since 0.00337194s) 2024-09-19T08:54:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:54:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:54:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:54:36.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:54:36.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:54:36.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: Manager daemon x is now available 2024-09-19T08:54:36.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:54:36.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:54:36.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' 2024-09-19T08:54:36.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' 2024-09-19T08:54:36.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:35 smithi001 ceph-mon[30939]: from='mgr.14100 172.21.15.1:0/3587042726' entity='mgr.x' 2024-09-19T08:54:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:37 smithi001 ceph-mon[30939]: mgrmap e3: x(active, since 1.00765s) 2024-09-19T08:54:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:37 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3542087060' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:54:38.104 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:54:38.105 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:54:38.106 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:54:38.115 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:54:23:245014+0000", 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:38.116 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:54:23.245690+0000", 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:54:38.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.268+0000 7f0f15619640 1 Processor -- start 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.268+0000 7f0f15619640 1 -- start start 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.268+0000 7f0f15619640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1010a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.269+0000 7f0f15619640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10063510 con 0x7f0f10108330 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.269+0000 7f0f0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1010a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.269+0000 7f0f0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1010a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53770/0 (socket says 172.21.15.1:53770) 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.269+0000 7f0f0effd640 1 -- 172.21.15.1:0/593603020 learned_addr learned my addr 172.21.15.1:0/593603020 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.269+0000 7f0f0effd640 1 -- 172.21.15.1:0/593603020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1010ac60 con 0x7f0f10108330 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.270+0000 7f0f0effd640 1 --2- 172.21.15.1:0/593603020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1010a720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009820 tx=0x7f0f0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38415669b21e863 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.270+0000 7f0f0e7fc640 1 -- 172.21.15.1:0/593603020 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f00037070 con 0x7f0f10108330 2024-09-19T08:54:38.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.270+0000 7f0f0e7fc640 1 -- 172.21.15.1:0/593603020 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0f00032920 con 0x7f0f10108330 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.270+0000 7f0f0e7fc640 1 -- 172.21.15.1:0/593603020 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f00030950 con 0x7f0f10108330 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.271+0000 7f0f15619640 1 -- 172.21.15.1:0/593603020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 msgr2=0x7f0f1010a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.271+0000 7f0f15619640 1 --2- 172.21.15.1:0/593603020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1010a720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009820 tx=0x7f0f0002a270 comp rx=0 tx=0).stop 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.271+0000 7f0f15619640 1 -- 172.21.15.1:0/593603020 shutdown_connections 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.271+0000 7f0f15619640 1 --2- 172.21.15.1:0/593603020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1010a720 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.271+0000 7f0f15619640 1 -- 172.21.15.1:0/593603020 >> 172.21.15.1:0/593603020 conn(0x7f0f10101f50 msgr2=0x7f0f10104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.271+0000 7f0f15619640 1 -- 172.21.15.1:0/593603020 shutdown_connections 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.271+0000 7f0f15619640 1 -- 172.21.15.1:0/593603020 wait complete. 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.272+0000 7f0f15619640 1 Processor -- start 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.272+0000 7f0f15619640 1 -- start start 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.272+0000 7f0f15619640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.272+0000 7f0f15619640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1010bd60 con 0x7f0f10108330 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.272+0000 7f0f0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.272+0000 7f0f0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1019b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53784/0 (socket says 172.21.15.1:53784) 2024-09-19T08:54:38.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.272+0000 7f0f0effd640 1 -- 172.21.15.1:0/3542087060 learned_addr learned my addr 172.21.15.1:0/3542087060 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.273+0000 7f0f0effd640 1 -- 172.21.15.1:0/3542087060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1019be00 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.273+0000 7f0f0effd640 1 --2- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1019b8c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0f00031000 tx=0x7f0f00032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.273+0000 7f0f0cff9640 1 -- 172.21.15.1:0/3542087060 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f00042070 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.273+0000 7f0f0cff9640 1 -- 172.21.15.1:0/3542087060 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0f000325f0 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.273+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1019c090 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.273+0000 7f0f0cff9640 1 -- 172.21.15.1:0/3542087060 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f00037040 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.273+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1019ed80 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.274+0000 7f0f0cff9640 1 -- 172.21.15.1:0/3542087060 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f0f00045070 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.274+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f10108790 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.274+0000 7f0f0cff9640 1 --2- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f0efc039110 0x7f0efc03b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.274+0000 7f0f0cff9640 1 -- 172.21.15.1:0/3542087060 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0f0006c0d0 con 0x7f0f10108330 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.275+0000 7f0f067fc640 1 --2- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f0efc039110 0x7f0efc03b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.275+0000 7f0f067fc640 1 --2- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f0efc039110 0x7f0efc03b5d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80098c0 tx=0x7f0ef8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.280+0000 7f0f0cff9640 1 -- 172.21.15.1:0/3542087060 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f00042210 con 0x7f0f10108330 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.526+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0f1019f400 con 0x7f0f10108330 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.527+0000 7f0f0cff9640 1 -- 172.21.15.1:0/3542087060 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f0f0003a540 con 0x7f0f10108330 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f0efc039110 msgr2=0x7f0efc03b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 --2- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f0efc039110 0x7f0efc03b5d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80098c0 tx=0x7f0ef8006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 msgr2=0x7f0f1019b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 --2- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1019b8c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0f00031000 tx=0x7f0f00032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 shutdown_connections 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 --2- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f0efc039110 0x7f0efc03b5d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 --2- 172.21.15.1:0/3542087060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f10108330 0x7f0f1019b8c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 >> 172.21.15.1:0/3542087060 conn(0x7f0f10101f50 msgr2=0x7f0f10102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 shutdown_connections 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:37.530+0000 7f0f15619640 1 -- 172.21.15.1:0/3542087060 wait complete. 2024-09-19T08:54:38.121 INFO:teuthology.orchestra.run.smithi001.stdout:mgr is available 2024-09-19T08:54:38.695 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:38 smithi001 ceph-mon[30939]: mgrmap e4: x(active, since 2s) 2024-09-19T08:54:39.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:54:39.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.504+0000 7f00d5153640 1 Processor -- start 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.504+0000 7f00d5153640 1 -- start start 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.504+0000 7f00d5153640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d010a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.504+0000 7f00d5153640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f00d00634d0 con 0x7f00d01083c0 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.504+0000 7f00ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d010a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.504+0000 7f00ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d010a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53792/0 (socket says 172.21.15.1:53792) 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.504+0000 7f00ced9d640 1 -- 172.21.15.1:0/1693165433 learned_addr learned my addr 172.21.15.1:0/1693165433 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:39.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.505+0000 7f00ced9d640 1 -- 172.21.15.1:0/1693165433 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d010acf0 con 0x7f00d01083c0 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.505+0000 7f00ced9d640 1 --2- 172.21.15.1:0/1693165433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d010a7b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009820 tx=0x7f00c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b4287cacccc6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.505+0000 7f00ce59c640 1 -- 172.21.15.1:0/1693165433 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00c0037070 con 0x7f00d01083c0 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.505+0000 7f00ce59c640 1 -- 172.21.15.1:0/1693165433 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f00c0032920 con 0x7f00d01083c0 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.505+0000 7f00ce59c640 1 -- 172.21.15.1:0/1693165433 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00c0030950 con 0x7f00d01083c0 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.506+0000 7f00d5153640 1 -- 172.21.15.1:0/1693165433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 msgr2=0x7f00d010a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.506+0000 7f00d5153640 1 --2- 172.21.15.1:0/1693165433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d010a7b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009820 tx=0x7f00c002a270 comp rx=0 tx=0).stop 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.506+0000 7f00d5153640 1 -- 172.21.15.1:0/1693165433 shutdown_connections 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.506+0000 7f00d5153640 1 --2- 172.21.15.1:0/1693165433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d010a7b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.506+0000 7f00d5153640 1 -- 172.21.15.1:0/1693165433 >> 172.21.15.1:0/1693165433 conn(0x7f00d0102060 msgr2=0x7f00d0104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.506+0000 7f00d5153640 1 -- 172.21.15.1:0/1693165433 shutdown_connections 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.506+0000 7f00d5153640 1 -- 172.21.15.1:0/1693165433 wait complete. 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.507+0000 7f00d5153640 1 Processor -- start 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.507+0000 7f00d5153640 1 -- start start 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.507+0000 7f00d5153640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d0107c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.507+0000 7f00d5153640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f00d010bd90 con 0x7f00d01083c0 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.507+0000 7f00ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d0107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.507+0000 7f00ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d0107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53794/0 (socket says 172.21.15.1:53794) 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.507+0000 7f00ced9d640 1 -- 172.21.15.1:0/472015620 learned_addr learned my addr 172.21.15.1:0/472015620 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.508+0000 7f00ced9d640 1 -- 172.21.15.1:0/472015620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d0108180 con 0x7f00d01083c0 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.508+0000 7f00ced9d640 1 --2- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d0107c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f00c00097f0 tx=0x7f00c0032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.508+0000 7f00ccd99640 1 -- 172.21.15.1:0/472015620 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00c0037040 con 0x7f00d01083c0 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.508+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d0106370 con 0x7f00d01083c0 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.508+0000 7f00ccd99640 1 -- 172.21.15.1:0/472015620 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f00c0040070 con 0x7f00d01083c0 2024-09-19T08:54:39.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.508+0000 7f00ccd99640 1 -- 172.21.15.1:0/472015620 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00c003a6d0 con 0x7f00d01083c0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.508+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d01068b0 con 0x7f00d01083c0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.509+0000 7f00ccd99640 1 -- 172.21.15.1:0/472015620 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f00c003b420 con 0x7f00d01083c0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.509+0000 7f00ccd99640 1 --2- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f00bc039220 0x7f00bc03b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.509+0000 7f00ccd99640 1 -- 172.21.15.1:0/472015620 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f00c006c390 con 0x7f00d01083c0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.509+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d0108820 con 0x7f00d01083c0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.509+0000 7f00c7fff640 1 --2- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f00bc039220 0x7f00bc03b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.510+0000 7f00c7fff640 1 --2- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f00bc039220 0x7f00bc03b6e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f00b80098c0 tx=0x7f00b8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.514+0000 7f00ccd99640 1 -- 172.21.15.1:0/472015620 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00c004a200 con 0x7f00d01083c0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.696+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f00d0106b30 con 0x7f00d01083c0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.697+0000 7f00ccd99640 1 -- 172.21.15.1:0/472015620 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7f00c0031e80 con 0x7f00d01083c0 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f00bc039220 msgr2=0x7f00bc03b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 --2- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f00bc039220 0x7f00bc03b6e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f00b80098c0 tx=0x7f00b8006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 msgr2=0x7f00d0107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 --2- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d0107c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f00c00097f0 tx=0x7f00c0032d00 comp rx=0 tx=0).stop 2024-09-19T08:54:39.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 shutdown_connections 2024-09-19T08:54:39.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 --2- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f00bc039220 0x7f00bc03b6e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 --2- 172.21.15.1:0/472015620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00d01083c0 0x7f00d0107c40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 >> 172.21.15.1:0/472015620 conn(0x7f00d0102060 msgr2=0x7f00d0102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 shutdown_connections 2024-09-19T08:54:39.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:38.699+0000 7f00d5153640 1 -- 172.21.15.1:0/472015620 wait complete. 2024-09-19T08:54:39.265 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling cephadm module... 2024-09-19T08:54:39.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:39 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/472015620' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:54:40.920 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:40 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2201426898' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T08:54:40.920 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: ignoring --setuser ceph since I am not root 2024-09-19T08:54:40.920 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: ignoring --setgroup ceph since I am not root 2024-09-19T08:54:40.920 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:40.762+0000 7fd238315040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:54:40.920 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:40.821+0000 7fd238315040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:54:41.170 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.682+0000 7ff1c6806640 1 Processor -- start 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.682+0000 7ff1c6806640 1 -- start start 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.682+0000 7ff1c6806640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c010a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.682+0000 7ff1c6806640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c00634b0 con 0x7ff1c01083c0 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.682+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c010a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.682+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c010a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53806/0 (socket says 172.21.15.1:53806) 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.682+0000 7ff1bffff640 1 -- 172.21.15.1:0/3848550947 learned_addr learned my addr 172.21.15.1:0/3848550947 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.683+0000 7ff1bffff640 1 -- 172.21.15.1:0/3848550947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c010acf0 con 0x7ff1c01083c0 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.683+0000 7ff1bffff640 1 --2- 172.21.15.1:0/3848550947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c010a7b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009820 tx=0x7ff1b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b40a0c992f64669 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.683+0000 7ff1bf7fe640 1 -- 172.21.15.1:0/3848550947 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b0037070 con 0x7ff1c01083c0 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.683+0000 7ff1bf7fe640 1 -- 172.21.15.1:0/3848550947 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff1b0032920 con 0x7ff1c01083c0 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.683+0000 7ff1bf7fe640 1 -- 172.21.15.1:0/3848550947 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b0030950 con 0x7ff1c01083c0 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.684+0000 7ff1c6806640 1 -- 172.21.15.1:0/3848550947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 msgr2=0x7ff1c010a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.171 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.684+0000 7ff1c6806640 1 --2- 172.21.15.1:0/3848550947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c010a7b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009820 tx=0x7ff1b002a270 comp rx=0 tx=0).stop 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.684+0000 7ff1c6806640 1 -- 172.21.15.1:0/3848550947 shutdown_connections 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.684+0000 7ff1c6806640 1 --2- 172.21.15.1:0/3848550947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c010a7b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.684+0000 7ff1c6806640 1 -- 172.21.15.1:0/3848550947 >> 172.21.15.1:0/3848550947 conn(0x7ff1c0102060 msgr2=0x7ff1c0104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.684+0000 7ff1c6806640 1 -- 172.21.15.1:0/3848550947 shutdown_connections 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.684+0000 7ff1c6806640 1 -- 172.21.15.1:0/3848550947 wait complete. 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.685+0000 7ff1c6806640 1 Processor -- start 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.685+0000 7ff1c6806640 1 -- start start 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.685+0000 7ff1c6806640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.685+0000 7ff1c6806640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c010bd90 con 0x7ff1c01083c0 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.685+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.685+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c019b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53816/0 (socket says 172.21.15.1:53816) 2024-09-19T08:54:41.172 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.685+0000 7ff1bffff640 1 -- 172.21.15.1:0/2201426898 learned_addr learned my addr 172.21.15.1:0/2201426898 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.685+0000 7ff1bffff640 1 -- 172.21.15.1:0/2201426898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c019bdd0 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.686+0000 7ff1bffff640 1 --2- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c019b890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00097f0 tx=0x7ff1b0032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.686+0000 7ff1bdffb640 1 -- 172.21.15.1:0/2201426898 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b0037040 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.686+0000 7ff1bdffb640 1 -- 172.21.15.1:0/2201426898 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff1b0040070 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.686+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c019c060 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.686+0000 7ff1bdffb640 1 -- 172.21.15.1:0/2201426898 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1b003a6d0 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.686+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c019ed50 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.687+0000 7ff1bdffb640 1 -- 172.21.15.1:0/2201426898 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7ff1b003a8c0 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.687+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c0108820 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.687+0000 7ff1bdffb640 1 --2- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7ff1ac039220 0x7ff1ac03b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.687+0000 7ff1bdffb640 1 -- 172.21.15.1:0/2201426898 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff1b006c510 con 0x7ff1c01083c0 2024-09-19T08:54:41.173 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.687+0000 7ff1b7fff640 1 --2- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7ff1ac039220 0x7ff1ac03b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.687+0000 7ff1b7fff640 1 --2- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7ff1ac039220 0x7ff1ac03b6e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80098c0 tx=0x7ff1a8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.692+0000 7ff1bdffb640 1 -- 172.21.15.1:0/2201426898 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1b006c270 con 0x7ff1c01083c0 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:39.916+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff1c019f3d0 con 0x7ff1c01083c0 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.611+0000 7ff1bdffb640 1 -- 172.21.15.1:0/2201426898 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff1b003abb0 con 0x7ff1c01083c0 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.613+0000 7ff1bdffb640 1 -- 172.21.15.1:0/2201426898 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7ff1b0044ce0 con 0x7ff1c01083c0 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7ff1ac039220 msgr2=0x7ff1ac03b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 --2- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7ff1ac039220 0x7ff1ac03b6e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80098c0 tx=0x7ff1a8006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 msgr2=0x7ff1c019b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 --2- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c019b890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00097f0 tx=0x7ff1b0032d00 comp rx=0 tx=0).stop 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 shutdown_connections 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 --2- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7ff1ac039220 0x7ff1ac03b6e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 --2- 172.21.15.1:0/2201426898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1c01083c0 0x7ff1c019b890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.174 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 >> 172.21.15.1:0/2201426898 conn(0x7ff1c0102060 msgr2=0x7ff1c0102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:41.175 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 shutdown_connections 2024-09-19T08:54:41.175 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:40.615+0000 7ff1c6806640 1 -- 172.21.15.1:0/2201426898 wait complete. 2024-09-19T08:54:41.202 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:40.976+0000 7fd238315040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:54:41.202 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:41.045+0000 7fd238315040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:54:41.202 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:41.202+0000 7fd238315040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:54:41.498 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:41.350+0000 7fd238315040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:54:41.785 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:41 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2201426898' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T08:54:41.786 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:41 smithi001 ceph-mon[30939]: mgrmap e5: x(active, since 5s) 2024-09-19T08:54:41.786 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:41.685+0000 7fd238315040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:54:41.786 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:41.748+0000 7fd238315040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:54:42.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:41.945+0000 7fd238315040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:54:42.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:54:42.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T08:54:42.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:54:42.430 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.578+0000 7f1a15936640 1 Processor -- start 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.579+0000 7f1a15936640 1 -- start start 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.579+0000 7f1a15936640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1010a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.579+0000 7f1a15936640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a10063490 con 0x7f1a101083b0 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.579+0000 7f1a0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1010a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.579+0000 7f1a0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1010a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53850/0 (socket says 172.21.15.1:53850) 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.579+0000 7f1a0effd640 1 -- 172.21.15.1:0/2684398643 learned_addr learned my addr 172.21.15.1:0/2684398643 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.579+0000 7f1a0effd640 1 -- 172.21.15.1:0/2684398643 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1010ace0 con 0x7f1a101083b0 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.580+0000 7f1a0effd640 1 --2- 172.21.15.1:0/2684398643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1010a7a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009820 tx=0x7f1a0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c313e0158f70f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.580+0000 7f1a0e7fc640 1 -- 172.21.15.1:0/2684398643 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a00037070 con 0x7f1a101083b0 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.580+0000 7f1a0e7fc640 1 -- 172.21.15.1:0/2684398643 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1a00032920 con 0x7f1a101083b0 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.580+0000 7f1a0e7fc640 1 -- 172.21.15.1:0/2684398643 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a00030950 con 0x7f1a101083b0 2024-09-19T08:54:42.431 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.581+0000 7f1a15936640 1 -- 172.21.15.1:0/2684398643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 msgr2=0x7f1a1010a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.581+0000 7f1a15936640 1 --2- 172.21.15.1:0/2684398643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1010a7a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009820 tx=0x7f1a0002a270 comp rx=0 tx=0).stop 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.581+0000 7f1a15936640 1 -- 172.21.15.1:0/2684398643 shutdown_connections 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.581+0000 7f1a15936640 1 --2- 172.21.15.1:0/2684398643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1010a7a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.581+0000 7f1a15936640 1 -- 172.21.15.1:0/2684398643 >> 172.21.15.1:0/2684398643 conn(0x7f1a10101f50 msgr2=0x7f1a10104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.581+0000 7f1a15936640 1 -- 172.21.15.1:0/2684398643 shutdown_connections 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.581+0000 7f1a15936640 1 -- 172.21.15.1:0/2684398643 wait complete. 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.582+0000 7f1a15936640 1 Processor -- start 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.582+0000 7f1a15936640 1 -- start start 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.582+0000 7f1a15936640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.582+0000 7f1a15936640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1010bd20 con 0x7f1a101083b0 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.582+0000 7f1a0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.582+0000 7f1a0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1019b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53862/0 (socket says 172.21.15.1:53862) 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.582+0000 7f1a0effd640 1 -- 172.21.15.1:0/1119920646 learned_addr learned my addr 172.21.15.1:0/1119920646 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:42.432 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.582+0000 7f1a0effd640 1 -- 172.21.15.1:0/1119920646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1019be00 con 0x7f1a101083b0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.583+0000 7f1a0effd640 1 --2- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1019b8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1a00031000 tx=0x7f1a00032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.583+0000 7f1a14934640 1 -- 172.21.15.1:0/1119920646 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a00042070 con 0x7f1a101083b0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.583+0000 7f1a14934640 1 -- 172.21.15.1:0/1119920646 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1a000325f0 con 0x7f1a101083b0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.583+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1019c090 con 0x7f1a101083b0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.583+0000 7f1a14934640 1 -- 172.21.15.1:0/1119920646 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a00037040 con 0x7f1a101083b0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.583+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a101061a0 con 0x7f1a101083b0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.584+0000 7f1a14934640 1 -- 172.21.15.1:0/1119920646 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f1a00045070 con 0x7f1a101083b0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.585+0000 7f1a14934640 1 --2- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f19fc0392c0 0x7f19fc03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.585+0000 7f1a14934640 1 -- 172.21.15.1:0/1119920646 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1a0006c240 con 0x7f1a101083b0 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.585+0000 7f1a07fff640 1 -- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f19fc0392c0 msgr2=0x7f19fc03b780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3303995107 2024-09-19T08:54:42.433 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.585+0000 7f1a07fff640 1 --2- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f19fc0392c0 0x7f19fc03b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.585+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a10108810 con 0x7f1a101083b0 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.590+0000 7f1a14934640 1 -- 172.21.15.1:0/1119920646 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a00042210 con 0x7f1a101083b0 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.786+0000 7f1a07fff640 1 -- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f19fc0392c0 msgr2=0x7f19fc03b780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3303995107 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.786+0000 7f1a07fff640 1 --2- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f19fc0392c0 0x7f19fc03b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.816+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1a10106630 con 0x7f1a101083b0 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.816+0000 7f1a14934640 1 -- 172.21.15.1:0/1119920646 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f1a0003a780 con 0x7f1a101083b0 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f19fc0392c0 msgr2=0x7f19fc03b780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 --2- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f19fc0392c0 0x7f19fc03b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 msgr2=0x7f1a1019b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 --2- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1019b8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1a00031000 tx=0x7f1a00032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 shutdown_connections 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 --2- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7f19fc0392c0 0x7f19fc03b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 --2- 172.21.15.1:0/1119920646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a101083b0 0x7f1a1019b8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:42.435 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 >> 172.21.15.1:0/1119920646 conn(0x7f1a10101f50 msgr2=0x7f1a10102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:42.435 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 shutdown_connections 2024-09-19T08:54:42.435 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:41.819+0000 7f1a15936640 1 -- 172.21.15.1:0/1119920646 wait complete. 2024-09-19T08:54:42.435 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-19T08:54:42.435 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 5... 2024-09-19T08:54:42.722 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:42 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1119920646' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:54:43.008 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:42 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:42.877+0000 7fd238315040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:54:43.008 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:42 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:42.947+0000 7fd238315040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:54:43.959 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:43 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:43.690+0000 7fd238315040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:54:43.959 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:43 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:43.810+0000 7fd238315040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:54:44.210 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:43 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:43.959+0000 7fd238315040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.022+0000 7fd238315040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:54:44.211 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.177+0000 7fd238315040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:54:44.475 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.248+0000 7fd238315040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:54:44.475 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.310+0000 7fd238315040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:54:44.475 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.475+0000 7fd238315040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:54:44.760 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.543+0000 7fd238315040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:54:44.760 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.612+0000 7fd238315040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:54:44.760 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.698+0000 7fd238315040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:54:44.760 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.760+0000 7fd238315040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:54:45.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:44.821+0000 7fd238315040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:54:46.047 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:45.646+0000 7fd238315040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:54:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: Active manager daemon x restarted 2024-09-19T08:54:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: Activating manager daemon x 2024-09-19T08:54:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T08:54:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: mgrmap e6: x(active, starting, since 0.00331913s) 2024-09-19T08:54:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:54:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:54:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: Manager daemon x is now available 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:54:46.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:45 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:54:47.309 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:54:47.309 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T08:54:47.309 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:54:47.309 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:54:47.309 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.803+0000 7fa97e33b640 1 Processor -- start 2024-09-19T08:54:47.309 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.803+0000 7fa97e33b640 1 -- start start 2024-09-19T08:54:47.309 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.803+0000 7fa97e33b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa97810a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.803+0000 7fa97e33b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa9780634b0 con 0x7fa978108390 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.803+0000 7fa977fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa97810a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.803+0000 7fa977fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa97810a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51234/0 (socket says 172.21.15.1:51234) 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.803+0000 7fa977fff640 1 -- 172.21.15.1:0/1474744108 learned_addr learned my addr 172.21.15.1:0/1474744108 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.803+0000 7fa977fff640 1 -- 172.21.15.1:0/1474744108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97810acc0 con 0x7fa978108390 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.804+0000 7fa977fff640 1 --2- 172.21.15.1:0/1474744108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa97810a780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa968009820 tx=0x7fa96802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f040cccc9b8ba130 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.804+0000 7fa976ffd640 1 -- 172.21.15.1:0/1474744108 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa968037070 con 0x7fa978108390 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.804+0000 7fa976ffd640 1 -- 172.21.15.1:0/1474744108 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa968032920 con 0x7fa978108390 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.804+0000 7fa976ffd640 1 -- 172.21.15.1:0/1474744108 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa968030950 con 0x7fa978108390 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.805+0000 7fa97e33b640 1 -- 172.21.15.1:0/1474744108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 msgr2=0x7fa97810a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.805+0000 7fa97e33b640 1 --2- 172.21.15.1:0/1474744108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa97810a780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa968009820 tx=0x7fa96802a270 comp rx=0 tx=0).stop 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.805+0000 7fa97e33b640 1 -- 172.21.15.1:0/1474744108 shutdown_connections 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.805+0000 7fa97e33b640 1 --2- 172.21.15.1:0/1474744108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa97810a780 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.805+0000 7fa97e33b640 1 -- 172.21.15.1:0/1474744108 >> 172.21.15.1:0/1474744108 conn(0x7fa978101f50 msgr2=0x7fa978104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.805+0000 7fa97e33b640 1 -- 172.21.15.1:0/1474744108 shutdown_connections 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.805+0000 7fa97e33b640 1 -- 172.21.15.1:0/1474744108 wait complete. 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.806+0000 7fa97e33b640 1 Processor -- start 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.806+0000 7fa97e33b640 1 -- start start 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.806+0000 7fa97e33b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa978107c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.806+0000 7fa97e33b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa97810bd60 con 0x7fa978108390 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.806+0000 7fa977fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa978107c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.806+0000 7fa977fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa978107c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51248/0 (socket says 172.21.15.1:51248) 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.806+0000 7fa977fff640 1 -- 172.21.15.1:0/2796222069 learned_addr learned my addr 172.21.15.1:0/2796222069 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.806+0000 7fa977fff640 1 -- 172.21.15.1:0/2796222069 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa978108150 con 0x7fa978108390 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.807+0000 7fa977fff640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa978107c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa968031000 tx=0x7fa968032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.807+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa968042070 con 0x7fa978108390 2024-09-19T08:54:47.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.807+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa978106340 con 0x7fa978108390 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.807+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa9680325f0 con 0x7fa978108390 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.807+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa968037040 con 0x7fa978108390 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.807+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa978106880 con 0x7fa978108390 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.808+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa968045070 con 0x7fa978108390 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.808+0000 7fa9757fa640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 0x7fa96003b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.808+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 --> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa96003be40 con 0x7fa960039270 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.808+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa96806c3a0 con 0x7fa978108390 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.808+0000 7fa9777fe640 1 -- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 msgr2=0x7fa96003b730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3303995107 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:42.808+0000 7fa9777fe640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 0x7fa96003b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:43.009+0000 7fa9777fe640 1 -- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 msgr2=0x7fa96003b730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3303995107 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:43.009+0000 7fa9777fe640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 0x7fa96003b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:43.410+0000 7fa9777fe640 1 -- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 msgr2=0x7fa96003b730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3303995107 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:43.410+0000 7fa9777fe640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 0x7fa96003b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:54:47.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:44.211+0000 7fa9777fe640 1 -- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 msgr2=0x7fa96003b730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3303995107 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:44.211+0000 7fa9777fe640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 0x7fa96003b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:45.650+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fa96806ae60 con 0x7fa978108390 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:45.650+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 msgr2=0x7fa96003b730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:45.650+0000 7fa9757fa640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 0x7fa96003b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.651+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fa968047440 con 0x7fa978108390 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.651+0000 7fa9757fa640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa96003cba0 0x7fa96003ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.651+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa968008e50 con 0x7fa96003cba0 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.651+0000 7fa9777fe640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa96003cba0 0x7fa96003ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.652+0000 7fa9777fe640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa96003cba0 0x7fa96003ef90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa96c003980 tx=0x7fa96c006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.652+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mgr.14118 v2:172.21.15.1:6800/2001580204 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fa968008e50 con 0x7fa96003cba0 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.665+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa9781087f0 con 0x7fa96003cba0 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.665+0000 7fa9757fa640 1 -- 172.21.15.1:0/2796222069 <== mgr.14118 v2:172.21.15.1:6800/2001580204 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa9781087f0 con 0x7fa96003cba0 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.665+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa96003cba0 msgr2=0x7fa96003ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.665+0000 7fa97e33b640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa96003cba0 0x7fa96003ef90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa96c003980 tx=0x7fa96c006e10 comp rx=0 tx=0).stop 2024-09-19T08:54:47.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.665+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 msgr2=0x7fa978107c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.666+0000 7fa97e33b640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa978107c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa968031000 tx=0x7fa968032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.666+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 shutdown_connections 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.666+0000 7fa97e33b640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa96003cba0 0x7fa96003ef90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.666+0000 7fa97e33b640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:6800/3303995107,v1:172.21.15.1:6801/3303995107] conn(0x7fa960039270 0x7fa96003b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.666+0000 7fa97e33b640 1 --2- 172.21.15.1:0/2796222069 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa978108390 0x7fa978107c10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.666+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 >> 172.21.15.1:0/2796222069 conn(0x7fa978101f50 msgr2=0x7fa978102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.666+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 shutdown_connections 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:46.666+0000 7fa97e33b640 1 -- 172.21.15.1:0/2796222069 wait complete. 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 5 is available 2024-09-19T08:54:47.314 INFO:teuthology.orchestra.run.smithi001.stdout:Setting orchestrator backend to cephadm... 2024-09-19T08:54:47.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:47 smithi001 ceph-mon[30939]: Found migration_current of "None". Setting to last migration. 2024-09-19T08:54:47.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:47 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:54:47.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:47 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:54:47.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:47 smithi001 ceph-mon[30939]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:54:47.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:47 smithi001 ceph-mon[30939]: mgrmap e7: x(active, since 1.00524s) 2024-09-19T08:54:48.449 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:48.102+0000 7fd1a4e3a640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:54:48] ENGINE Error in HTTPServer.serve 2024-09-19T08:54:48.449 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: Traceback (most recent call last): 2024-09-19T08:54:48.449 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:54:48.449 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: self._connections.run(self.expiration_interval) 2024-09-19T08:54:48.449 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:54:48.449 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: self._run(expiration_interval) 2024-09-19T08:54:48.449 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:54:48.449 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: s = self.context.wrap_socket( 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: return self.sslsocket_class._create( 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: self.do_handshake() 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: self._sslobj.do_handshake() 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:54:48.450 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:54:48.456 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.717+0000 7f20a1d0d640 1 Processor -- start 2024-09-19T08:54:48.456 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.717+0000 7f20a1d0d640 1 -- start start 2024-09-19T08:54:48.456 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.717+0000 7f20a1d0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c10a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.456 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.717+0000 7f20a1d0d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f209c063490 con 0x7f209c1083b0 2024-09-19T08:54:48.456 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.717+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c10a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.456 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.717+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c10a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51334/0 (socket says 172.21.15.1:51334) 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.717+0000 7f209b7fe640 1 -- 172.21.15.1:0/454636288 learned_addr learned my addr 172.21.15.1:0/454636288 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.718+0000 7f209b7fe640 1 -- 172.21.15.1:0/454636288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c10ace0 con 0x7f209c1083b0 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.718+0000 7f209b7fe640 1 --2- 172.21.15.1:0/454636288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c10a7a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f208c009820 tx=0x7f208c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f319032411da1fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f209a7fc640 1 -- 172.21.15.1:0/454636288 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f208c037070 con 0x7f209c1083b0 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f209a7fc640 1 -- 172.21.15.1:0/454636288 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f208c032920 con 0x7f209c1083b0 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f209a7fc640 1 -- 172.21.15.1:0/454636288 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f208c030950 con 0x7f209c1083b0 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f20a1d0d640 1 -- 172.21.15.1:0/454636288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 msgr2=0x7f209c10a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f20a1d0d640 1 --2- 172.21.15.1:0/454636288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c10a7a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f208c009820 tx=0x7f208c02a270 comp rx=0 tx=0).stop 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f20a1d0d640 1 -- 172.21.15.1:0/454636288 shutdown_connections 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f20a1d0d640 1 --2- 172.21.15.1:0/454636288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c10a7a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f20a1d0d640 1 -- 172.21.15.1:0/454636288 >> 172.21.15.1:0/454636288 conn(0x7f209c101f50 msgr2=0x7f209c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f20a1d0d640 1 -- 172.21.15.1:0/454636288 shutdown_connections 2024-09-19T08:54:48.457 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.719+0000 7f20a1d0d640 1 -- 172.21.15.1:0/454636288 wait complete. 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.720+0000 7f20a1d0d640 1 Processor -- start 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.720+0000 7f20a1d0d640 1 -- start start 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.720+0000 7f20a1d0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.720+0000 7f20a1d0d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10bd20 con 0x7f209c1083b0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.720+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.720+0000 7f209b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c19b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51340/0 (socket says 172.21.15.1:51340) 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.720+0000 7f209b7fe640 1 -- 172.21.15.1:0/1119369752 learned_addr learned my addr 172.21.15.1:0/1119369752 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.721+0000 7f209b7fe640 1 -- 172.21.15.1:0/1119369752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c19be00 con 0x7f209c1083b0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.721+0000 7f209b7fe640 1 --2- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c19b8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f208c031000 tx=0x7f208c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.721+0000 7f2098ff9640 1 -- 172.21.15.1:0/1119369752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f208c042070 con 0x7f209c1083b0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.721+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c19c090 con 0x7f209c1083b0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.721+0000 7f2098ff9640 1 -- 172.21.15.1:0/1119369752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f208c0325f0 con 0x7f209c1083b0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.721+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c19ed80 con 0x7f209c1083b0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.721+0000 7f2098ff9640 1 -- 172.21.15.1:0/1119369752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f208c037040 con 0x7f209c1083b0 2024-09-19T08:54:48.458 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.722+0000 7f2098ff9640 1 -- 172.21.15.1:0/1119369752 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f208c045070 con 0x7f209c1083b0 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.722+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c108810 con 0x7f209c1083b0 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.722+0000 7f2098ff9640 1 --2- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2084039160 0x7f208403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.722+0000 7f2098ff9640 1 -- 172.21.15.1:0/1119369752 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f208c06c150 con 0x7f209c1083b0 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.722+0000 7f209affd640 1 --2- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2084039160 0x7f208403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.723+0000 7f209affd640 1 --2- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2084039160 0x7f208403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20900098c0 tx=0x7f2090006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.727+0000 7f2098ff9640 1 -- 172.21.15.1:0/1119369752 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f208c03c930 con 0x7f209c1083b0 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.920+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f209c1031f0 con 0x7f2084039160 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.925+0000 7f2098ff9640 1 -- 172.21.15.1:0/1119369752 <== mgr.14118 v2:172.21.15.1:6800/2001580204 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f209c1031f0 con 0x7f2084039160 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2084039160 msgr2=0x7f208403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 --2- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2084039160 0x7f208403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20900098c0 tx=0x7f2090006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 msgr2=0x7f209c19b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 --2- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c19b8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f208c031000 tx=0x7f208c032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 shutdown_connections 2024-09-19T08:54:48.459 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 --2- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2084039160 0x7f208403b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.460 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 --2- 172.21.15.1:0/1119369752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f209c1083b0 0x7f209c19b8c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.460 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 >> 172.21.15.1:0/1119369752 conn(0x7f209c101f50 msgr2=0x7f209c102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.460 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 shutdown_connections 2024-09-19T08:54:48.460 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:47.927+0000 7f20a1d0d640 1 -- 172.21.15.1:0/1119369752 wait complete. 2024-09-19T08:54:48.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-mon[30939]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:54:48.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:54:48.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:48.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:48 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:49.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:49 smithi001 ceph-mon[30939]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:49.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:49 smithi001 ceph-mon[30939]: [19/Sep/2024:08:54:47] ENGINE Bus STARTING 2024-09-19T08:54:49.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:49 smithi001 ceph-mon[30939]: [19/Sep/2024:08:54:48] ENGINE Serving on https://172.21.15.1:7150 2024-09-19T08:54:49.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:49 smithi001 ceph-mon[30939]: [19/Sep/2024:08:54:48] ENGINE Error in HTTPServer.serve 2024-09-19T08:54:49.665 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:54:49.666 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-19T08:54:49.667 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:54:49.667 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-19T08:54:49.667 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:54:49.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:49 smithi001 ceph-mon[30939]: [19/Sep/2024:08:54:48] ENGINE Serving on http://172.21.15.1:8765 2024-09-19T08:54:49.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:49 smithi001 ceph-mon[30939]: [19/Sep/2024:08:54:48] ENGINE Bus STARTED 2024-09-19T08:54:49.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:49 smithi001 ceph-mon[30939]: mgrmap e8: x(active, since 2s) 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.873+0000 7fd48c25b640 1 Processor -- start 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.873+0000 7fd48c25b640 1 -- start start 2024-09-19T08:54:49.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.873+0000 7fd48c25b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd484107ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.874+0000 7fd48c25b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4841082b0 con 0x7fd4841078e0 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.874+0000 7fd489ff7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd484107ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.874+0000 7fd489ff7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd484107ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51348/0 (socket says 172.21.15.1:51348) 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.874+0000 7fd489ff7640 1 -- 172.21.15.1:0/488807618 learned_addr learned my addr 172.21.15.1:0/488807618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.874+0000 7fd489ff7640 1 -- 172.21.15.1:0/488807618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd484108ae0 con 0x7fd4841078e0 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.875+0000 7fd489ff7640 1 --2- 172.21.15.1:0/488807618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd484107ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd480009820 tx=0x7fd48002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b14ffab72ee66f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.875+0000 7fd488ff5640 1 -- 172.21.15.1:0/488807618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd480037070 con 0x7fd4841078e0 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.875+0000 7fd488ff5640 1 -- 172.21.15.1:0/488807618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd480032920 con 0x7fd4841078e0 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.875+0000 7fd488ff5640 1 -- 172.21.15.1:0/488807618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd480030950 con 0x7fd4841078e0 2024-09-19T08:54:49.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.876+0000 7fd48c25b640 1 -- 172.21.15.1:0/488807618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 msgr2=0x7fd484107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.876+0000 7fd48c25b640 1 --2- 172.21.15.1:0/488807618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd484107ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd480009820 tx=0x7fd48002a270 comp rx=0 tx=0).stop 2024-09-19T08:54:49.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.876+0000 7fd48c25b640 1 -- 172.21.15.1:0/488807618 shutdown_connections 2024-09-19T08:54:49.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.876+0000 7fd48c25b640 1 --2- 172.21.15.1:0/488807618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd484107ce0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.876+0000 7fd48c25b640 1 -- 172.21.15.1:0/488807618 >> 172.21.15.1:0/488807618 conn(0x7fd484103050 msgr2=0x7fd4841054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.876+0000 7fd48c25b640 1 -- 172.21.15.1:0/488807618 shutdown_connections 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.876+0000 7fd48c25b640 1 -- 172.21.15.1:0/488807618 wait complete. 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.876+0000 7fd48c25b640 1 Processor -- start 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.877+0000 7fd48c25b640 1 -- start start 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.877+0000 7fd48c25b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd48407c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.877+0000 7fd48c25b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd48410be90 con 0x7fd4841078e0 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.877+0000 7fd489ff7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd48407c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.877+0000 7fd489ff7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd48407c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51360/0 (socket says 172.21.15.1:51360) 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.877+0000 7fd489ff7640 1 -- 172.21.15.1:0/288242787 learned_addr learned my addr 172.21.15.1:0/288242787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.877+0000 7fd489ff7640 1 -- 172.21.15.1:0/288242787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48407cf30 con 0x7fd4841078e0 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.877+0000 7fd489ff7640 1 --2- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd48407c9f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd480009940 tx=0x7fd480032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.878+0000 7fd47affd640 1 -- 172.21.15.1:0/288242787 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd480042070 con 0x7fd4841078e0 2024-09-19T08:54:49.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.878+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48407b120 con 0x7fd4841078e0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.878+0000 7fd47affd640 1 -- 172.21.15.1:0/288242787 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd4800325f0 con 0x7fd4841078e0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.878+0000 7fd47affd640 1 -- 172.21.15.1:0/288242787 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd480037040 con 0x7fd4841078e0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.878+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48407b660 con 0x7fd4841078e0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.879+0000 7fd47affd640 1 -- 172.21.15.1:0/288242787 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd480045070 con 0x7fd4841078e0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.879+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484107d60 con 0x7fd4841078e0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.879+0000 7fd47affd640 1 --2- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd470039270 0x7fd47003b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.879+0000 7fd47affd640 1 -- 172.21.15.1:0/288242787 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd48006c2d0 con 0x7fd4841078e0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.879+0000 7fd4897f6640 1 --2- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd470039270 0x7fd47003b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.879+0000 7fd4897f6640 1 --2- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd470039270 0x7fd47003b730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd4740098c0 tx=0x7fd474006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:48.884+0000 7fd47affd640 1 -- 172.21.15.1:0/288242787 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd48004b170 con 0x7fd4841078e0 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.065+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fd48407bfb0 con 0x7fd470039270 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.066+0000 7fd47affd640 1 -- 172.21.15.1:0/288242787 <== mgr.14118 v2:172.21.15.1:6800/2001580204 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fd48407bfb0 con 0x7fd470039270 2024-09-19T08:54:49.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd470039270 msgr2=0x7fd47003b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 --2- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd470039270 0x7fd47003b730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd4740098c0 tx=0x7fd474006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 msgr2=0x7fd48407c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 --2- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd48407c9f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd480009940 tx=0x7fd480032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 shutdown_connections 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 --2- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd470039270 0x7fd47003b730 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 --2- 172.21.15.1:0/288242787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4841078e0 0x7fd48407c9f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 >> 172.21.15.1:0/288242787 conn(0x7fd484103050 msgr2=0x7fd484103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 shutdown_connections 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:49.068+0000 7fd48c25b640 1 -- 172.21.15.1:0/288242787 wait complete. 2024-09-19T08:54:49.679 INFO:teuthology.orchestra.run.smithi001.stdout:Generating ssh key... 2024-09-19T08:54:50.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-mon[30939]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:50.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: Generating public/private rsa key pair. 2024-09-19T08:54:50.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: Your identification has been saved in /tmp/tmptx4gifsa/key 2024-09-19T08:54:50.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: Your public key has been saved in /tmp/tmptx4gifsa/key.pub 2024-09-19T08:54:50.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: The key fingerprint is: 2024-09-19T08:54:50.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: SHA256:yaMIpOpWU6Jn5Y5BRTeW3feMbY5tx14wU07STCjG1qs ceph-98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:50.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: The key's randomart image is: 2024-09-19T08:54:50.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: +---[RSA 3072]----+ 2024-09-19T08:54:50.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: | .. +o .. . =.| 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: | .o... .=.+ =| 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: | . . o..=* | 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: | o o o . . .==.| 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: |. + = S .== | 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: |.. B o . . E. ++| 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: |. + * . ..o| 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: |.. . . .| 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: |.. | 2024-09-19T08:54:50.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:54:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: +----[SHA256]-----+ 2024-09-19T08:54:51.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.049+0000 7fa63d655640 1 Processor -- start 2024-09-19T08:54:51.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.049+0000 7fa63d655640 1 -- start start 2024-09-19T08:54:51.117 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.049+0000 7fa63d655640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63807b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:51.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.049+0000 7fa63d655640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa63807b680 con 0x7fa63807cce0 2024-09-19T08:54:51.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.049+0000 7fa636ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63807b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:51.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.049+0000 7fa636ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63807b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51372/0 (socket says 172.21.15.1:51372) 2024-09-19T08:54:51.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.049+0000 7fa636ffd640 1 -- 172.21.15.1:0/3824547186 learned_addr learned my addr 172.21.15.1:0/3824547186 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:51.118 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.049+0000 7fa636ffd640 1 -- 172.21.15.1:0/3824547186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63807b800 con 0x7fa63807cce0 2024-09-19T08:54:51.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.050+0000 7fa636ffd640 1 --2- 172.21.15.1:0/3824547186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63807b140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa628009820 tx=0x7fa62802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc57e8956d7190b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:51.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.050+0000 7fa635ffb640 1 -- 172.21.15.1:0/3824547186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa628037070 con 0x7fa63807cce0 2024-09-19T08:54:51.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.050+0000 7fa635ffb640 1 -- 172.21.15.1:0/3824547186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa628032920 con 0x7fa63807cce0 2024-09-19T08:54:51.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.050+0000 7fa635ffb640 1 -- 172.21.15.1:0/3824547186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa628030950 con 0x7fa63807cce0 2024-09-19T08:54:51.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.051+0000 7fa63d655640 1 -- 172.21.15.1:0/3824547186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 msgr2=0x7fa63807b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:51.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.051+0000 7fa63d655640 1 --2- 172.21.15.1:0/3824547186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63807b140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa628009820 tx=0x7fa62802a270 comp rx=0 tx=0).stop 2024-09-19T08:54:51.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.051+0000 7fa63d655640 1 -- 172.21.15.1:0/3824547186 shutdown_connections 2024-09-19T08:54:51.119 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.051+0000 7fa63d655640 1 --2- 172.21.15.1:0/3824547186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63807b140 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:51.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.051+0000 7fa63d655640 1 -- 172.21.15.1:0/3824547186 >> 172.21.15.1:0/3824547186 conn(0x7fa6381030c0 msgr2=0x7fa6381054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:51.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.051+0000 7fa63d655640 1 -- 172.21.15.1:0/3824547186 shutdown_connections 2024-09-19T08:54:51.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.051+0000 7fa63d655640 1 -- 172.21.15.1:0/3824547186 wait complete. 2024-09-19T08:54:51.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.052+0000 7fa63d655640 1 Processor -- start 2024-09-19T08:54:51.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.052+0000 7fa63d655640 1 -- start start 2024-09-19T08:54:51.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.052+0000 7fa63d655640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63819da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:51.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.052+0000 7fa63d655640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa63810dfc0 con 0x7fa63807cce0 2024-09-19T08:54:51.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.052+0000 7fa636ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63819da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:51.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.052+0000 7fa636ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63819da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51380/0 (socket says 172.21.15.1:51380) 2024-09-19T08:54:51.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.052+0000 7fa636ffd640 1 -- 172.21.15.1:0/3661924305 learned_addr learned my addr 172.21.15.1:0/3661924305 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:51.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.052+0000 7fa636ffd640 1 -- 172.21.15.1:0/3661924305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63819dfc0 con 0x7fa63807cce0 2024-09-19T08:54:51.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.053+0000 7fa636ffd640 1 --2- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63819da80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa6280097f0 tx=0x7fa628032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:51.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.053+0000 7fa61ffff640 1 -- 172.21.15.1:0/3661924305 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa628037040 con 0x7fa63807cce0 2024-09-19T08:54:51.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.053+0000 7fa61ffff640 1 -- 172.21.15.1:0/3661924305 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa628040070 con 0x7fa63807cce0 2024-09-19T08:54:51.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.053+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63819e250 con 0x7fa63807cce0 2024-09-19T08:54:51.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.053+0000 7fa61ffff640 1 -- 172.21.15.1:0/3661924305 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa62803a6d0 con 0x7fa63807cce0 2024-09-19T08:54:51.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.053+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6381a0f40 con 0x7fa63807cce0 2024-09-19T08:54:51.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.054+0000 7fa61ffff640 1 -- 172.21.15.1:0/3661924305 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa62803a870 con 0x7fa63807cce0 2024-09-19T08:54:51.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.054+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63807b1c0 con 0x7fa63807cce0 2024-09-19T08:54:51.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.054+0000 7fa61ffff640 1 --2- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa6200392c0 0x7fa62003b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:51.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.054+0000 7fa61ffff640 1 -- 172.21.15.1:0/3661924305 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa62806c870 con 0x7fa63807cce0 2024-09-19T08:54:51.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.054+0000 7fa6367fc640 1 --2- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa6200392c0 0x7fa62003b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:51.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.054+0000 7fa6367fc640 1 --2- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa6200392c0 0x7fa62003b780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0098c0 tx=0x7fa62c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:51.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.059+0000 7fa61ffff640 1 -- 172.21.15.1:0/3661924305 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6280313a0 con 0x7fa63807cce0 2024-09-19T08:54:51.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.235+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa638104280 con 0x7fa6200392c0 2024-09-19T08:54:51.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.547+0000 7fa61ffff640 1 -- 172.21.15.1:0/3661924305 <== mgr.14118 v2:172.21.15.1:6800/2001580204 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa638104280 con 0x7fa6200392c0 2024-09-19T08:54:51.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.549+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa6200392c0 msgr2=0x7fa62003b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:51.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.549+0000 7fa63d655640 1 --2- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa6200392c0 0x7fa62003b780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0098c0 tx=0x7fa62c006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:51.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.549+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 msgr2=0x7fa63819da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:51.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.549+0000 7fa63d655640 1 --2- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63819da80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa6280097f0 tx=0x7fa628032d00 comp rx=0 tx=0).stop 2024-09-19T08:54:51.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.549+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 shutdown_connections 2024-09-19T08:54:51.125 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.550+0000 7fa63d655640 1 --2- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fa6200392c0 0x7fa62003b780 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:51.125 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.550+0000 7fa63d655640 1 --2- 172.21.15.1:0/3661924305 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa63807cce0 0x7fa63819da80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:51.125 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.550+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 >> 172.21.15.1:0/3661924305 conn(0x7fa6381030c0 msgr2=0x7fa638103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:51.125 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.550+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 shutdown_connections 2024-09-19T08:54:51.125 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:50.550+0000 7fa63d655640 1 -- 172.21.15.1:0/3661924305 wait complete. 2024-09-19T08:54:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:51 smithi001 ceph-mon[30939]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:51 smithi001 ceph-mon[30939]: Generating ssh key... 2024-09-19T08:54:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:51 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:54:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:51 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:54:52.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCd87DB4rjKtcloyFax9LH7/z6Vk1XfQndeG7/iTYpC8gdSFDs2sdnLaCWqn378RNIEhdvj9wMYsn5FoHj+ZmbFvkjicTYaxMAEhYld95K2T9O3kPhgx1G5TPg6ls9QlTGVF4/KFnGry9CUL/97CRMYtkEMsCZqtZi0slLqc6ghP81J8bCrROzDbgRfU0mnI6aQRdlyw3VIf7iThSZFJcyp7hRMxKuGU7lsHeqJGQXjZx0pJswqz0yOnXG1UV7vAp34/lS1WbwUWUTpjFLS/IUhMS48Io69bRWn71g3p2wmsdu2UJozsn+NF9eKaO2FQ8GxbaZvxm1qu3hf+rLz1i3wViB7eVioU/EPodhD6CxN1Yn2IybG/8vLlqTfie+X+Dv6ELsG65dtxrj4WxXQsp0FjjsevL29QgZlRIWADlJFJbGY6Fgn8j4iXTrXUTcecLxS1p3OGreo+i4UJ56qrIbDur+4UXJyu5FSXDaoyD39oPqyWsV/kQPDE65j874PlOU= ceph-98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:54:52.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.509+0000 7f8ccf7f9640 1 Processor -- start 2024-09-19T08:54:52.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.509+0000 7f8ccf7f9640 1 -- start start 2024-09-19T08:54:52.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.509+0000 7f8ccf7f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc8107d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.509+0000 7f8ccf7f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc81082e0 con 0x7f8cc8107910 2024-09-19T08:54:52.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.510+0000 7f8ccd595640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc8107d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.510+0000 7f8ccd595640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc8107d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51396/0 (socket says 172.21.15.1:51396) 2024-09-19T08:54:52.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.510+0000 7f8ccd595640 1 -- 172.21.15.1:0/1932936587 learned_addr learned my addr 172.21.15.1:0/1932936587 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.510+0000 7f8ccd595640 1 -- 172.21.15.1:0/1932936587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc8108b10 con 0x7f8cc8107910 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.511+0000 7f8ccd595640 1 --2- 172.21.15.1:0/1932936587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc8107d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009820 tx=0x7f8cc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9377bd80e6982d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.511+0000 7f8cbffff640 1 -- 172.21.15.1:0/1932936587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cc4037070 con 0x7f8cc8107910 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.511+0000 7f8cbffff640 1 -- 172.21.15.1:0/1932936587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8cc4032920 con 0x7f8cc8107910 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.511+0000 7f8cbffff640 1 -- 172.21.15.1:0/1932936587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cc4030950 con 0x7f8cc8107910 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.512+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/1932936587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 msgr2=0x7f8cc8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.512+0000 7f8ccf7f9640 1 --2- 172.21.15.1:0/1932936587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc8107d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009820 tx=0x7f8cc402a270 comp rx=0 tx=0).stop 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.512+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/1932936587 shutdown_connections 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.512+0000 7f8ccf7f9640 1 --2- 172.21.15.1:0/1932936587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc8107d10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.512+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/1932936587 >> 172.21.15.1:0/1932936587 conn(0x7f8cc81030c0 msgr2=0x7f8cc81054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.512+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/1932936587 shutdown_connections 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.512+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/1932936587 wait complete. 2024-09-19T08:54:52.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.512+0000 7f8ccf7f9640 1 Processor -- start 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.513+0000 7f8ccf7f9640 1 -- start start 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.513+0000 7f8ccf7f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.513+0000 7f8ccf7f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc810bec0 con 0x7f8cc8107910 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.513+0000 7f8ccd595640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.513+0000 7f8ccd595640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51400/0 (socket says 172.21.15.1:51400) 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.513+0000 7f8ccd595640 1 -- 172.21.15.1:0/721311643 learned_addr learned my addr 172.21.15.1:0/721311643 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.513+0000 7f8ccd595640 1 -- 172.21.15.1:0/721311643 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc819be10 con 0x7f8cc8107910 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.513+0000 7f8ccd595640 1 --2- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc819b8d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009940 tx=0x7f8cc4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.514+0000 7f8cbe7fc640 1 -- 172.21.15.1:0/721311643 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cc4042070 con 0x7f8cc8107910 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.514+0000 7f8cbe7fc640 1 -- 172.21.15.1:0/721311643 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8cc40325f0 con 0x7f8cc8107910 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.514+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc819c0a0 con 0x7f8cc8107910 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.514+0000 7f8cbe7fc640 1 -- 172.21.15.1:0/721311643 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cc4037040 con 0x7f8cc8107910 2024-09-19T08:54:52.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.514+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc819ed90 con 0x7f8cc8107910 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.515+0000 7f8cbe7fc640 1 -- 172.21.15.1:0/721311643 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8cc4045070 con 0x7f8cc8107910 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.515+0000 7f8cbe7fc640 1 --2- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f8cb40392c0 0x7f8cb403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.515+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc8107d90 con 0x7f8cc8107910 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.515+0000 7f8cbe7fc640 1 -- 172.21.15.1:0/721311643 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8cc406c280 con 0x7f8cc8107910 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.515+0000 7f8cccd94640 1 --2- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f8cb40392c0 0x7f8cb403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.515+0000 7f8cccd94640 1 --2- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f8cb40392c0 0x7f8cb403b780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80098c0 tx=0x7f8cb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.520+0000 7f8cbe7fc640 1 -- 172.21.15.1:0/721311643 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8cc404b170 con 0x7f8cc8107910 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.697+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f8cc81042c0 con 0x7f8cb40392c0 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.698+0000 7f8cbe7fc640 1 -- 172.21.15.1:0/721311643 <== mgr.14118 v2:172.21.15.1:6800/2001580204 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f8cc81042c0 con 0x7f8cb40392c0 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f8cb40392c0 msgr2=0x7f8cb403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 --2- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f8cb40392c0 0x7f8cb403b780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80098c0 tx=0x7f8cb8006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 msgr2=0x7f8cc819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:52.296 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 --2- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc819b8d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009940 tx=0x7f8cc4032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:52.297 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 shutdown_connections 2024-09-19T08:54:52.297 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 --2- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f8cb40392c0 0x7f8cb403b780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.297 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 --2- 172.21.15.1:0/721311643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc8107910 0x7f8cc819b8d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:52.297 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 >> 172.21.15.1:0/721311643 conn(0x7f8cc81030c0 msgr2=0x7f8cc8103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:52.297 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 shutdown_connections 2024-09-19T08:54:52.297 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:51.700+0000 7f8ccf7f9640 1 -- 172.21.15.1:0/721311643 wait complete. 2024-09-19T08:54:52.297 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:54:52.297 INFO:teuthology.orchestra.run.smithi001.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T08:54:52.301 INFO:teuthology.orchestra.run.smithi001.stdout:Adding host smithi001... 2024-09-19T08:54:53.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:52 smithi001 ceph-mon[30939]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:53.895 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:53 smithi001 ceph-mon[30939]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:54.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:54 smithi001 ceph-mon[30939]: Deploying cephadm binary to smithi001 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Added host 'smithi001' with addr '172.21.15.1' 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.681+0000 7f5543013640 1 Processor -- start 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.681+0000 7f5543013640 1 -- start start 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.682+0000 7f5543013640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c10a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.682+0000 7f5543013640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f553c063510 con 0x7f553c108330 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.682+0000 7f5540daf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c10a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.682+0000 7f5540daf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c10a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35684/0 (socket says 172.21.15.1:35684) 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.682+0000 7f5540daf640 1 -- 172.21.15.1:0/744328230 learned_addr learned my addr 172.21.15.1:0/744328230 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.682+0000 7f5540daf640 1 -- 172.21.15.1:0/744328230 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c10ac60 con 0x7f553c108330 2024-09-19T08:54:57.409 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.683+0000 7f5540daf640 1 --2- 172.21.15.1:0/744328230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c10a720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5530009820 tx=0x7f553002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb809d77e3c5b064 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.683+0000 7f553b7fe640 1 -- 172.21.15.1:0/744328230 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5530037070 con 0x7f553c108330 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.683+0000 7f553b7fe640 1 -- 172.21.15.1:0/744328230 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5530032920 con 0x7f553c108330 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.683+0000 7f553b7fe640 1 -- 172.21.15.1:0/744328230 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5530030950 con 0x7f553c108330 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.683+0000 7f5543013640 1 -- 172.21.15.1:0/744328230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 msgr2=0x7f553c10a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.683+0000 7f5543013640 1 --2- 172.21.15.1:0/744328230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c10a720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5530009820 tx=0x7f553002a270 comp rx=0 tx=0).stop 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 -- 172.21.15.1:0/744328230 shutdown_connections 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 --2- 172.21.15.1:0/744328230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c10a720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 -- 172.21.15.1:0/744328230 >> 172.21.15.1:0/744328230 conn(0x7f553c101f50 msgr2=0x7f553c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 -- 172.21.15.1:0/744328230 shutdown_connections 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 -- 172.21.15.1:0/744328230 wait complete. 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 Processor -- start 2024-09-19T08:54:57.410 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 -- start start 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.684+0000 7f5543013640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10bd60 con 0x7f553c108330 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5540daf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5540daf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35698/0 (socket says 172.21.15.1:35698) 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5540daf640 1 -- 172.21.15.1:0/531632979 learned_addr learned my addr 172.21.15.1:0/531632979 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5540daf640 1 -- 172.21.15.1:0/531632979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c1080f0 con 0x7f553c108330 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5540daf640 1 --2- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c107bb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5530031000 tx=0x7f5530032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5539ffb640 1 -- 172.21.15.1:0/531632979 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5530042070 con 0x7f553c108330 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c1062e0 con 0x7f553c108330 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5539ffb640 1 -- 172.21.15.1:0/531632979 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f55300325f0 con 0x7f553c108330 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.685+0000 7f5539ffb640 1 -- 172.21.15.1:0/531632979 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5530037040 con 0x7f553c108330 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.686+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c106820 con 0x7f553c108330 2024-09-19T08:54:57.411 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.686+0000 7f5539ffb640 1 -- 172.21.15.1:0/531632979 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5530045070 con 0x7f553c108330 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.687+0000 7f5539ffb640 1 --2- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f552c039270 0x7f552c03b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.687+0000 7f5539ffb640 1 -- 172.21.15.1:0/531632979 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f553006c380 con 0x7f553c108330 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.687+0000 7f553bfff640 1 --2- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f552c039270 0x7f552c03b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.687+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c108790 con 0x7f553c108330 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.687+0000 7f553bfff640 1 --2- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f552c039270 0x7f552c03b730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f55280098c0 tx=0x7f5528006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.692+0000 7f5539ffb640 1 -- 172.21.15.1:0/531632979 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5530042210 con 0x7f553c108330 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:52.874+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}) -- 0x7f553c106f90 con 0x7f552c039270 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.778+0000 7f5539ffb640 1 -- 172.21.15.1:0/531632979 <== mgr.14118 v2:172.21.15.1:6800/2001580204 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f553c106f90 con 0x7f552c039270 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f552c039270 msgr2=0x7f552c03b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 --2- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f552c039270 0x7f552c03b730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f55280098c0 tx=0x7f5528006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 msgr2=0x7f553c107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 --2- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c107bb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5530031000 tx=0x7f5530032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:57.412 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 shutdown_connections 2024-09-19T08:54:57.413 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 --2- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f552c039270 0x7f552c03b730 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:57.413 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 --2- 172.21.15.1:0/531632979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f553c108330 0x7f553c107bb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:57.413 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 >> 172.21.15.1:0/531632979 conn(0x7f553c101f50 msgr2=0x7f553c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:57.413 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 shutdown_connections 2024-09-19T08:54:57.413 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:56.781+0000 7f5543013640 1 -- 172.21.15.1:0/531632979 wait complete. 2024-09-19T08:54:57.413 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mon service... 2024-09-19T08:54:58.008 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:57 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:54:58.008 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:57 smithi001 ceph-mon[30939]: Added host smithi001 2024-09-19T08:54:58.008 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:57 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:58.793 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T08:54:58.793 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.799+0000 7f2c99861640 1 Processor -- start 2024-09-19T08:54:58.793 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.799+0000 7f2c99861640 1 -- start start 2024-09-19T08:54:58.793 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.799+0000 7f2c99861640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c94107d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:58.793 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.799+0000 7f2c99861640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2c941082e0 con 0x7f2c94107910 2024-09-19T08:54:58.793 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.799+0000 7f2c92ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c94107d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.799+0000 7f2c92ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c94107d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35706/0 (socket says 172.21.15.1:35706) 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.799+0000 7f2c92ffd640 1 -- 172.21.15.1:0/2558282208 learned_addr learned my addr 172.21.15.1:0/2558282208 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.799+0000 7f2c92ffd640 1 -- 172.21.15.1:0/2558282208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c94108b10 con 0x7f2c94107910 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.800+0000 7f2c92ffd640 1 --2- 172.21.15.1:0/2558282208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c94107d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009820 tx=0x7f2c8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929bf6ed3073096f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.800+0000 7f2c927fc640 1 -- 172.21.15.1:0/2558282208 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c84037070 con 0x7f2c94107910 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.800+0000 7f2c927fc640 1 -- 172.21.15.1:0/2558282208 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2c84032920 con 0x7f2c94107910 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.800+0000 7f2c927fc640 1 -- 172.21.15.1:0/2558282208 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c84030950 con 0x7f2c94107910 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.801+0000 7f2c99861640 1 -- 172.21.15.1:0/2558282208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 msgr2=0x7f2c94107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.801+0000 7f2c99861640 1 --2- 172.21.15.1:0/2558282208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c94107d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009820 tx=0x7f2c8402a270 comp rx=0 tx=0).stop 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.801+0000 7f2c99861640 1 -- 172.21.15.1:0/2558282208 shutdown_connections 2024-09-19T08:54:58.794 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.801+0000 7f2c99861640 1 --2- 172.21.15.1:0/2558282208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c94107d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.801+0000 7f2c99861640 1 -- 172.21.15.1:0/2558282208 >> 172.21.15.1:0/2558282208 conn(0x7f2c941030c0 msgr2=0x7f2c941054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.801+0000 7f2c99861640 1 -- 172.21.15.1:0/2558282208 shutdown_connections 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.801+0000 7f2c99861640 1 -- 172.21.15.1:0/2558282208 wait complete. 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c99861640 1 Processor -- start 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c99861640 1 -- start start 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c99861640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c9419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c99861640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9410bec0 con 0x7f2c94107910 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c92ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c9419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c92ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c9419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35714/0 (socket says 172.21.15.1:35714) 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c92ffd640 1 -- 172.21.15.1:0/4288134944 learned_addr learned my addr 172.21.15.1:0/4288134944 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c92ffd640 1 -- 172.21.15.1:0/4288134944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9419be10 con 0x7f2c94107910 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.802+0000 7f2c92ffd640 1 --2- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c9419b8d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009940 tx=0x7f2c84032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:58.795 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.803+0000 7f2c9885f640 1 -- 172.21.15.1:0/4288134944 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c84042070 con 0x7f2c94107910 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.803+0000 7f2c9885f640 1 -- 172.21.15.1:0/4288134944 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2c840325f0 con 0x7f2c94107910 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.803+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9419c0a0 con 0x7f2c94107910 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.803+0000 7f2c9885f640 1 -- 172.21.15.1:0/4288134944 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c84037040 con 0x7f2c94107910 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.803+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9419ed90 con 0x7f2c94107910 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.803+0000 7f2c9885f640 1 -- 172.21.15.1:0/4288134944 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f2c84045070 con 0x7f2c94107910 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.804+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c94107d90 con 0x7f2c94107910 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.804+0000 7f2c9885f640 1 --2- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2c800392c0 0x7f2c8003b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.804+0000 7f2c9885f640 1 -- 172.21.15.1:0/4288134944 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2c8406c4e0 con 0x7f2c94107910 2024-09-19T08:54:58.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.804+0000 7f2c8bfff640 1 --2- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2c800392c0 0x7f2c8003b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.804+0000 7f2c8bfff640 1 --2- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2c800392c0 0x7f2c8003b780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0098c0 tx=0x7f2c7c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:57.809+0000 7f2c9885f640 1 -- 172.21.15.1:0/4288134944 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c84045520 con 0x7f2c94107910 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.007+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2c941042c0 con 0x7f2c800392c0 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.012+0000 7f2c9885f640 1 -- 172.21.15.1:0/4288134944 <== mgr.14118 v2:172.21.15.1:6800/2001580204 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2c941042c0 con 0x7f2c800392c0 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2c800392c0 msgr2=0x7f2c8003b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 --2- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2c800392c0 0x7f2c8003b780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0098c0 tx=0x7f2c7c006db0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 msgr2=0x7f2c9419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 --2- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c9419b8d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009940 tx=0x7f2c84032e40 comp rx=0 tx=0).stop 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 shutdown_connections 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 --2- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f2c800392c0 0x7f2c8003b780 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 --2- 172.21.15.1:0/4288134944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c94107910 0x7f2c9419b8d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 >> 172.21.15.1:0/4288134944 conn(0x7f2c941030c0 msgr2=0x7f2c94103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:58.797 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 shutdown_connections 2024-09-19T08:54:58.798 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:58.015+0000 7f2c99861640 1 -- 172.21.15.1:0/4288134944 wait complete. 2024-09-19T08:54:58.798 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mgr service... 2024-09-19T08:54:59.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:59 smithi001 ceph-mon[30939]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:54:59.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:59 smithi001 ceph-mon[30939]: Saving service mon spec with placement count:5 2024-09-19T08:54:59.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:54:59 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:55:00.775 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:00 smithi001 ceph-mon[30939]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:00.775 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:00 smithi001 ceph-mon[30939]: Saving service mgr spec with placement count:2 2024-09-19T08:55:00.775 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:00 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:55:00.776 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:00 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.364+0000 7fd6247a2640 1 Processor -- start 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.364+0000 7fd6247a2640 1 -- start start 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.364+0000 7fd6247a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c106c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.364+0000 7fd6247a2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c1071e0 con 0x7fd61c106810 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.364+0000 7fd62253e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c106c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.364+0000 7fd62253e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c106c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35724/0 (socket says 172.21.15.1:35724) 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.364+0000 7fd62253e640 1 -- 172.21.15.1:0/3801056196 learned_addr learned my addr 172.21.15.1:0/3801056196 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.365+0000 7fd62253e640 1 -- 172.21.15.1:0/3801056196 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c107a10 con 0x7fd61c106810 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.365+0000 7fd62253e640 1 --2- 172.21.15.1:0/3801056196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c106c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd618009820 tx=0x7fd61802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c798c806e0acab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.366+0000 7fd62153c640 1 -- 172.21.15.1:0/3801056196 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd618037070 con 0x7fd61c106810 2024-09-19T08:55:01.066 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.366+0000 7fd62153c640 1 -- 172.21.15.1:0/3801056196 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd618032920 con 0x7fd61c106810 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.366+0000 7fd62153c640 1 -- 172.21.15.1:0/3801056196 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd618030950 con 0x7fd61c106810 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.366+0000 7fd6247a2640 1 -- 172.21.15.1:0/3801056196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 msgr2=0x7fd61c106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.366+0000 7fd6247a2640 1 --2- 172.21.15.1:0/3801056196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c106c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd618009820 tx=0x7fd61802a270 comp rx=0 tx=0).stop 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.366+0000 7fd6247a2640 1 -- 172.21.15.1:0/3801056196 shutdown_connections 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.366+0000 7fd6247a2640 1 --2- 172.21.15.1:0/3801056196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c106c10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.366+0000 7fd6247a2640 1 -- 172.21.15.1:0/3801056196 >> 172.21.15.1:0/3801056196 conn(0x7fd61c102060 msgr2=0x7fd61c104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.367+0000 7fd6247a2640 1 -- 172.21.15.1:0/3801056196 shutdown_connections 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.367+0000 7fd6247a2640 1 -- 172.21.15.1:0/3801056196 wait complete. 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.367+0000 7fd6247a2640 1 Processor -- start 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.367+0000 7fd6247a2640 1 -- start start 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd6247a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd6247a2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c10adc0 con 0x7fd61c106810 2024-09-19T08:55:01.067 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd62253e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd62253e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c19b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35732/0 (socket says 172.21.15.1:35732) 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd62253e640 1 -- 172.21.15.1:0/2418872830 learned_addr learned my addr 172.21.15.1:0/2418872830 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd62253e640 1 -- 172.21.15.1:0/2418872830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c19be20 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd62253e640 1 --2- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c19b8e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6180097f0 tx=0x7fd618032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd6137fe640 1 -- 172.21.15.1:0/2418872830 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd618037040 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd6137fe640 1 -- 172.21.15.1:0/2418872830 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd618040070 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c19c0b0 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.368+0000 7fd6137fe640 1 -- 172.21.15.1:0/2418872830 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd61803a610 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.369+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61c19eda0 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.369+0000 7fd6137fe640 1 -- 172.21.15.1:0/2418872830 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd61803a890 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.370+0000 7fd6137fe640 1 --2- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd608039270 0x7fd60803b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.370+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd61c106c90 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.370+0000 7fd6137fe640 1 -- 172.21.15.1:0/2418872830 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd61806c920 con 0x7fd61c106810 2024-09-19T08:55:01.068 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.370+0000 7fd621d3d640 1 --2- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd608039270 0x7fd60803b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.370+0000 7fd621d3d640 1 --2- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd608039270 0x7fd60803b730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0098c0 tx=0x7fd60c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.375+0000 7fd6137fe640 1 -- 172.21.15.1:0/2418872830 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd618041270 con 0x7fd61c106810 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.588+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fd61c02dab0 con 0x7fd608039270 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.593+0000 7fd6137fe640 1 -- 172.21.15.1:0/2418872830 <== mgr.14118 v2:172.21.15.1:6800/2001580204 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd61c02dab0 con 0x7fd608039270 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd608039270 msgr2=0x7fd60803b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 --2- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd608039270 0x7fd60803b730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0098c0 tx=0x7fd60c006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 msgr2=0x7fd61c19b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 --2- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c19b8e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6180097f0 tx=0x7fd618032d00 comp rx=0 tx=0).stop 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 shutdown_connections 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 --2- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd608039270 0x7fd60803b730 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 --2- 172.21.15.1:0/2418872830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd61c106810 0x7fd61c19b8e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 >> 172.21.15.1:0/2418872830 conn(0x7fd61c102060 msgr2=0x7fd61c102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 shutdown_connections 2024-09-19T08:55:01.069 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:54:59.595+0000 7fd6247a2640 1 -- 172.21.15.1:0/2418872830 wait complete. 2024-09-19T08:55:01.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:01 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:55:01.879 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:01 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/495926082' entity='client.admin' 2024-09-19T08:55:02.768 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.428+0000 7f69b07a5640 1 Processor -- start 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.428+0000 7f69b07a5640 1 -- start start 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.429+0000 7f69b07a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a810a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.429+0000 7f69b07a5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8063490 con 0x7f69a8108400 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.429+0000 7f69ae541640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a810a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.429+0000 7f69ae541640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a810a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35734/0 (socket says 172.21.15.1:35734) 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.429+0000 7f69ae541640 1 -- 172.21.15.1:0/4150068098 learned_addr learned my addr 172.21.15.1:0/4150068098 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.429+0000 7f69ae541640 1 -- 172.21.15.1:0/4150068098 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a810ad30 con 0x7f69a8108400 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.430+0000 7f69ae541640 1 --2- 172.21.15.1:0/4150068098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a810a7f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009820 tx=0x7f69a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952e590d56fa0af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.430+0000 7f69ad53f640 1 -- 172.21.15.1:0/4150068098 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a4037070 con 0x7f69a8108400 2024-09-19T08:55:02.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.430+0000 7f69ad53f640 1 -- 172.21.15.1:0/4150068098 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69a4032940 con 0x7f69a8108400 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.430+0000 7f69ad53f640 1 -- 172.21.15.1:0/4150068098 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a40308b0 con 0x7f69a8108400 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.431+0000 7f69b07a5640 1 -- 172.21.15.1:0/4150068098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 msgr2=0x7f69a810a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.431+0000 7f69b07a5640 1 --2- 172.21.15.1:0/4150068098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a810a7f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009820 tx=0x7f69a402a270 comp rx=0 tx=0).stop 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.431+0000 7f69b07a5640 1 -- 172.21.15.1:0/4150068098 shutdown_connections 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.431+0000 7f69b07a5640 1 --2- 172.21.15.1:0/4150068098 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a810a7f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.431+0000 7f69b07a5640 1 -- 172.21.15.1:0/4150068098 >> 172.21.15.1:0/4150068098 conn(0x7f69a8102060 msgr2=0x7f69a8104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.431+0000 7f69b07a5640 1 -- 172.21.15.1:0/4150068098 shutdown_connections 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.431+0000 7f69b07a5640 1 -- 172.21.15.1:0/4150068098 wait complete. 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.432+0000 7f69b07a5640 1 Processor -- start 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.432+0000 7f69b07a5640 1 -- start start 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.432+0000 7f69b07a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a8107c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.432+0000 7f69b07a5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f69a810bdb0 con 0x7f69a8108400 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.432+0000 7f69ae541640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a8107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:02.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.432+0000 7f69ae541640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a8107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35736/0 (socket says 172.21.15.1:35736) 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.432+0000 7f69ae541640 1 -- 172.21.15.1:0/495926082 learned_addr learned my addr 172.21.15.1:0/495926082 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.433+0000 7f69ae541640 1 -- 172.21.15.1:0/495926082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a81081c0 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.433+0000 7f69ae541640 1 --2- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a8107c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69a4032670 tx=0x7f69a40326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.433+0000 7f699f7fe640 1 -- 172.21.15.1:0/495926082 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a4042070 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.433+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a81063b0 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.433+0000 7f699f7fe640 1 -- 172.21.15.1:0/495926082 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69a403d930 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.433+0000 7f699f7fe640 1 -- 172.21.15.1:0/495926082 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a4037040 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.433+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a81068f0 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.434+0000 7f699f7fe640 1 -- 172.21.15.1:0/495926082 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f69a4045070 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.434+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698c0052c0 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.434+0000 7f699f7fe640 1 --2- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f69940392c0 0x7f699403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.434+0000 7f699f7fe640 1 -- 172.21.15.1:0/495926082 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f69a406c550 con 0x7f69a8108400 2024-09-19T08:55:02.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.434+0000 7f69add40640 1 --2- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f69940392c0 0x7f699403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.435+0000 7f69add40640 1 --2- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f69940392c0 0x7f699403b780 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f69980098c0 tx=0x7f6998006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.439+0000 7f699f7fe640 1 -- 172.21.15.1:0/495926082 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69a403cdc0 con 0x7f69a8108400 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.621+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f698c0055b0 con 0x7f69a8108400 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.623+0000 7f699f7fe640 1 -- 172.21.15.1:0/495926082 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f69a4045520 con 0x7f69a8108400 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f69940392c0 msgr2=0x7f699403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 --2- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f69940392c0 0x7f699403b780 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f69980098c0 tx=0x7f6998006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 msgr2=0x7f69a8107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 --2- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a8107c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69a4032670 tx=0x7f69a40326a0 comp rx=0 tx=0).stop 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 shutdown_connections 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 --2- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f69940392c0 0x7f699403b780 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 --2- 172.21.15.1:0/495926082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69a8108400 0x7f69a8107c80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 >> 172.21.15.1:0/495926082 conn(0x7f69a8102060 msgr2=0x7f69a8102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 shutdown_connections 2024-09-19T08:55:02.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:01.626+0000 7f69b07a5640 1 -- 172.21.15.1:0/495926082 wait complete. 2024-09-19T08:55:03.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:03 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:55:03.692 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:03 smithi001 ceph-mon[30939]: from='mgr.14118 172.21.15.1:0/3910131823' entity='mgr.x' 2024-09-19T08:55:03.692 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:03 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/135659251' entity='client.admin' 2024-09-19T08:55:04.007 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.189+0000 7fda00f13640 1 Processor -- start 2024-09-19T08:55:04.007 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.189+0000 7fda00f13640 1 -- start start 2024-09-19T08:55:04.007 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.190+0000 7fda00f13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc10a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:04.007 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.190+0000 7fda00f13640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc063510 con 0x7fd9fc108330 2024-09-19T08:55:04.007 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.190+0000 7fd9fa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc10a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:04.007 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.190+0000 7fd9fa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc10a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36146/0 (socket says 172.21.15.1:36146) 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.190+0000 7fd9fa59c640 1 -- 172.21.15.1:0/3943187182 learned_addr learned my addr 172.21.15.1:0/3943187182 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.190+0000 7fd9fa59c640 1 -- 172.21.15.1:0/3943187182 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc10ac60 con 0x7fd9fc108330 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.191+0000 7fd9fa59c640 1 --2- 172.21.15.1:0/3943187182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc10a720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009820 tx=0x7fd9ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e55e209d7802e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.191+0000 7fd9f9d9b640 1 -- 172.21.15.1:0/3943187182 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9ec037070 con 0x7fd9fc108330 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.191+0000 7fd9f9d9b640 1 -- 172.21.15.1:0/3943187182 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9ec032940 con 0x7fd9fc108330 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.191+0000 7fd9f9d9b640 1 -- 172.21.15.1:0/3943187182 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9ec0308b0 con 0x7fd9fc108330 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.192+0000 7fda00f13640 1 -- 172.21.15.1:0/3943187182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 msgr2=0x7fd9fc10a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.192+0000 7fda00f13640 1 --2- 172.21.15.1:0/3943187182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc10a720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009820 tx=0x7fd9ec02a270 comp rx=0 tx=0).stop 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.192+0000 7fda00f13640 1 -- 172.21.15.1:0/3943187182 shutdown_connections 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.192+0000 7fda00f13640 1 --2- 172.21.15.1:0/3943187182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc10a720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.192+0000 7fda00f13640 1 -- 172.21.15.1:0/3943187182 >> 172.21.15.1:0/3943187182 conn(0x7fd9fc101f50 msgr2=0x7fd9fc104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.192+0000 7fda00f13640 1 -- 172.21.15.1:0/3943187182 shutdown_connections 2024-09-19T08:55:04.008 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.192+0000 7fda00f13640 1 -- 172.21.15.1:0/3943187182 wait complete. 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fda00f13640 1 Processor -- start 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fda00f13640 1 -- start start 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fda00f13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fda00f13640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc10bda0 con 0x7fd9fc108330 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fd9fa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fd9fa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36162/0 (socket says 172.21.15.1:36162) 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fd9fa59c640 1 -- 172.21.15.1:0/135659251 learned_addr learned my addr 172.21.15.1:0/135659251 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fd9fa59c640 1 -- 172.21.15.1:0/135659251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc1080f0 con 0x7fd9fc108330 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.193+0000 7fd9fa59c640 1 --2- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc107bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec032670 tx=0x7fd9ec0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.194+0000 7fd9f37fe640 1 -- 172.21.15.1:0/135659251 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9ec042070 con 0x7fd9fc108330 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.194+0000 7fd9f37fe640 1 -- 172.21.15.1:0/135659251 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9ec03d930 con 0x7fd9fc108330 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.194+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9fc1062e0 con 0x7fd9fc108330 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.194+0000 7fd9f37fe640 1 -- 172.21.15.1:0/135659251 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9ec037040 con 0x7fd9fc108330 2024-09-19T08:55:04.009 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.194+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9fc106820 con 0x7fd9fc108330 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.194+0000 7fd9f37fe640 1 -- 172.21.15.1:0/135659251 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd9ec045070 con 0x7fd9fc108330 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.195+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9fc108790 con 0x7fd9fc108330 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.195+0000 7fd9f37fe640 1 --2- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd9e80392c0 0x7fd9e803b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.195+0000 7fd9f37fe640 1 -- 172.21.15.1:0/135659251 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd9ec06c460 con 0x7fd9fc108330 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.195+0000 7fd9f3fff640 1 --2- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd9e80392c0 0x7fd9e803b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.195+0000 7fd9f3fff640 1 --2- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd9e80392c0 0x7fd9e803b780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40098c0 tx=0x7fd9e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.200+0000 7fd9f37fe640 1 -- 172.21.15.1:0/135659251 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9ec03cdc0 con 0x7fd9fc108330 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.377+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fd9fc107050 con 0x7fd9fc108330 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.379+0000 7fd9f37fe640 1 -- 172.21.15.1:0/135659251 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fd9ec045520 con 0x7fd9fc108330 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.381+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd9e80392c0 msgr2=0x7fd9e803b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.381+0000 7fda00f13640 1 --2- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd9e80392c0 0x7fd9e803b780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40098c0 tx=0x7fd9e4006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.381+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 msgr2=0x7fd9fc107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:04.010 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.381+0000 7fda00f13640 1 --2- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc107bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec032670 tx=0x7fd9ec0326a0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.011 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.382+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 shutdown_connections 2024-09-19T08:55:04.011 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.382+0000 7fda00f13640 1 --2- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fd9e80392c0 0x7fd9e803b780 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.011 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.382+0000 7fda00f13640 1 --2- 172.21.15.1:0/135659251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9fc108330 0x7fd9fc107bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:04.011 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.382+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 >> 172.21.15.1:0/135659251 conn(0x7fd9fc101f50 msgr2=0x7fd9fc102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:04.011 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.382+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 shutdown_connections 2024-09-19T08:55:04.011 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:03.382+0000 7fda00f13640 1 -- 172.21.15.1:0/135659251 wait complete. 2024-09-19T08:55:04.011 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling the dashboard module... 2024-09-19T08:55:04.900 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:04 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3753564392' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T08:55:04.900 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: ignoring --setuser ceph since I am not root 2024-09-19T08:55:04.900 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: ignoring --setgroup ceph since I am not root 2024-09-19T08:55:04.900 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:04.899+0000 7f9c006d8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:55:05.186 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:04.958+0000 7f9c006d8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:55:05.187 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:05.115+0000 7f9c006d8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:55:05.187 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:05.186+0000 7f9c006d8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:55:05.491 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:05.340+0000 7f9c006d8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:55:05.492 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:05.491+0000 7f9c006d8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:55:05.768 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.441+0000 7f78ed802640 1 Processor -- start 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.441+0000 7f78ed802640 1 -- start start 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.442+0000 7f78ed802640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e8107c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.442+0000 7f78ed802640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8108200 con 0x7f78e8107830 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.442+0000 7f78e6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e8107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.442+0000 7f78e6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e8107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36168/0 (socket says 172.21.15.1:36168) 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.442+0000 7f78e6ffd640 1 -- 172.21.15.1:0/631095088 learned_addr learned my addr 172.21.15.1:0/631095088 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.442+0000 7f78e6ffd640 1 -- 172.21.15.1:0/631095088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e81089e0 con 0x7f78e8107830 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.443+0000 7f78e6ffd640 1 --2- 172.21.15.1:0/631095088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e8107c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009820 tx=0x7f78d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e569c3976fbec13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.443+0000 7f78e5ffb640 1 -- 172.21.15.1:0/631095088 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78d8037070 con 0x7f78e8107830 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.443+0000 7f78e5ffb640 1 -- 172.21.15.1:0/631095088 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78d8032940 con 0x7f78e8107830 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.443+0000 7f78e5ffb640 1 -- 172.21.15.1:0/631095088 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78d80308b0 con 0x7f78e8107830 2024-09-19T08:55:05.769 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.444+0000 7f78ed802640 1 -- 172.21.15.1:0/631095088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 msgr2=0x7f78e8107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.444+0000 7f78ed802640 1 --2- 172.21.15.1:0/631095088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e8107c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009820 tx=0x7f78d802a270 comp rx=0 tx=0).stop 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.444+0000 7f78ed802640 1 -- 172.21.15.1:0/631095088 shutdown_connections 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.444+0000 7f78ed802640 1 --2- 172.21.15.1:0/631095088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e8107c30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.444+0000 7f78ed802640 1 -- 172.21.15.1:0/631095088 >> 172.21.15.1:0/631095088 conn(0x7f78e8102fe0 msgr2=0x7f78e8105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.444+0000 7f78ed802640 1 -- 172.21.15.1:0/631095088 shutdown_connections 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.444+0000 7f78ed802640 1 -- 172.21.15.1:0/631095088 wait complete. 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.444+0000 7f78ed802640 1 Processor -- start 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.445+0000 7f78ed802640 1 -- start start 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.445+0000 7f78ed802640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.445+0000 7f78ed802640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f78e810bd90 con 0x7f78e8107830 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.445+0000 7f78e6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.445+0000 7f78e6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e819b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36184/0 (socket says 172.21.15.1:36184) 2024-09-19T08:55:05.770 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.445+0000 7f78e6ffd640 1 -- 172.21.15.1:0/3753564392 learned_addr learned my addr 172.21.15.1:0/3753564392 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.446+0000 7f78e6ffd640 1 -- 172.21.15.1:0/3753564392 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e819bd50 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.446+0000 7f78e6ffd640 1 --2- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e819b810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78d80097f0 tx=0x7f78d8032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.446+0000 7f78ec800640 1 -- 172.21.15.1:0/3753564392 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78d8037040 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.446+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e819bfe0 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.446+0000 7f78ec800640 1 -- 172.21.15.1:0/3753564392 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78d8040070 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.446+0000 7f78ec800640 1 -- 172.21.15.1:0/3753564392 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78d803a520 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.446+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e819ecd0 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.447+0000 7f78ec800640 1 -- 172.21.15.1:0/3753564392 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f78d803a820 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.447+0000 7f78ec800640 1 --2- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f78d0039220 0x7f78d003b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.447+0000 7f78ec800640 1 -- 172.21.15.1:0/3753564392 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f78d806d9c0 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.447+0000 7f78e67fc640 1 --2- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f78d0039220 0x7f78d003b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.447+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e8107cb0 con 0x7f78e8107830 2024-09-19T08:55:05.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.448+0000 7f78e67fc640 1 --2- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f78d0039220 0x7f78d003b6e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0098c0 tx=0x7f78dc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.452+0000 7f78ec800640 1 -- 172.21.15.1:0/3753564392 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78d8044c70 con 0x7f78e8107830 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.687+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f78e819f150 con 0x7f78e8107830 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.739+0000 7f78ec800640 1 -- 172.21.15.1:0/3753564392 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f78d8042e30 con 0x7f78e8107830 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.740+0000 7f78ec800640 1 -- 172.21.15.1:0/3753564392 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f78d806dd10 con 0x7f78e8107830 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.741+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f78d0039220 msgr2=0x7f78d003b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.741+0000 7f78ed802640 1 --2- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f78d0039220 0x7f78d003b6e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0098c0 tx=0x7f78dc006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.741+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 msgr2=0x7f78e819b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.741+0000 7f78ed802640 1 --2- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e819b810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78d80097f0 tx=0x7f78d8032e60 comp rx=0 tx=0).stop 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.741+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 shutdown_connections 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.741+0000 7f78ed802640 1 --2- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f78d0039220 0x7f78d003b6e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.741+0000 7f78ed802640 1 --2- 172.21.15.1:0/3753564392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78e8107830 0x7f78e819b810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.741+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 >> 172.21.15.1:0/3753564392 conn(0x7f78e8102fe0 msgr2=0x7f78e8103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:05.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.742+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 shutdown_connections 2024-09-19T08:55:05.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:04.742+0000 7f78ed802640 1 -- 172.21.15.1:0/3753564392 wait complete. 2024-09-19T08:55:06.035 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:05 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3753564392' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T08:55:06.036 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:05 smithi001 ceph-mon[30939]: mgrmap e9: x(active, since 19s) 2024-09-19T08:55:06.036 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:05.831+0000 7f9c006d8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:55:06.036 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:05.894+0000 7f9c006d8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:55:06.297 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:06 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:06.092+0000 7f9c006d8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:55:06.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:06 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2552220982' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:55:07.245 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:07.046+0000 7f9c006d8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:55:07.246 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:07.118+0000 7f9c006d8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:55:07.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:55:07.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T08:55:07.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.210+0000 7fbc694f1640 1 Processor -- start 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.210+0000 7fbc694f1640 1 -- start start 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.210+0000 7fbc694f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc6410a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.210+0000 7fbc694f1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc64063510 con 0x7fbc64108330 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.210+0000 7fbc62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc6410a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.211+0000 7fbc62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc6410a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36220/0 (socket says 172.21.15.1:36220) 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.211+0000 7fbc62ffd640 1 -- 172.21.15.1:0/879597245 learned_addr learned my addr 172.21.15.1:0/879597245 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.211+0000 7fbc62ffd640 1 -- 172.21.15.1:0/879597245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6410ac60 con 0x7fbc64108330 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.211+0000 7fbc62ffd640 1 --2- 172.21.15.1:0/879597245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc6410a720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009820 tx=0x7fbc5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7af8c9e6dda71c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:07.257 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc61ffb640 1 -- 172.21.15.1:0/879597245 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc54037070 con 0x7fbc64108330 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc61ffb640 1 -- 172.21.15.1:0/879597245 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc54032940 con 0x7fbc64108330 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc61ffb640 1 -- 172.21.15.1:0/879597245 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc540308b0 con 0x7fbc64108330 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc694f1640 1 -- 172.21.15.1:0/879597245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 msgr2=0x7fbc6410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc694f1640 1 --2- 172.21.15.1:0/879597245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc6410a720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009820 tx=0x7fbc5402a270 comp rx=0 tx=0).stop 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc694f1640 1 -- 172.21.15.1:0/879597245 shutdown_connections 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc694f1640 1 --2- 172.21.15.1:0/879597245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc6410a720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc694f1640 1 -- 172.21.15.1:0/879597245 >> 172.21.15.1:0/879597245 conn(0x7fbc64101f50 msgr2=0x7fbc64104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc694f1640 1 -- 172.21.15.1:0/879597245 shutdown_connections 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.212+0000 7fbc694f1640 1 -- 172.21.15.1:0/879597245 wait complete. 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.213+0000 7fbc694f1640 1 Processor -- start 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.213+0000 7fbc694f1640 1 -- start start 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.213+0000 7fbc694f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc64107bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.213+0000 7fbc694f1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6410bda0 con 0x7fbc64108330 2024-09-19T08:55:07.258 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc64107bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc64107bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36234/0 (socket says 172.21.15.1:36234) 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc62ffd640 1 -- 172.21.15.1:0/2552220982 learned_addr learned my addr 172.21.15.1:0/2552220982 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc62ffd640 1 -- 172.21.15.1:0/2552220982 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc641080f0 con 0x7fbc64108330 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc62ffd640 1 --2- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc64107bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc54032670 tx=0x7fbc540326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc4bfff640 1 -- 172.21.15.1:0/2552220982 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc54042070 con 0x7fbc64108330 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc4bfff640 1 -- 172.21.15.1:0/2552220982 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc5403d930 con 0x7fbc64108330 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc641062e0 con 0x7fbc64108330 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc4bfff640 1 -- 172.21.15.1:0/2552220982 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc54037040 con 0x7fbc64108330 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.214+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc64106820 con 0x7fbc64108330 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.215+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc64108790 con 0x7fbc64108330 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.215+0000 7fbc4bfff640 1 -- 172.21.15.1:0/2552220982 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fbc54045070 con 0x7fbc64108330 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.216+0000 7fbc4bfff640 1 --2- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fbc4c0392c0 0x7fbc4c03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:07.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.216+0000 7fbc4bfff640 1 -- 172.21.15.1:0/2552220982 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbc5406c4e0 con 0x7fbc64108330 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.216+0000 7fbc627fc640 1 -- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fbc4c0392c0 msgr2=0x7fbc4c03b780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2001580204 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.216+0000 7fbc627fc640 1 --2- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fbc4c0392c0 0x7fbc4c03b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.220+0000 7fbc4bfff640 1 -- 172.21.15.1:0/2552220982 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc5404b170 con 0x7fbc64108330 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.417+0000 7fbc627fc640 1 -- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fbc4c0392c0 msgr2=0x7fbc4c03b780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2001580204 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.417+0000 7fbc627fc640 1 --2- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fbc4c0392c0 0x7fbc4c03b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.447+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fbc64106aa0 con 0x7fbc64108330 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.448+0000 7fbc4bfff640 1 -- 172.21.15.1:0/2552220982 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fbc54045760 con 0x7fbc64108330 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fbc4c0392c0 msgr2=0x7fbc4c03b780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 --2- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fbc4c0392c0 0x7fbc4c03b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 msgr2=0x7fbc64107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:07.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 --2- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc64107bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc54032670 tx=0x7fbc540326a0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 shutdown_connections 2024-09-19T08:55:07.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 --2- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7fbc4c0392c0 0x7fbc4c03b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 --2- 172.21.15.1:0/2552220982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc64108330 0x7fbc64107bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:07.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 >> 172.21.15.1:0/2552220982 conn(0x7fbc64101f50 msgr2=0x7fbc64102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:07.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 shutdown_connections 2024-09-19T08:55:07.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:06.450+0000 7fbc694f1640 1 -- 172.21.15.1:0/2552220982 wait complete. 2024-09-19T08:55:07.261 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-19T08:55:07.261 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 9... 2024-09-19T08:55:08.154 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:07.881+0000 7f9c006d8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:55:08.154 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.004+0000 7f9c006d8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:55:08.446 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.154+0000 7f9c006d8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:55:08.446 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.218+0000 7f9c006d8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:55:08.446 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.374+0000 7f9c006d8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:55:08.446 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.446+0000 7f9c006d8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:55:08.742 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.509+0000 7f9c006d8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:55:08.742 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.674+0000 7f9c006d8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:55:08.742 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.742+0000 7f9c006d8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:55:09.023 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.812+0000 7f9c006d8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:55:09.023 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.899+0000 7f9c006d8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:55:09.024 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:08.961+0000 7f9c006d8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:55:09.024 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:09.023+0000 7f9c006d8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:55:10.109 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:09.855+0000 7f9c006d8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:55:10.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: Active manager daemon x restarted 2024-09-19T08:55:10.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: Activating manager daemon x 2024-09-19T08:55:10.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T08:55:10.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: mgrmap e10: x(active, starting, since 0.00338498s) 2024-09-19T08:55:10.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:55:10.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:55:10.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:55:10.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:55:10.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:55:10.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: Manager daemon x is now available 2024-09-19T08:55:10.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:10.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:55:10.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.620+0000 7f9748363640 1 Processor -- start 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.620+0000 7f9748363640 1 -- start start 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.620+0000 7f9748363640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f9740106bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.620+0000 7f9748363640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9740107190 con 0x7f97401067c0 2024-09-19T08:55:11.438 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.620+0000 7f97460ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f9740106bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.620+0000 7f97460ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f9740106bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36240/0 (socket says 172.21.15.1:36240) 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.620+0000 7f97460ff640 1 -- 172.21.15.1:0/1712772299 learned_addr learned my addr 172.21.15.1:0/1712772299 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.621+0000 7f97460ff640 1 -- 172.21.15.1:0/1712772299 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97401079c0 con 0x7f97401067c0 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.621+0000 7f97460ff640 1 --2- 172.21.15.1:0/1712772299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f9740106bc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f973c009820 tx=0x7f973c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f784cb5100710871 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f97450fd640 1 -- 172.21.15.1:0/1712772299 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c037070 con 0x7f97401067c0 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f97450fd640 1 -- 172.21.15.1:0/1712772299 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f973c032940 con 0x7f97401067c0 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f97450fd640 1 -- 172.21.15.1:0/1712772299 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c0308b0 con 0x7f97401067c0 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f9748363640 1 -- 172.21.15.1:0/1712772299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 msgr2=0x7f9740106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f9748363640 1 --2- 172.21.15.1:0/1712772299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f9740106bc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f973c009820 tx=0x7f973c02a270 comp rx=0 tx=0).stop 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f9748363640 1 -- 172.21.15.1:0/1712772299 shutdown_connections 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f9748363640 1 --2- 172.21.15.1:0/1712772299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f9740106bc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f9748363640 1 -- 172.21.15.1:0/1712772299 >> 172.21.15.1:0/1712772299 conn(0x7f9740101f50 msgr2=0x7f9740104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:11.439 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f9748363640 1 -- 172.21.15.1:0/1712772299 shutdown_connections 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.622+0000 7f9748363640 1 -- 172.21.15.1:0/1712772299 wait complete. 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.623+0000 7f9748363640 1 Processor -- start 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.623+0000 7f9748363640 1 -- start start 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.623+0000 7f9748363640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f974019b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.623+0000 7f9748363640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f974010ad70 con 0x7f97401067c0 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.623+0000 7f97460ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f974019b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.623+0000 7f97460ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f974019b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36250/0 (socket says 172.21.15.1:36250) 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.623+0000 7f97460ff640 1 -- 172.21.15.1:0/117244409 learned_addr learned my addr 172.21.15.1:0/117244409 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.623+0000 7f97460ff640 1 -- 172.21.15.1:0/117244409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974019bea0 con 0x7f97401067c0 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.624+0000 7f97460ff640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f974019b960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f973c0097f0 tx=0x7f973c032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.624+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c037040 con 0x7f97401067c0 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.624+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f973c040070 con 0x7f97401067c0 2024-09-19T08:55:11.440 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.624+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974019c130 con 0x7f97401067c0 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.624+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c03a520 con 0x7f97401067c0 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.624+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974019ee20 con 0x7f97401067c0 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.625+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f973c03a820 con 0x7f97401067c0 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.625+0000 7f97377fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 0x7f972c03b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.625+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 --> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f972c03be40 con 0x7f972c039270 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.625+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f973c06cc00 con 0x7f97401067c0 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.625+0000 7f97458fe640 1 -- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 msgr2=0x7f972c03b730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2001580204 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.625+0000 7f97458fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 0x7f972c03b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.826+0000 7f97458fe640 1 -- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 msgr2=0x7f972c03b730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2001580204 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:07.826+0000 7f97458fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 0x7f972c03b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:08.227+0000 7f97458fe640 1 -- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 msgr2=0x7f972c03b730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2001580204 2024-09-19T08:55:11.441 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:08.227+0000 7f97458fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 0x7f972c03b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:09.028+0000 7f97458fe640 1 -- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 msgr2=0x7f972c03b730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2001580204 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:09.028+0000 7f97458fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 0x7f972c03b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:09.858+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f973c06b6f0 con 0x7f97401067c0 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:09.858+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 msgr2=0x7f972c03b730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:09.858+0000 7f97377fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 0x7f972c03b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.859+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f973c045460 con 0x7f97401067c0 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.860+0000 7f97377fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f972c03cd30 0x7f972c03f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.860+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f973c03de70 con 0x7f972c03cd30 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.861+0000 7f97458fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f972c03cd30 0x7f972c03f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.861+0000 7f97458fe640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f972c03cd30 0x7f972c03f120 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9730003980 tx=0x7f9730006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.862+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f973c03de70 con 0x7f972c03cd30 2024-09-19T08:55:11.442 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.868+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9740106c40 con 0x7f972c03cd30 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f97377fe640 1 -- 172.21.15.1:0/117244409 <== mgr.14150 v2:172.21.15.1:6800/554641341 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f9740106c40 con 0x7f972c03cd30 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f972c03cd30 msgr2=0x7f972c03f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f972c03cd30 0x7f972c03f120 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9730003980 tx=0x7f9730006e10 comp rx=0 tx=0).stop 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 msgr2=0x7f974019b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f974019b960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f973c0097f0 tx=0x7f973c032e60 comp rx=0 tx=0).stop 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 shutdown_connections 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f972c03cd30 0x7f972c03f120 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:6800/2001580204,v1:172.21.15.1:6801/2001580204] conn(0x7f972c039270 0x7f972c03b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 --2- 172.21.15.1:0/117244409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f97401067c0 0x7f974019b960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 >> 172.21.15.1:0/117244409 conn(0x7f9740101f50 msgr2=0x7f9740102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 shutdown_connections 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:10.869+0000 7f9748363640 1 -- 172.21.15.1:0/117244409 wait complete. 2024-09-19T08:55:11.443 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 9 is available 2024-09-19T08:55:11.444 INFO:teuthology.orchestra.run.smithi001.stdout:Generating a dashboard self-signed certificate... 2024-09-19T08:55:12.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:11 smithi001 ceph-mon[30939]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:55:12.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:11 smithi001 ceph-mon[30939]: mgrmap e11: x(active, since 1.00595s) 2024-09-19T08:55:12.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:11 smithi001 ceph-mon[30939]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:55:12.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:12.451+0000 7f9b66021640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:55:12] ENGINE Error in HTTPServer.serve 2024-09-19T08:55:12.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: Traceback (most recent call last): 2024-09-19T08:55:12.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:55:12.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: self._connections.run(self.expiration_interval) 2024-09-19T08:55:12.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:55:12.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: self._run(expiration_interval) 2024-09-19T08:55:12.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:55:12.798 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: s = self.context.wrap_socket( 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: return self.sslsocket_class._create( 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: self.do_handshake() 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: self._sslobj.do_handshake() 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:55:12.799 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.829+0000 7fe8133a6640 1 Processor -- start 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.829+0000 7fe8133a6640 1 -- start start 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.829+0000 7fe8133a6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c106580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.829+0000 7fe8133a6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c0634b0 con 0x7fe80c106180 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.829+0000 7fe811142640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c106580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.829+0000 7fe811142640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c106580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36342/0 (socket says 172.21.15.1:36342) 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.829+0000 7fe811142640 1 -- 172.21.15.1:0/714955403 learned_addr learned my addr 172.21.15.1:0/714955403 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.830+0000 7fe811142640 1 -- 172.21.15.1:0/714955403 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c106ac0 con 0x7fe80c106180 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.830+0000 7fe811142640 1 --2- 172.21.15.1:0/714955403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c106580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe808009820 tx=0x7fe80802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b7db4e085f8a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.830+0000 7fe803fff640 1 -- 172.21.15.1:0/714955403 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808037070 con 0x7fe80c106180 2024-09-19T08:55:12.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.830+0000 7fe803fff640 1 -- 172.21.15.1:0/714955403 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe808032940 con 0x7fe80c106180 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.830+0000 7fe803fff640 1 -- 172.21.15.1:0/714955403 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8080308b0 con 0x7fe80c106180 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.831+0000 7fe8133a6640 1 -- 172.21.15.1:0/714955403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 msgr2=0x7fe80c106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.831+0000 7fe8133a6640 1 --2- 172.21.15.1:0/714955403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c106580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe808009820 tx=0x7fe80802a270 comp rx=0 tx=0).stop 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.831+0000 7fe8133a6640 1 -- 172.21.15.1:0/714955403 shutdown_connections 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.831+0000 7fe8133a6640 1 --2- 172.21.15.1:0/714955403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c106580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.831+0000 7fe8133a6640 1 -- 172.21.15.1:0/714955403 >> 172.21.15.1:0/714955403 conn(0x7fe80c101f50 msgr2=0x7fe80c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.831+0000 7fe8133a6640 1 -- 172.21.15.1:0/714955403 shutdown_connections 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.831+0000 7fe8133a6640 1 -- 172.21.15.1:0/714955403 wait complete. 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.832+0000 7fe8133a6640 1 Processor -- start 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.832+0000 7fe8133a6640 1 -- start start 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.832+0000 7fe8133a6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c19daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.832+0000 7fe8133a6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c107c60 con 0x7fe80c106180 2024-09-19T08:55:12.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.832+0000 7fe811142640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c19daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.832+0000 7fe811142640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c19daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36344/0 (socket says 172.21.15.1:36344) 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.832+0000 7fe811142640 1 -- 172.21.15.1:0/2576644221 learned_addr learned my addr 172.21.15.1:0/2576644221 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.833+0000 7fe811142640 1 -- 172.21.15.1:0/2576644221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c19dfe0 con 0x7fe80c106180 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.833+0000 7fe811142640 1 --2- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c19daa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe808032670 tx=0x7fe8080326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.833+0000 7fe8027fc640 1 -- 172.21.15.1:0/2576644221 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808042070 con 0x7fe80c106180 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.833+0000 7fe8027fc640 1 -- 172.21.15.1:0/2576644221 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe80803d930 con 0x7fe80c106180 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.833+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80c19e270 con 0x7fe80c106180 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.833+0000 7fe8027fc640 1 -- 172.21.15.1:0/2576644221 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808037040 con 0x7fe80c106180 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.833+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80c1a0f60 con 0x7fe80c106180 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.834+0000 7fe8027fc640 1 -- 172.21.15.1:0/2576644221 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fe808045070 con 0x7fe80c106180 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.834+0000 7fe8027fc640 1 --2- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7f8039200 0x7fe7f803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.834+0000 7fe8027fc640 1 -- 172.21.15.1:0/2576644221 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe80806c8f0 con 0x7fe80c106180 2024-09-19T08:55:12.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.834+0000 7fe810941640 1 --2- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7f8039200 0x7fe7f803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.834+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe80c106580 con 0x7fe80c106180 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.835+0000 7fe810941640 1 --2- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7f8039200 0x7fe7f803b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0098c0 tx=0x7fe7fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.839+0000 7fe8027fc640 1 -- 172.21.15.1:0/2576644221 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe808045bf0 con 0x7fe80c106180 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:11.865+0000 7fe8027fc640 1 -- 172.21.15.1:0/2576644221 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fe808046730 con 0x7fe80c106180 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.025+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fe80c02d930 con 0x7fe7f8039200 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.105+0000 7fe8027fc640 1 -- 172.21.15.1:0/2576644221 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fe80c02d930 con 0x7fe7f8039200 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7f8039200 msgr2=0x7fe7f803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 --2- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7f8039200 0x7fe7f803b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0098c0 tx=0x7fe7fc006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 msgr2=0x7fe80c19daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 --2- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c19daa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe808032670 tx=0x7fe8080326a0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 shutdown_connections 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 --2- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7f8039200 0x7fe7f803b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 --2- 172.21.15.1:0/2576644221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe80c106180 0x7fe80c19daa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:12.815 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 >> 172.21.15.1:0/2576644221 conn(0x7fe80c101f50 msgr2=0x7fe80c194780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:12.815 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 shutdown_connections 2024-09-19T08:55:12.815 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:12.108+0000 7fe8133a6640 1 -- 172.21.15.1:0/2576644221 wait complete. 2024-09-19T08:55:12.815 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial admin user... 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-mon[30939]: mgrmap e12: x(active, since 2s) 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-mon[30939]: [19/Sep/2024:08:55:12] ENGINE Bus STARTING 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-mon[30939]: [19/Sep/2024:08:55:12] ENGINE Serving on http://172.21.15.1:8765 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-mon[30939]: [19/Sep/2024:08:55:12] ENGINE Serving on https://172.21.15.1:7150 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-mon[30939]: [19/Sep/2024:08:55:12] ENGINE Bus STARTED 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:12 smithi001 ceph-mon[30939]: [19/Sep/2024:08:55:12] ENGINE Error in HTTPServer.serve 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:55:13.157 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-19T08:55:13.158 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$rsCLeMP2G8lyYUFkG6nk1.fKO4zQ6B0XUoooDmYnwOWK9SUyKHWYC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726736113, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.244+0000 7f3c6f195640 1 Processor -- start 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.244+0000 7f3c6f195640 1 -- start start 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.245+0000 7f3c6f195640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c681065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.245+0000 7f3c6f195640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c68063470 con 0x7f3c681061c0 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.245+0000 7f3c6cf31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c681065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.245+0000 7f3c6cf31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c681065c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41944/0 (socket says 172.21.15.1:41944) 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.245+0000 7f3c6cf31640 1 -- 172.21.15.1:0/648174302 learned_addr learned my addr 172.21.15.1:0/648174302 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.245+0000 7f3c6cf31640 1 -- 172.21.15.1:0/648174302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c68106b00 con 0x7f3c681061c0 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.246+0000 7f3c6cf31640 1 --2- 172.21.15.1:0/648174302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c681065c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009820 tx=0x7f3c5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8adef8a63e4d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.246+0000 7f3c677fe640 1 -- 172.21.15.1:0/648174302 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c5c037070 con 0x7f3c681061c0 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.246+0000 7f3c677fe640 1 -- 172.21.15.1:0/648174302 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c5c032940 con 0x7f3c681061c0 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.246+0000 7f3c677fe640 1 -- 172.21.15.1:0/648174302 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c5c0308b0 con 0x7f3c681061c0 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 -- 172.21.15.1:0/648174302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 msgr2=0x7f3c681065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 --2- 172.21.15.1:0/648174302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c681065c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009820 tx=0x7f3c5c02a270 comp rx=0 tx=0).stop 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 -- 172.21.15.1:0/648174302 shutdown_connections 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 --2- 172.21.15.1:0/648174302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c681065c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 -- 172.21.15.1:0/648174302 >> 172.21.15.1:0/648174302 conn(0x7f3c68101f50 msgr2=0x7f3c68104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 -- 172.21.15.1:0/648174302 shutdown_connections 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 -- 172.21.15.1:0/648174302 wait complete. 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 Processor -- start 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.247+0000 7f3c6f195640 1 -- start start 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c6f195640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c6819dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c6f195640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c68107ca0 con 0x7f3c681061c0 2024-09-19T08:55:14.319 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c6cf31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c6819dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c6cf31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c6819dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41946/0 (socket says 172.21.15.1:41946) 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c6cf31640 1 -- 172.21.15.1:0/3699633855 learned_addr learned my addr 172.21.15.1:0/3699633855 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c6cf31640 1 -- 172.21.15.1:0/3699633855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6819e000 con 0x7f3c681061c0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c6cf31640 1 --2- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c6819dac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c032670 tx=0x7f3c5c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c65ffb640 1 -- 172.21.15.1:0/3699633855 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c5c042070 con 0x7f3c681061c0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c65ffb640 1 -- 172.21.15.1:0/3699633855 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c5c03d930 con 0x7f3c681061c0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6819e290 con 0x7f3c681061c0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.248+0000 7f3c65ffb640 1 -- 172.21.15.1:0/3699633855 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c5c037040 con 0x7f3c681061c0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.249+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c681a0f80 con 0x7f3c681061c0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.249+0000 7f3c65ffb640 1 -- 172.21.15.1:0/3699633855 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f3c5c045070 con 0x7f3c681061c0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.250+0000 7f3c65ffb640 1 --2- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c58039320 0x7f3c5803b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.250+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c681065c0 con 0x7f3c681061c0 2024-09-19T08:55:14.320 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.250+0000 7f3c65ffb640 1 -- 172.21.15.1:0/3699633855 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3c5c06c570 con 0x7f3c681061c0 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.250+0000 7f3c67fff640 1 --2- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c58039320 0x7f3c5803b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.250+0000 7f3c67fff640 1 --2- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c58039320 0x7f3c5803b7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c540098c0 tx=0x7f3c54006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.254+0000 7f3c65ffb640 1 -- 172.21.15.1:0/3699633855 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3c5c03c8d0 con 0x7f3c681061c0 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.449+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f3c68197590 con 0x7f3c58039320 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.698+0000 7f3c65ffb640 1 -- 172.21.15.1:0/3699633855 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f3c68197590 con 0x7f3c58039320 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c58039320 msgr2=0x7f3c5803b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 --2- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c58039320 0x7f3c5803b7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c540098c0 tx=0x7f3c54006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 msgr2=0x7f3c6819dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 --2- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c6819dac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c032670 tx=0x7f3c5c0326a0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 shutdown_connections 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 --2- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c58039320 0x7f3c5803b7e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 --2- 172.21.15.1:0/3699633855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c681061c0 0x7f3c6819dac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 >> 172.21.15.1:0/3699633855 conn(0x7f3c68101f50 msgr2=0x7f3c68194760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.321 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 shutdown_connections 2024-09-19T08:55:14.322 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:13.701+0000 7f3c6f195640 1 -- 172.21.15.1:0/3699633855 wait complete. 2024-09-19T08:55:14.322 INFO:teuthology.orchestra.run.smithi001.stdout:Fetching dashboard port number... 2024-09-19T08:55:14.561 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:14.561 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:14 smithi001 ceph-mon[30939]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:14.561 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:14.561 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:15.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.739+0000 7f33e9520640 1 Processor -- start 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.739+0000 7f33e9520640 1 -- start start 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.739+0000 7f33e9520640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e4106c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.739+0000 7f33e9520640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f33e41071e0 con 0x7f33e4106810 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.740+0000 7f33e2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e4106c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.740+0000 7f33e2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e4106c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41948/0 (socket says 172.21.15.1:41948) 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.740+0000 7f33e2ffd640 1 -- 172.21.15.1:0/3082003422 learned_addr learned my addr 172.21.15.1:0/3082003422 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.740+0000 7f33e2ffd640 1 -- 172.21.15.1:0/3082003422 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e4107a10 con 0x7f33e4106810 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e2ffd640 1 --2- 172.21.15.1:0/3082003422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e4106c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009820 tx=0x7f33d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cadca8fb9098a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e1ffb640 1 -- 172.21.15.1:0/3082003422 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33d4037070 con 0x7f33e4106810 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e1ffb640 1 -- 172.21.15.1:0/3082003422 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33d4032940 con 0x7f33e4106810 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e1ffb640 1 -- 172.21.15.1:0/3082003422 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33d40308b0 con 0x7f33e4106810 2024-09-19T08:55:15.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e9520640 1 -- 172.21.15.1:0/3082003422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 msgr2=0x7f33e4106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e9520640 1 --2- 172.21.15.1:0/3082003422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e4106c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009820 tx=0x7f33d402a270 comp rx=0 tx=0).stop 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e9520640 1 -- 172.21.15.1:0/3082003422 shutdown_connections 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e9520640 1 --2- 172.21.15.1:0/3082003422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e4106c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.741+0000 7f33e9520640 1 -- 172.21.15.1:0/3082003422 >> 172.21.15.1:0/3082003422 conn(0x7f33e4102060 msgr2=0x7f33e4104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.742+0000 7f33e9520640 1 -- 172.21.15.1:0/3082003422 shutdown_connections 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.742+0000 7f33e9520640 1 -- 172.21.15.1:0/3082003422 wait complete. 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.742+0000 7f33e9520640 1 Processor -- start 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.742+0000 7f33e9520640 1 -- start start 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.742+0000 7f33e9520640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.742+0000 7f33e9520640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f33e410adc0 con 0x7f33e4106810 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33e2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33e2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41956/0 (socket says 172.21.15.1:41956) 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33e2ffd640 1 -- 172.21.15.1:0/2090258263 learned_addr learned my addr 172.21.15.1:0/2090258263 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33e2ffd640 1 -- 172.21.15.1:0/2090258263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e419be10 con 0x7f33e4106810 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33e2ffd640 1 --2- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e419b8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009940 tx=0x7f33d4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33cbfff640 1 -- 172.21.15.1:0/2090258263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33d4042070 con 0x7f33e4106810 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e419c0a0 con 0x7f33e4106810 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33cbfff640 1 -- 172.21.15.1:0/2090258263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33d403d930 con 0x7f33e4106810 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33cbfff640 1 -- 172.21.15.1:0/2090258263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33d4037040 con 0x7f33e4106810 2024-09-19T08:55:15.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.743+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e419ed90 con 0x7f33e4106810 2024-09-19T08:55:15.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.744+0000 7f33cbfff640 1 -- 172.21.15.1:0/2090258263 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f33d4045070 con 0x7f33e4106810 2024-09-19T08:55:15.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.744+0000 7f33cbfff640 1 --2- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33cc0392c0 0x7f33cc03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:15.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.744+0000 7f33cbfff640 1 -- 172.21.15.1:0/2090258263 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f33d406c540 con 0x7f33e4106810 2024-09-19T08:55:15.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.744+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e4106c90 con 0x7f33e4106810 2024-09-19T08:55:15.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.745+0000 7f33e27fc640 1 --2- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33cc0392c0 0x7f33cc03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:15.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.745+0000 7f33e27fc640 1 --2- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33cc0392c0 0x7f33cc03b780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f33d80098c0 tx=0x7f33d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:15.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.749+0000 7f33cbfff640 1 -- 172.21.15.1:0/2090258263 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33d404b170 con 0x7f33e4106810 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.930+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f33e402d8e0 con 0x7f33e4106810 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.930+0000 7f33cbfff640 1 -- 172.21.15.1:0/2090258263 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f33d402fd90 con 0x7f33e4106810 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33cc0392c0 msgr2=0x7f33cc03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 --2- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33cc0392c0 0x7f33cc03b780 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f33d80098c0 tx=0x7f33d8006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 msgr2=0x7f33e419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 --2- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e419b8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009940 tx=0x7f33d4032670 comp rx=0 tx=0).stop 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 shutdown_connections 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 --2- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33cc0392c0 0x7f33cc03b780 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 --2- 172.21.15.1:0/2090258263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33e4106810 0x7f33e419b8d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 >> 172.21.15.1:0/2090258263 conn(0x7f33e4102060 msgr2=0x7f33e4102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:15.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 shutdown_connections 2024-09-19T08:55:15.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:14.933+0000 7f33e9520640 1 -- 172.21.15.1:0/2090258263 wait complete. 2024-09-19T08:55:15.592 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:55:15.593 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T08:55:15.600 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:55:15.600 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T08:55:15.600 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T08:55:15.600 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T08:55:15.602 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph Dashboard is now available at: 2024-09-19T08:55:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: URL: https://smithi001.front.sepia.ceph.com:8443/ 2024-09-19T08:55:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: User: admin 2024-09-19T08:55:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: Password: od94badc7v 2024-09-19T08:55:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:15.603 INFO:teuthology.orchestra.run.smithi001.stdout:Saving cluster configuration to /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config directory 2024-09-19T08:55:15.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:15 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2090258263' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T08:55:17.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:17 smithi001 ceph-mon[30939]: mgrmap e13: x(active, since 6s) 2024-09-19T08:55:17.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:17 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1970990745' entity='client.admin' 2024-09-19T08:55:17.771 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.894+0000 7f1107efa640 1 Processor -- start 2024-09-19T08:55:17.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.894+0000 7f1107efa640 1 -- start start 2024-09-19T08:55:17.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.894+0000 7f1107efa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110010a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.894+0000 7f1107efa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1100063510 con 0x7f1100108380 2024-09-19T08:55:17.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.894+0000 7f1105c96640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110010a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.894+0000 7f1105c96640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110010a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41958/0 (socket says 172.21.15.1:41958) 2024-09-19T08:55:17.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.894+0000 7f1105c96640 1 -- 172.21.15.1:0/3104581875 learned_addr learned my addr 172.21.15.1:0/3104581875 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:17.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.895+0000 7f1105c96640 1 -- 172.21.15.1:0/3104581875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110010acb0 con 0x7f1100108380 2024-09-19T08:55:17.772 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.895+0000 7f1105c96640 1 --2- 172.21.15.1:0/3104581875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110010a770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009820 tx=0x7f10fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e0248a1d7de459 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1104c94640 1 -- 172.21.15.1:0/3104581875 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc037070 con 0x7f1100108380 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1104c94640 1 -- 172.21.15.1:0/3104581875 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10fc032940 con 0x7f1100108380 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1104c94640 1 -- 172.21.15.1:0/3104581875 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc0308b0 con 0x7f1100108380 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1107efa640 1 -- 172.21.15.1:0/3104581875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 msgr2=0x7f110010a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1107efa640 1 --2- 172.21.15.1:0/3104581875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110010a770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009820 tx=0x7f10fc02a270 comp rx=0 tx=0).stop 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1107efa640 1 -- 172.21.15.1:0/3104581875 shutdown_connections 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1107efa640 1 --2- 172.21.15.1:0/3104581875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110010a770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1107efa640 1 -- 172.21.15.1:0/3104581875 >> 172.21.15.1:0/3104581875 conn(0x7f1100102060 msgr2=0x7f1100104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1107efa640 1 -- 172.21.15.1:0/3104581875 shutdown_connections 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.896+0000 7f1107efa640 1 -- 172.21.15.1:0/3104581875 wait complete. 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.897+0000 7f1107efa640 1 Processor -- start 2024-09-19T08:55:17.773 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.897+0000 7f1107efa640 1 -- start start 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.897+0000 7f1107efa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.897+0000 7f1107efa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f110010bdf0 con 0x7f1100108380 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.897+0000 7f1105c96640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.897+0000 7f1105c96640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41964/0 (socket says 172.21.15.1:41964) 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.897+0000 7f1105c96640 1 -- 172.21.15.1:0/1970990745 learned_addr learned my addr 172.21.15.1:0/1970990745 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.898+0000 7f1105c96640 1 -- 172.21.15.1:0/1970990745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110019be10 con 0x7f1100108380 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.898+0000 7f1105c96640 1 --2- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110019b8d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10fc032670 tx=0x7f10fc0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.898+0000 7f10f6ffd640 1 -- 172.21.15.1:0/1970990745 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc042070 con 0x7f1100108380 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.898+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f110019c0a0 con 0x7f1100108380 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.898+0000 7f10f6ffd640 1 -- 172.21.15.1:0/1970990745 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10fc03d930 con 0x7f1100108380 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.898+0000 7f10f6ffd640 1 -- 172.21.15.1:0/1970990745 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc037040 con 0x7f1100108380 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.898+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f110019ed90 con 0x7f1100108380 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.899+0000 7f10f6ffd640 1 -- 172.21.15.1:0/1970990745 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f10fc045070 con 0x7f1100108380 2024-09-19T08:55:17.774 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.899+0000 7f10f6ffd640 1 --2- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f10ec039360 0x7f10ec03b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.899+0000 7f10f6ffd640 1 -- 172.21.15.1:0/1970990745 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f10fc06c7a0 con 0x7f1100108380 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.899+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11001087e0 con 0x7f1100108380 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.899+0000 7f1105495640 1 --2- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f10ec039360 0x7f10ec03b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.900+0000 7f1105495640 1 --2- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f10ec039360 0x7f10ec03b820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10f00098c0 tx=0x7f10f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:16.904+0000 7f10f6ffd640 1 -- 172.21.15.1:0/1970990745 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10fc045760 con 0x7f1100108380 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.178+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f110019ef60 con 0x7f1100108380 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.181+0000 7f10f6ffd640 1 -- 172.21.15.1:0/1970990745 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f10fc0463b0 con 0x7f1100108380 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f10ec039360 msgr2=0x7f10ec03b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 --2- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f10ec039360 0x7f10ec03b820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10f00098c0 tx=0x7f10f0006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 msgr2=0x7f110019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 --2- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110019b8d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10fc032670 tx=0x7f10fc0326a0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 shutdown_connections 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 --2- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f10ec039360 0x7f10ec03b820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.775 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 --2- 172.21.15.1:0/1970990745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1100108380 0x7f110019b8d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 >> 172.21.15.1:0/1970990745 conn(0x7f1100102060 msgr2=0x7f1100102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 shutdown_connections 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T08:55:17.184+0000 7f1107efa640 1 -- 172.21.15.1:0/1970990745 wait complete. 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: ceph telemetry on 2024-09-19T08:55:17.776 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:17.777 INFO:teuthology.orchestra.run.smithi001.stdout:For more information see: 2024-09-19T08:55:17.777 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:17.777 INFO:teuthology.orchestra.run.smithi001.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T08:55:17.777 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:17.777 INFO:teuthology.orchestra.run.smithi001.stdout:Bootstrap complete. 2024-09-19T08:55:17.809 INFO:tasks.cephadm:Fetching config... 2024-09-19T08:55:17.810 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:55:17.810 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T08:55:17.826 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T08:55:17.826 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:55:17.826 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T08:55:17.881 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T08:55:17.881 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:55:17.881 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T08:55:17.947 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T08:55:17.947 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:55:17.947 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T08:55:18.003 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T08:55:18.004 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCd87DB4rjKtcloyFax9LH7/z6Vk1XfQndeG7/iTYpC8gdSFDs2sdnLaCWqn378RNIEhdvj9wMYsn5FoHj+ZmbFvkjicTYaxMAEhYld95K2T9O3kPhgx1G5TPg6ls9QlTGVF4/KFnGry9CUL/97CRMYtkEMsCZqtZi0slLqc6ghP81J8bCrROzDbgRfU0mnI6aQRdlyw3VIf7iThSZFJcyp7hRMxKuGU7lsHeqJGQXjZx0pJswqz0yOnXG1UV7vAp34/lS1WbwUWUTpjFLS/IUhMS48Io69bRWn71g3p2wmsdu2UJozsn+NF9eKaO2FQ8GxbaZvxm1qu3hf+rLz1i3wViB7eVioU/EPodhD6CxN1Yn2IybG/8vLlqTfie+X+Dv6ELsG65dtxrj4WxXQsp0FjjsevL29QgZlRIWADlJFJbGY6Fgn8j4iXTrXUTcecLxS1p3OGreo+i4UJ56qrIbDur+4UXJyu5FSXDaoyD39oPqyWsV/kQPDE65j874PlOU= ceph-98b2a8e0-7664-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:55:18.080 INFO:teuthology.orchestra.run.smithi001.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCd87DB4rjKtcloyFax9LH7/z6Vk1XfQndeG7/iTYpC8gdSFDs2sdnLaCWqn378RNIEhdvj9wMYsn5FoHj+ZmbFvkjicTYaxMAEhYld95K2T9O3kPhgx1G5TPg6ls9QlTGVF4/KFnGry9CUL/97CRMYtkEMsCZqtZi0slLqc6ghP81J8bCrROzDbgRfU0mnI6aQRdlyw3VIf7iThSZFJcyp7hRMxKuGU7lsHeqJGQXjZx0pJswqz0yOnXG1UV7vAp34/lS1WbwUWUTpjFLS/IUhMS48Io69bRWn71g3p2wmsdu2UJozsn+NF9eKaO2FQ8GxbaZvxm1qu3hf+rLz1i3wViB7eVioU/EPodhD6CxN1Yn2IybG/8vLlqTfie+X+Dv6ELsG65dtxrj4WxXQsp0FjjsevL29QgZlRIWADlJFJbGY6Fgn8j4iXTrXUTcecLxS1p3OGreo+i4UJ56qrIbDur+4UXJyu5FSXDaoyD39oPqyWsV/kQPDE65j874PlOU= ceph-98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:18.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCd87DB4rjKtcloyFax9LH7/z6Vk1XfQndeG7/iTYpC8gdSFDs2sdnLaCWqn378RNIEhdvj9wMYsn5FoHj+ZmbFvkjicTYaxMAEhYld95K2T9O3kPhgx1G5TPg6ls9QlTGVF4/KFnGry9CUL/97CRMYtkEMsCZqtZi0slLqc6ghP81J8bCrROzDbgRfU0mnI6aQRdlyw3VIf7iThSZFJcyp7hRMxKuGU7lsHeqJGQXjZx0pJswqz0yOnXG1UV7vAp34/lS1WbwUWUTpjFLS/IUhMS48Io69bRWn71g3p2wmsdu2UJozsn+NF9eKaO2FQ8GxbaZvxm1qu3hf+rLz1i3wViB7eVioU/EPodhD6CxN1Yn2IybG/8vLlqTfie+X+Dv6ELsG65dtxrj4WxXQsp0FjjsevL29QgZlRIWADlJFJbGY6Fgn8j4iXTrXUTcecLxS1p3OGreo+i4UJ56qrIbDur+4UXJyu5FSXDaoyD39oPqyWsV/kQPDE65j874PlOU= ceph-98b2a8e0-7664-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:55:18.148 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCd87DB4rjKtcloyFax9LH7/z6Vk1XfQndeG7/iTYpC8gdSFDs2sdnLaCWqn378RNIEhdvj9wMYsn5FoHj+ZmbFvkjicTYaxMAEhYld95K2T9O3kPhgx1G5TPg6ls9QlTGVF4/KFnGry9CUL/97CRMYtkEMsCZqtZi0slLqc6ghP81J8bCrROzDbgRfU0mnI6aQRdlyw3VIf7iThSZFJcyp7hRMxKuGU7lsHeqJGQXjZx0pJswqz0yOnXG1UV7vAp34/lS1WbwUWUTpjFLS/IUhMS48Io69bRWn71g3p2wmsdu2UJozsn+NF9eKaO2FQ8GxbaZvxm1qu3hf+rLz1i3wViB7eVioU/EPodhD6CxN1Yn2IybG/8vLlqTfie+X+Dv6ELsG65dtxrj4WxXQsp0FjjsevL29QgZlRIWADlJFJbGY6Fgn8j4iXTrXUTcecLxS1p3OGreo+i4UJ56qrIbDur+4UXJyu5FSXDaoyD39oPqyWsV/kQPDE65j874PlOU= ceph-98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:18.160 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCd87DB4rjKtcloyFax9LH7/z6Vk1XfQndeG7/iTYpC8gdSFDs2sdnLaCWqn378RNIEhdvj9wMYsn5FoHj+ZmbFvkjicTYaxMAEhYld95K2T9O3kPhgx1G5TPg6ls9QlTGVF4/KFnGry9CUL/97CRMYtkEMsCZqtZi0slLqc6ghP81J8bCrROzDbgRfU0mnI6aQRdlyw3VIf7iThSZFJcyp7hRMxKuGU7lsHeqJGQXjZx0pJswqz0yOnXG1UV7vAp34/lS1WbwUWUTpjFLS/IUhMS48Io69bRWn71g3p2wmsdu2UJozsn+NF9eKaO2FQ8GxbaZvxm1qu3hf+rLz1i3wViB7eVioU/EPodhD6CxN1Yn2IybG/8vLlqTfie+X+Dv6ELsG65dtxrj4WxXQsp0FjjsevL29QgZlRIWADlJFJbGY6Fgn8j4iXTrXUTcecLxS1p3OGreo+i4UJ56qrIbDur+4UXJyu5FSXDaoyD39oPqyWsV/kQPDE65j874PlOU= ceph-98b2a8e0-7664-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:55:18.201 INFO:teuthology.orchestra.run.smithi064.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCd87DB4rjKtcloyFax9LH7/z6Vk1XfQndeG7/iTYpC8gdSFDs2sdnLaCWqn378RNIEhdvj9wMYsn5FoHj+ZmbFvkjicTYaxMAEhYld95K2T9O3kPhgx1G5TPg6ls9QlTGVF4/KFnGry9CUL/97CRMYtkEMsCZqtZi0slLqc6ghP81J8bCrROzDbgRfU0mnI6aQRdlyw3VIf7iThSZFJcyp7hRMxKuGU7lsHeqJGQXjZx0pJswqz0yOnXG1UV7vAp34/lS1WbwUWUTpjFLS/IUhMS48Io69bRWn71g3p2wmsdu2UJozsn+NF9eKaO2FQ8GxbaZvxm1qu3hf+rLz1i3wViB7eVioU/EPodhD6CxN1Yn2IybG/8vLlqTfie+X+Dv6ELsG65dtxrj4WxXQsp0FjjsevL29QgZlRIWADlJFJbGY6Fgn8j4iXTrXUTcecLxS1p3OGreo+i4UJ56qrIbDur+4UXJyu5FSXDaoyD39oPqyWsV/kQPDE65j874PlOU= ceph-98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:18.214 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T08:55:18.473 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:19.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.992+0000 7f0148e1c640 1 -- 172.21.15.1:0/2996716405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 msgr2=0x7f0144101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.992+0000 7f0148e1c640 1 --2- 172.21.15.1:0/2996716405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 0x7f0144101a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0134009880 tx=0x7f013402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.992+0000 7f0148e1c640 1 -- 172.21.15.1:0/2996716405 shutdown_connections 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.992+0000 7f0148e1c640 1 --2- 172.21.15.1:0/2996716405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 0x7f0144101a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.992+0000 7f0148e1c640 1 -- 172.21.15.1:0/2996716405 >> 172.21.15.1:0/2996716405 conn(0x7f01440fcdb0 msgr2=0x7f01440ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.992+0000 7f0148e1c640 1 -- 172.21.15.1:0/2996716405 shutdown_connections 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.992+0000 7f0148e1c640 1 -- 172.21.15.1:0/2996716405 wait complete. 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f0148e1c640 1 Processor -- start 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f0148e1c640 1 -- start start 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f0148e1c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 0x7f0144199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f0148e1c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0144107850 con 0x7f0144101600 2024-09-19T08:55:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f014259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 0x7f0144199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f014259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 0x7f0144199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41980/0 (socket says 172.21.15.1:41980) 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f014259c640 1 -- 172.21.15.1:0/2514947006 learned_addr learned my addr 172.21.15.1:0/2514947006 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f014259c640 1 -- 172.21.15.1:0/2514947006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01441995d0 con 0x7f0144101600 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.993+0000 7f014259c640 1 --2- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 0x7f0144199090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0134009230 tx=0x7f0134032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.994+0000 7f013bfff640 1 -- 172.21.15.1:0/2514947006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013403f030 con 0x7f0144101600 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.994+0000 7f013bfff640 1 -- 172.21.15.1:0/2514947006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0134003e30 con 0x7f0144101600 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.994+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0144199860 con 0x7f0144101600 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.994+0000 7f013bfff640 1 -- 172.21.15.1:0/2514947006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0134035070 con 0x7f0144101600 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.994+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014419c550 con 0x7f0144101600 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.995+0000 7f013bfff640 1 -- 172.21.15.1:0/2514947006 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0134042030 con 0x7f0144101600 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.995+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0144107fd0 con 0x7f0144101600 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.995+0000 7f013bfff640 1 --2- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01300392a0 0x7f013003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.995+0000 7f013bfff640 1 -- 172.21.15.1:0/2514947006 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0134040070 con 0x7f0144101600 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.995+0000 7f0139d9b640 1 --2- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01300392a0 0x7f013003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:18.995+0000 7f0139d9b640 1 --2- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01300392a0 0x7f013003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f012c0098c0 tx=0x7f012c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.000+0000 7f013bfff640 1 -- 172.21.15.1:0/2514947006 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f013404c350 con 0x7f0144101600 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.176+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f014402d830 con 0x7f0144101600 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.178+0000 7f013bfff640 1 -- 172.21.15.1:0/2514947006 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f0134030df0 con 0x7f0144101600 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01300392a0 msgr2=0x7f013003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 --2- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01300392a0 0x7f013003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f012c0098c0 tx=0x7f012c006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 msgr2=0x7f0144199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 --2- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 0x7f0144199090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0134009230 tx=0x7f0134032d00 comp rx=0 tx=0).stop 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 shutdown_connections 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 --2- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01300392a0 0x7f013003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 --2- 172.21.15.1:0/2514947006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0144101600 0x7f0144199090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 >> 172.21.15.1:0/2514947006 conn(0x7f01440fcdb0 msgr2=0x7f01440ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:19.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 shutdown_connections 2024-09-19T08:55:19.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:19.180+0000 7f0148e1c640 1 -- 172.21.15.1:0/2514947006 wait complete. 2024-09-19T08:55:19.730 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T08:55:19.731 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T08:55:20.229 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:20.472 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:20 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2514947006' entity='client.admin' 2024-09-19T08:55:20.472 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:20 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:20.472 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:20 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:20.472 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:20 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi001", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:20.472 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:20 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:21.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.139+0000 7fba12042640 1 -- 172.21.15.1:0/822575974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 msgr2=0x7fba0c1044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.139+0000 7fba12042640 1 --2- 172.21.15.1:0/822575974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 0x7fba0c1044c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009880 tx=0x7fb9fc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.140+0000 7fba12042640 1 -- 172.21.15.1:0/822575974 shutdown_connections 2024-09-19T08:55:21.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.140+0000 7fba12042640 1 --2- 172.21.15.1:0/822575974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 0x7fba0c1044c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.140+0000 7fba12042640 1 -- 172.21.15.1:0/822575974 >> 172.21.15.1:0/822575974 conn(0x7fba0c0fbcd0 msgr2=0x7fba0c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:21.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.140+0000 7fba12042640 1 -- 172.21.15.1:0/822575974 shutdown_connections 2024-09-19T08:55:21.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.140+0000 7fba12042640 1 -- 172.21.15.1:0/822575974 wait complete. 2024-09-19T08:55:21.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.140+0000 7fba12042640 1 Processor -- start 2024-09-19T08:55:21.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.140+0000 7fba12042640 1 -- start start 2024-09-19T08:55:21.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.141+0000 7fba12042640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 0x7fba0c196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.141+0000 7fba12042640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c1077b0 con 0x7fba0c1020d0 2024-09-19T08:55:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.141+0000 7fba0b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 0x7fba0c196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.141+0000 7fba0b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 0x7fba0c196dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41998/0 (socket says 172.21.15.1:41998) 2024-09-19T08:55:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.141+0000 7fba0b7fe640 1 -- 172.21.15.1:0/2499821006 learned_addr learned my addr 172.21.15.1:0/2499821006 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.141+0000 7fba0b7fe640 1 -- 172.21.15.1:0/2499821006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c197310 con 0x7fba0c1020d0 2024-09-19T08:55:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.141+0000 7fba0b7fe640 1 --2- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 0x7fba0c196dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009230 tx=0x7fb9fc032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.142+0000 7fba097fa640 1 -- 172.21.15.1:0/2499821006 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9fc03f030 con 0x7fba0c1020d0 2024-09-19T08:55:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.142+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c1975a0 con 0x7fba0c1020d0 2024-09-19T08:55:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.142+0000 7fba097fa640 1 -- 172.21.15.1:0/2499821006 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9fc003e30 con 0x7fba0c1020d0 2024-09-19T08:55:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.142+0000 7fba097fa640 1 -- 172.21.15.1:0/2499821006 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9fc035070 con 0x7fba0c1020d0 2024-09-19T08:55:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.142+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0c19a290 con 0x7fba0c1020d0 2024-09-19T08:55:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.143+0000 7fba097fa640 1 -- 172.21.15.1:0/2499821006 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fb9fc042030 con 0x7fba0c1020d0 2024-09-19T08:55:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.143+0000 7fba097fa640 1 --2- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9f80392a0 0x7fb9f803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.143+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba0c107f30 con 0x7fba0c1020d0 2024-09-19T08:55:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.143+0000 7fba097fa640 1 -- 172.21.15.1:0/2499821006 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb9fc040070 con 0x7fba0c1020d0 2024-09-19T08:55:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.143+0000 7fba02ffd640 1 --2- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9f80392a0 0x7fb9f803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.143+0000 7fba02ffd640 1 --2- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9f80392a0 0x7fb9f803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40098c0 tx=0x7fb9f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.148+0000 7fba097fa640 1 -- 172.21.15.1:0/2499821006 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9fc04c350 con 0x7fba0c1020d0 2024-09-19T08:55:21.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.331+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fba0c02d830 con 0x7fb9f80392a0 2024-09-19T08:55:21.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.334+0000 7fba097fa640 1 -- 172.21.15.1:0/2499821006 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fba0c02d830 con 0x7fb9f80392a0 2024-09-19T08:55:21.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9f80392a0 msgr2=0x7fb9f803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 --2- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9f80392a0 0x7fb9f803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40098c0 tx=0x7fb9f4006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 msgr2=0x7fba0c196dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:21.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 --2- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 0x7fba0c196dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009230 tx=0x7fb9fc032d00 comp rx=0 tx=0).stop 2024-09-19T08:55:21.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 shutdown_connections 2024-09-19T08:55:21.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 --2- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9f80392a0 0x7fb9f803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 --2- 172.21.15.1:0/2499821006 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba0c1020d0 0x7fba0c196dd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:21.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 >> 172.21.15.1:0/2499821006 conn(0x7fba0c0fbcd0 msgr2=0x7fba0c0fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:21.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 shutdown_connections 2024-09-19T08:55:21.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:21.337+0000 7fba12042640 1 -- 172.21.15.1:0/2499821006 wait complete. 2024-09-19T08:55:21.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:21 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:21.467 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:21 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: Updating smithi001:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: Updating smithi001:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:22.704 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:22.705 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:22.705 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:22.732 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi022 2024-09-19T08:55:22.732 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:55:22.732 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:55:22.751 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:55:22.751 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:22.811 INFO:tasks.cephadm:Adding host smithi022 to orchestrator... 2024-09-19T08:55:22.811 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch host add smithi022 2024-09-19T08:55:23.063 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:23.466 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:23 smithi001 ceph-mon[30939]: Updating smithi001:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.466+0000 7f8fd0248640 1 -- 172.21.15.1:0/366516045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 msgr2=0x7f8fc8100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.466+0000 7f8fd0248640 1 --2- 172.21.15.1:0/366516045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 0x7f8fc8100250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009c20 tx=0x7f8fc402bba0 comp rx=0 tx=0).stop 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.467+0000 7f8fd0248640 1 -- 172.21.15.1:0/366516045 shutdown_connections 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.467+0000 7f8fd0248640 1 --2- 172.21.15.1:0/366516045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 0x7f8fc8100250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.467+0000 7f8fd0248640 1 -- 172.21.15.1:0/366516045 >> 172.21.15.1:0/366516045 conn(0x7f8fc80fb930 msgr2=0x7f8fc80fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.467+0000 7f8fd0248640 1 -- 172.21.15.1:0/366516045 shutdown_connections 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.467+0000 7f8fd0248640 1 -- 172.21.15.1:0/366516045 wait complete. 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.467+0000 7f8fd0248640 1 Processor -- start 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.467+0000 7f8fd0248640 1 -- start start 2024-09-19T08:55:23.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fd0248640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 0x7f8fc8197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fd0248640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc8109b70 con 0x7f8fc80ffe70 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fcdfe4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 0x7f8fc8197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fcdfe4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 0x7f8fc8197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33994/0 (socket says 172.21.15.1:33994) 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fcdfe4640 1 -- 172.21.15.1:0/3732847059 learned_addr learned my addr 172.21.15.1:0/3732847059 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fcdfe4640 1 -- 172.21.15.1:0/3732847059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc8197790 con 0x7f8fc80ffe70 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fcdfe4640 1 --2- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 0x7f8fc8197250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4006010 tx=0x7f8fc402d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fbeffd640 1 -- 172.21.15.1:0/3732847059 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc402e580 con 0x7f8fc80ffe70 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc8197a20 con 0x7f8fc80ffe70 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fbeffd640 1 -- 172.21.15.1:0/3732847059 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fc4004040 con 0x7f8fc80ffe70 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fbeffd640 1 -- 172.21.15.1:0/3732847059 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc403f460 con 0x7f8fc80ffe70 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.468+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc819bb20 con 0x7f8fc80ffe70 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.469+0000 7f8fbeffd640 1 -- 172.21.15.1:0/3732847059 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f8fc4046020 con 0x7f8fc80ffe70 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.469+0000 7f8fbeffd640 1 --2- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fb4039280 0x7f8fb403b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:23.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.469+0000 7f8fbeffd640 1 -- 172.21.15.1:0/3732847059 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8fc4044020 con 0x7f8fc80ffe70 2024-09-19T08:55:23.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.469+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc8101350 con 0x7f8fc80ffe70 2024-09-19T08:55:23.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.470+0000 7f8fcd7e3640 1 --2- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fb4039280 0x7f8fb403b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:23.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.470+0000 7f8fcd7e3640 1 --2- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fb4039280 0x7f8fb403b740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80098c0 tx=0x7f8fb8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:23.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.474+0000 7f8fbeffd640 1 -- 172.21.15.1:0/3732847059 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8fc4033030 con 0x7f8fc80ffe70 2024-09-19T08:55:23.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:23.656+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi022", "target": ["mon-mgr", ""]}) -- 0x7f8fc81002d0 con 0x7f8fb4039280 2024-09-19T08:55:24.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:24 smithi001 ceph-mon[30939]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:25.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:25 smithi001 ceph-mon[30939]: Deploying cephadm binary to smithi022 2024-09-19T08:55:27.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.517+0000 7f8fbeffd640 1 -- 172.21.15.1:0/3732847059 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8fc81002d0 con 0x7f8fb4039280 2024-09-19T08:55:27.517 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi022' with addr '172.21.15.22' 2024-09-19T08:55:27.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fb4039280 msgr2=0x7f8fb403b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 --2- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fb4039280 0x7f8fb403b740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80098c0 tx=0x7f8fb8006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 msgr2=0x7f8fc8197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 --2- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 0x7f8fc8197250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4006010 tx=0x7f8fc402d8b0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 shutdown_connections 2024-09-19T08:55:27.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 --2- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fb4039280 0x7f8fb403b740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 --2- 172.21.15.1:0/3732847059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fc80ffe70 0x7f8fc8197250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 >> 172.21.15.1:0/3732847059 conn(0x7f8fc80fb930 msgr2=0x7f8fc818f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:27.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 shutdown_connections 2024-09-19T08:55:27.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:27.520+0000 7f8fd0248640 1 -- 172.21.15.1:0/3732847059 wait complete. 2024-09-19T08:55:28.199 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:55:28.451 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:28 smithi001 ceph-mon[30939]: Added host smithi022 2024-09-19T08:55:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:28.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.906+0000 7f11ddca0640 1 -- 172.21.15.1:0/1514416729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 msgr2=0x7f11d8102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.906+0000 7f11ddca0640 1 --2- 172.21.15.1:0/1514416729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 0x7f11d8102b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009880 tx=0x7f11c802a670 comp rx=0 tx=0).stop 2024-09-19T08:55:28.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.906+0000 7f11ddca0640 1 -- 172.21.15.1:0/1514416729 shutdown_connections 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.906+0000 7f11ddca0640 1 --2- 172.21.15.1:0/1514416729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 0x7f11d8102b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.906+0000 7f11ddca0640 1 -- 172.21.15.1:0/1514416729 >> 172.21.15.1:0/1514416729 conn(0x7f11d80fc1b0 msgr2=0x7f11d80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.906+0000 7f11ddca0640 1 -- 172.21.15.1:0/1514416729 shutdown_connections 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.906+0000 7f11ddca0640 1 -- 172.21.15.1:0/1514416729 wait complete. 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.907+0000 7f11ddca0640 1 Processor -- start 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.907+0000 7f11ddca0640 1 -- start start 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.907+0000 7f11ddca0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 0x7f11d81972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.907+0000 7f11ddca0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11d810be00 con 0x7f11d8102750 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.907+0000 7f11d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 0x7f11d81972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.907+0000 7f11d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 0x7f11d81972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34020/0 (socket says 172.21.15.1:34020) 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.907+0000 7f11d77fe640 1 -- 172.21.15.1:0/4074936334 learned_addr learned my addr 172.21.15.1:0/4074936334 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:28.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.908+0000 7f11d77fe640 1 -- 172.21.15.1:0/4074936334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d8197820 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.908+0000 7f11d77fe640 1 --2- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 0x7f11d81972e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11c8006010 tx=0x7f11c8003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.908+0000 7f11d4ff9640 1 -- 172.21.15.1:0/4074936334 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11c803f070 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.908+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d8197ab0 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.908+0000 7f11d4ff9640 1 -- 172.21.15.1:0/4074936334 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11c8031c20 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.908+0000 7f11d4ff9640 1 -- 172.21.15.1:0/4074936334 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11c8035030 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.908+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d8197f10 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.909+0000 7f11d4ff9640 1 -- 172.21.15.1:0/4074936334 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f11c8042070 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.909+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d806a7b0 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.909+0000 7f11d4ff9640 1 --2- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f11c00392a0 0x7f11c003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.909+0000 7f11d4ff9640 1 -- 172.21.15.1:0/4074936334 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f11c806d130 con 0x7f11d8102750 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.909+0000 7f11d6ffd640 1 --2- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f11c00392a0 0x7f11c003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.910+0000 7f11d6ffd640 1 --2- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f11c00392a0 0x7f11c003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0098c0 tx=0x7f11cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:28.915+0000 7f11d4ff9640 1 -- 172.21.15.1:0/4074936334 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11c804c350 con 0x7f11d8102750 2024-09-19T08:55:29.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.095+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11d8198640 con 0x7f11c00392a0 2024-09-19T08:55:29.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.096+0000 7f11d4ff9640 1 -- 172.21.15.1:0/4074936334 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f11d8198640 con 0x7f11c00392a0 2024-09-19T08:55:29.096 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:29.096 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}] 2024-09-19T08:55:29.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f11c00392a0 msgr2=0x7f11c003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 --2- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f11c00392a0 0x7f11c003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0098c0 tx=0x7f11cc006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 msgr2=0x7f11d81972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:29.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 --2- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 0x7f11d81972e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11c8006010 tx=0x7f11c8003c00 comp rx=0 tx=0).stop 2024-09-19T08:55:29.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 shutdown_connections 2024-09-19T08:55:29.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 --2- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f11c00392a0 0x7f11c003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 --2- 172.21.15.1:0/4074936334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d8102750 0x7f11d81972e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:29.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 >> 172.21.15.1:0/4074936334 conn(0x7f11d80fc1b0 msgr2=0x7f11d81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:29.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 shutdown_connections 2024-09-19T08:55:29.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:29.099+0000 7f11ddca0640 1 -- 172.21.15.1:0/4074936334 wait complete. 2024-09-19T08:55:29.934 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi064 2024-09-19T08:55:29.934 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:55:29.934 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:55:29.953 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:55:29.953 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:30.012 INFO:tasks.cephadm:Adding host smithi064 to orchestrator... 2024-09-19T08:55:30.012 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch host add smithi064 2024-09-19T08:55:30.268 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:30.297 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:29 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:30.297 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:29 smithi001 ceph-mon[30939]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 -- 172.21.15.1:0/3185481748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 msgr2=0x7ff6c41006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 --2- 172.21.15.1:0/3185481748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 0x7ff6c41006c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009880 tx=0x7ff6c002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 -- 172.21.15.1:0/3185481748 shutdown_connections 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 --2- 172.21.15.1:0/3185481748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 0x7ff6c41006c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 -- 172.21.15.1:0/3185481748 >> 172.21.15.1:0/3185481748 conn(0x7ff6c40fc1b0 msgr2=0x7ff6c40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 -- 172.21.15.1:0/3185481748 shutdown_connections 2024-09-19T08:55:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 -- 172.21.15.1:0/3185481748 wait complete. 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 Processor -- start 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.697+0000 7ff6cb889640 1 -- start start 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6cb889640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 0x7ff6c4199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6cb889640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c410dff0 con 0x7ff6c41002e0 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6c9625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 0x7ff6c4199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6c9625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 0x7ff6c4199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34050/0 (socket says 172.21.15.1:34050) 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6c9625640 1 -- 172.21.15.1:0/2646299214 learned_addr learned my addr 172.21.15.1:0/2646299214 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6c9625640 1 -- 172.21.15.1:0/2646299214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c41999c0 con 0x7ff6c41002e0 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6c9625640 1 --2- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 0x7ff6c4199480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009230 tx=0x7ff6c0003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6ba7fc640 1 -- 172.21.15.1:0/2646299214 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c003f070 con 0x7ff6c41002e0 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6ba7fc640 1 -- 172.21.15.1:0/2646299214 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6c0031d50 con 0x7ff6c41002e0 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c4199c50 con 0x7ff6c41002e0 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6ba7fc640 1 -- 172.21.15.1:0/2646299214 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c0035030 con 0x7ff6c41002e0 2024-09-19T08:55:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.698+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c419a0b0 con 0x7ff6c41002e0 2024-09-19T08:55:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.699+0000 7ff6ba7fc640 1 -- 172.21.15.1:0/2646299214 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff6c0042070 con 0x7ff6c41002e0 2024-09-19T08:55:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.699+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c406a7b0 con 0x7ff6c41002e0 2024-09-19T08:55:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.700+0000 7ff6ba7fc640 1 --2- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff6b00392a0 0x7ff6b003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.700+0000 7ff6ba7fc640 1 -- 172.21.15.1:0/2646299214 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff6c006d190 con 0x7ff6c41002e0 2024-09-19T08:55:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.700+0000 7ff6c8e24640 1 --2- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff6b00392a0 0x7ff6b003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.700+0000 7ff6c8e24640 1 --2- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff6b00392a0 0x7ff6b003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40098c0 tx=0x7ff6b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:30.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.704+0000 7ff6ba7fc640 1 -- 172.21.15.1:0/2646299214 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff6c0036260 con 0x7ff6c41002e0 2024-09-19T08:55:30.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:30.886+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi064", "target": ["mon-mgr", ""]}) -- 0x7ff6c419a7e0 con 0x7ff6b00392a0 2024-09-19T08:55:31.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:30 smithi001 ceph-mon[30939]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi064", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:33.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-19T08:55:33.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:33.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:33.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:34.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:33 smithi001 ceph-mon[30939]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:33 smithi001 ceph-mon[30939]: Updating smithi022:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:33 smithi001 ceph-mon[30939]: Deploying cephadm binary to smithi064 2024-09-19T08:55:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:33 smithi001 ceph-mon[30939]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:33 smithi001 ceph-mon[30939]: Updating smithi022:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:55:34.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.764+0000 7ff6ba7fc640 1 -- 172.21.15.1:0/2646299214 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7ff6c419a7e0 con 0x7ff6b00392a0 2024-09-19T08:55:34.764 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi064' with addr '172.21.15.64' 2024-09-19T08:55:34.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff6b00392a0 msgr2=0x7ff6b003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:34.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 --2- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff6b00392a0 0x7ff6b003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40098c0 tx=0x7ff6b4006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 msgr2=0x7ff6c4199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:34.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 --2- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 0x7ff6c4199480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009230 tx=0x7ff6c0003cb0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 shutdown_connections 2024-09-19T08:55:34.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 --2- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff6b00392a0 0x7ff6b003b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 --2- 172.21.15.1:0/2646299214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6c41002e0 0x7ff6c4199480 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:34.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 >> 172.21.15.1:0/2646299214 conn(0x7ff6c40fc1b0 msgr2=0x7ff6c40fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:34.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 shutdown_connections 2024-09-19T08:55:34.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:34.766+0000 7ff6cb889640 1 -- 172.21.15.1:0/2646299214 wait complete. 2024-09-19T08:55:35.371 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:55:35.622 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:36.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:35 smithi001 ceph-mon[30939]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:36.037 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:36.037 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:35 smithi001 ceph-mon[30939]: Added host smithi064 2024-09-19T08:55:36.037 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:36.037 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:36.037 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:36.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.086+0000 7f0c26248640 1 -- 172.21.15.1:0/594289421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 msgr2=0x7f0c20107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:36.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.086+0000 7f0c26248640 1 --2- 172.21.15.1:0/594289421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 0x7f0c20107a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009880 tx=0x7f0c1002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:36.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.086+0000 7f0c26248640 1 -- 172.21.15.1:0/594289421 shutdown_connections 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.086+0000 7f0c26248640 1 --2- 172.21.15.1:0/594289421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 0x7f0c20107a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.086+0000 7f0c26248640 1 -- 172.21.15.1:0/594289421 >> 172.21.15.1:0/594289421 conn(0x7f0c200fd260 msgr2=0x7f0c200ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.086+0000 7f0c26248640 1 -- 172.21.15.1:0/594289421 shutdown_connections 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.086+0000 7f0c26248640 1 -- 172.21.15.1:0/594289421 wait complete. 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.087+0000 7f0c26248640 1 Processor -- start 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.087+0000 7f0c26248640 1 -- start start 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.087+0000 7f0c26248640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 0x7f0c20197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.087+0000 7f0c26248640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2010bdc0 con 0x7f0c20107650 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.087+0000 7f0c1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 0x7f0c20197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.087+0000 7f0c1f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 0x7f0c20197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33816/0 (socket says 172.21.15.1:33816) 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.087+0000 7f0c1f7fe640 1 -- 172.21.15.1:0/1403977867 learned_addr learned my addr 172.21.15.1:0/1403977867 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.087+0000 7f0c1f7fe640 1 -- 172.21.15.1:0/1403977867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c201977c0 con 0x7f0c20107650 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.088+0000 7f0c1f7fe640 1 --2- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 0x7f0c20197280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0c10006010 tx=0x7f0c10003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:36.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.088+0000 7f0c1cff9640 1 -- 172.21.15.1:0/1403977867 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1003f070 con 0x7f0c20107650 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.088+0000 7f0c1cff9640 1 -- 172.21.15.1:0/1403977867 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c10031c20 con 0x7f0c20107650 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.088+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c20197a50 con 0x7f0c20107650 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.088+0000 7f0c1cff9640 1 -- 172.21.15.1:0/1403977867 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c10035030 con 0x7f0c20107650 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.088+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c20197eb0 con 0x7f0c20107650 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.089+0000 7f0c1cff9640 1 -- 172.21.15.1:0/1403977867 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0c10042070 con 0x7f0c20107650 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.089+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c20102cc0 con 0x7f0c20107650 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.089+0000 7f0c1cff9640 1 --2- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0c080392a0 0x7f0c0803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.089+0000 7f0c1cff9640 1 -- 172.21.15.1:0/1403977867 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0c1006d130 con 0x7f0c20107650 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.089+0000 7f0c1effd640 1 --2- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0c080392a0 0x7f0c0803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.089+0000 7f0c1effd640 1 --2- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0c080392a0 0x7f0c0803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c140098c0 tx=0x7f0c14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:36.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.094+0000 7f0c1cff9640 1 -- 172.21.15.1:0/1403977867 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c1004c350 con 0x7f0c20107650 2024-09-19T08:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.276+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c20198650 con 0x7f0c080392a0 2024-09-19T08:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.277+0000 7f0c1cff9640 1 -- 172.21.15.1:0/1403977867 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+237 (secure 0 0 0) 0x7f0c20198650 con 0x7f0c080392a0 2024-09-19T08:55:36.277 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:55:36.277 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.64", "hostname": "smithi064", "labels": [], "status": ""}] 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0c080392a0 msgr2=0x7f0c0803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 --2- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0c080392a0 0x7f0c0803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c140098c0 tx=0x7f0c14006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 msgr2=0x7f0c20197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 --2- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 0x7f0c20197280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0c10006010 tx=0x7f0c10003c00 comp rx=0 tx=0).stop 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 shutdown_connections 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 --2- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0c080392a0 0x7f0c0803b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 --2- 172.21.15.1:0/1403977867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20107650 0x7f0c20197280 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 >> 172.21.15.1:0/1403977867 conn(0x7f0c200fd260 msgr2=0x7f0c200feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 shutdown_connections 2024-09-19T08:55:36.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:36.279+0000 7f0c26248640 1 -- 172.21.15.1:0/1403977867 wait complete. 2024-09-19T08:55:36.816 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T08:55:36.817 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T08:55:37.065 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:37.441 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:37 smithi001 ceph-mon[30939]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:37.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:37.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:37 smithi001 ceph-mon[30939]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.524+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/2144882349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 msgr2=0x7f0ab4106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.524+0000 7f0ab8e5e640 1 --2- 172.21.15.1:0/2144882349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 0x7f0ab4106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009880 tx=0x7f0aa402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.524+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/2144882349 shutdown_connections 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.524+0000 7f0ab8e5e640 1 --2- 172.21.15.1:0/2144882349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 0x7f0ab4106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.524+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/2144882349 >> 172.21.15.1:0/2144882349 conn(0x7f0ab40fc1b0 msgr2=0x7f0ab40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.524+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/2144882349 shutdown_connections 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.524+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/2144882349 wait complete. 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.525+0000 7f0ab8e5e640 1 Processor -- start 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.525+0000 7f0ab8e5e640 1 -- start start 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.525+0000 7f0ab8e5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 0x7f0ab4195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.525+0000 7f0ab8e5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab410acd0 con 0x7f0ab4106560 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.525+0000 7f0ab259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 0x7f0ab4195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.525+0000 7f0ab259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 0x7f0ab4195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33828/0 (socket says 172.21.15.1:33828) 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.525+0000 7f0ab259c640 1 -- 172.21.15.1:0/1831702130 learned_addr learned my addr 172.21.15.1:0/1831702130 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.526+0000 7f0ab259c640 1 -- 172.21.15.1:0/1831702130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab406acd0 con 0x7f0ab4106560 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.526+0000 7f0ab259c640 1 --2- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 0x7f0ab4195e00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006010 tx=0x7f0aa4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.526+0000 7f0aa37fe640 1 -- 172.21.15.1:0/1831702130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aa403f070 con 0x7f0ab4106560 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.526+0000 7f0aa37fe640 1 -- 172.21.15.1:0/1831702130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0aa4031c20 con 0x7f0ab4106560 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.526+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab4196340 con 0x7f0ab4106560 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.526+0000 7f0aa37fe640 1 -- 172.21.15.1:0/1831702130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aa4035030 con 0x7f0ab4106560 2024-09-19T08:55:37.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.526+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab41967a0 con 0x7f0ab4106560 2024-09-19T08:55:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.527+0000 7f0aa37fe640 1 -- 172.21.15.1:0/1831702130 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0aa4042070 con 0x7f0ab4106560 2024-09-19T08:55:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.527+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab4101bd0 con 0x7f0ab4106560 2024-09-19T08:55:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.527+0000 7f0aa37fe640 1 --2- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a9c039350 0x7f0a9c03b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.527+0000 7f0aa37fe640 1 -- 172.21.15.1:0/1831702130 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0aa406d0f0 con 0x7f0ab4106560 2024-09-19T08:55:37.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.527+0000 7f0ab1d9b640 1 --2- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a9c039350 0x7f0a9c03b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:37.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.528+0000 7f0ab1d9b640 1 --2- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a9c039350 0x7f0a9c03b810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80098c0 tx=0x7f0aa8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:37.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.532+0000 7f0aa37fe640 1 -- 172.21.15.1:0/1831702130 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0aa403b5f0 con 0x7f0ab4106560 2024-09-19T08:55:37.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:37.713+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0ab406a4c0 con 0x7f0ab4106560 2024-09-19T08:55:38.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.119+0000 7f0aa37fe640 1 -- 172.21.15.1:0/1831702130 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f0aa403ac60 con 0x7f0ab4106560 2024-09-19T08:55:38.118 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-09-19T08:55:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a9c039350 msgr2=0x7f0a9c03b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 --2- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a9c039350 0x7f0a9c03b810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80098c0 tx=0x7f0aa8006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 msgr2=0x7f0ab4195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 --2- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 0x7f0ab4195e00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4006010 tx=0x7f0aa4003c00 comp rx=0 tx=0).stop 2024-09-19T08:55:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 shutdown_connections 2024-09-19T08:55:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 --2- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a9c039350 0x7f0a9c03b810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 --2- 172.21.15.1:0/1831702130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ab4106560 0x7f0ab4195e00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 >> 172.21.15.1:0/1831702130 conn(0x7f0ab40fc1b0 msgr2=0x7f0ab40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 shutdown_connections 2024-09-19T08:55:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:55:38.121+0000 7f0ab8e5e640 1 -- 172.21.15.1:0/1831702130 wait complete. 2024-09-19T08:55:38.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:38 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1831702130' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:55:38.798 INFO:tasks.cephadm:Adding mon.a on smithi001 2024-09-19T08:55:38.798 INFO:tasks.cephadm:Adding mon.b on smithi022 2024-09-19T08:55:38.798 INFO:tasks.cephadm:Adding mon.c on smithi064 2024-09-19T08:55:38.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c' 2024-09-19T08:55:39.219 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:55:39.288 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:55:39.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:39 smithi001 ceph-mon[30939]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:39.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:39 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1831702130' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:55:39.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:39 smithi001 ceph-mon[30939]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.795+0000 7f66fa231640 1 -- 172.21.15.64:0/3174783786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 msgr2=0x7f66f4100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.795+0000 7f66fa231640 1 --2- 172.21.15.64:0/3174783786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 0x7f66f4100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009880 tx=0x7f66e402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.795+0000 7f66fa231640 1 -- 172.21.15.64:0/3174783786 shutdown_connections 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.795+0000 7f66fa231640 1 --2- 172.21.15.64:0/3174783786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 0x7f66f4100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.795+0000 7f66fa231640 1 -- 172.21.15.64:0/3174783786 >> 172.21.15.64:0/3174783786 conn(0x7f66f40fbcd0 msgr2=0x7f66f40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.795+0000 7f66fa231640 1 -- 172.21.15.64:0/3174783786 shutdown_connections 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.795+0000 7f66fa231640 1 -- 172.21.15.64:0/3174783786 wait complete. 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.796+0000 7f66fa231640 1 Processor -- start 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.796+0000 7f66fa231640 1 -- start start 2024-09-19T08:55:39.827 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.796+0000 7f66fa231640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 0x7f66f4196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.796+0000 7f66fa231640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f66f4106740 con 0x7f66f4100540 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.796+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 0x7f66f4196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 0x7f66f4196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.64:44824/0 (socket says 172.21.15.64:44824) 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66f37fe640 1 -- 172.21.15.64:0/2546953374 learned_addr learned my addr 172.21.15.64:0/2546953374 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66f37fe640 1 -- 172.21.15.64:0/2546953374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f41973c0 con 0x7f66f4100540 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66f37fe640 1 --2- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 0x7f66f4196e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009230 tx=0x7f66e4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66f0ff9640 1 -- 172.21.15.64:0/2546953374 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e403f030 con 0x7f66f4100540 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66f0ff9640 1 -- 172.21.15.64:0/2546953374 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f66e4003e30 con 0x7f66f4100540 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f4197650 con 0x7f66f4100540 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66f0ff9640 1 -- 172.21.15.64:0/2546953374 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4035070 con 0x7f66f4100540 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.797+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f419a340 con 0x7f66f4100540 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.798+0000 7f66f0ff9640 1 -- 172.21.15.64:0/2546953374 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f66e4042030 con 0x7f66f4100540 2024-09-19T08:55:39.828 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.798+0000 7f66f0ff9640 1 --2- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66dc039300 0x7f66dc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.798+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f4106ec0 con 0x7f66f4100540 2024-09-19T08:55:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.798+0000 7f66f0ff9640 1 -- 172.21.15.64:0/2546953374 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f66e4040070 con 0x7f66f4100540 2024-09-19T08:55:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.799+0000 7f66f2ffd640 1 --2- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66dc039300 0x7f66dc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.799+0000 7f66f2ffd640 1 --2- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66dc039300 0x7f66dc03b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f66e80098c0 tx=0x7f66e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:39.829 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.804+0000 7f66f0ff9640 1 -- 172.21.15.64:0/2546953374 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66e4069e50 con 0x7f66f4100540 2024-09-19T08:55:39.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.993+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c", "target": ["mon-mgr", ""]}) -- 0x7f66f40fd430 con 0x7f66dc039300 2024-09-19T08:55:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:39.998+0000 7f66f0ff9640 1 -- 172.21.15.64:0/2546953374 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f66f40fd430 con 0x7f66dc039300 2024-09-19T08:55:39.999 INFO:teuthology.orchestra.run.smithi064.stdout:Scheduled mon update... 2024-09-19T08:55:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66dc039300 msgr2=0x7f66dc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 --2- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66dc039300 0x7f66dc03b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f66e80098c0 tx=0x7f66e8006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 msgr2=0x7f66f4196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 --2- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 0x7f66f4196e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009230 tx=0x7f66e4032d00 comp rx=0 tx=0).stop 2024-09-19T08:55:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 shutdown_connections 2024-09-19T08:55:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 --2- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66dc039300 0x7f66dc03b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 --2- 172.21.15.64:0/2546953374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66f4100540 0x7f66f4196e80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 >> 172.21.15.64:0/2546953374 conn(0x7f66f40fbcd0 msgr2=0x7f66f40fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 shutdown_connections 2024-09-19T08:55:40.002 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:40.000+0000 7f66fa231640 1 -- 172.21.15.64:0/2546953374 wait complete. 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: Updating smithi064:/etc/ceph/ceph.conf 2024-09-19T08:55:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:40.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:40.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:40.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:40.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:40.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:40.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:40.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:40.754 DEBUG:teuthology.orchestra.run.smithi022:mon.b> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T08:55:40.757 DEBUG:teuthology.orchestra.run.smithi064:mon.c> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T08:55:40.763 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:55:40.763 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:41.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:41 smithi001 ceph-mon[30939]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:55:41.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:41 smithi001 ceph-mon[30939]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:41.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:41 smithi001 ceph-mon[30939]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:41.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:41 smithi001 ceph-mon[30939]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c;count:3 2024-09-19T08:55:41.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:41 smithi001 ceph-mon[30939]: Deploying daemon mon.c on smithi064 2024-09-19T08:55:42.680 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:43.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.328+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/1735167141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 msgr2=0x7fe2d0102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:43.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.328+0000 7fe2d5cc8640 1 --2- 172.21.15.64:0/1735167141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 0x7fe2d0102c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009880 tx=0x7fe2c402a670 comp rx=0 tx=0).stop 2024-09-19T08:55:43.381 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.328+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/1735167141 shutdown_connections 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.328+0000 7fe2d5cc8640 1 --2- 172.21.15.64:0/1735167141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 0x7fe2d0102c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.328+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/1735167141 >> 172.21.15.64:0/1735167141 conn(0x7fe2d00fc2c0 msgr2=0x7fe2d00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.328+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/1735167141 shutdown_connections 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.328+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/1735167141 wait complete. 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.329+0000 7fe2d5cc8640 1 Processor -- start 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.329+0000 7fe2d5cc8640 1 -- start start 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.329+0000 7fe2d5cc8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 0x7fe2d01973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.329+0000 7fe2d5cc8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d010bf10 con 0x7fe2d0102860 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.330+0000 7fe2cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 0x7fe2d01973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:43.382 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.330+0000 7fe2cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 0x7fe2d01973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.64:44834/0 (socket says 172.21.15.64:44834) 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.330+0000 7fe2cf7fe640 1 -- 172.21.15.64:0/699824346 learned_addr learned my addr 172.21.15.64:0/699824346 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.330+0000 7fe2cf7fe640 1 -- 172.21.15.64:0/699824346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d01978e0 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.330+0000 7fe2cf7fe640 1 --2- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 0x7fe2d01973a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4006010 tx=0x7fe2c4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.330+0000 7fe2ccff9640 1 -- 172.21.15.64:0/699824346 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c403f070 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.331+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d0197b70 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.331+0000 7fe2ccff9640 1 -- 172.21.15.64:0/699824346 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2c4031c20 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.331+0000 7fe2ccff9640 1 -- 172.21.15.64:0/699824346 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2c4035030 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.331+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d0197fd0 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.331+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d006a4e0 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.332+0000 7fe2ccff9640 1 -- 172.21.15.64:0/699824346 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fe2c4042070 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.332+0000 7fe2ccff9640 1 --2- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2b80392a0 0x7fe2b803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.332+0000 7fe2ccff9640 1 -- 172.21.15.64:0/699824346 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe2c406d200 con 0x7fe2d0102860 2024-09-19T08:55:43.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.332+0000 7fe2ceffd640 1 --2- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2b80392a0 0x7fe2b803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:43.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.333+0000 7fe2ceffd640 1 --2- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2b80392a0 0x7fe2b803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00098c0 tx=0x7fe2c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:43.384 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.337+0000 7fe2ccff9640 1 -- 172.21.15.64:0/699824346 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2c404c350 con 0x7fe2d0102860 2024-09-19T08:55:43.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:43 smithi001 ceph-mon[30939]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:43.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.595+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe2d0198760 con 0x7fe2d0102860 2024-09-19T08:55:43.596 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.596+0000 7fe2ccff9640 1 -- 172.21.15.64:0/699824346 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7fe2c403b5f0 con 0x7fe2d0102860 2024-09-19T08:55:43.597 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:55:43.597 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:54:09.693383Z","created":"2024-09-19T08:54:09.693383Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:55:43.597 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2024-09-19T08:55:43.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.598+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2b80392a0 msgr2=0x7fe2b803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:43.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.598+0000 7fe2d5cc8640 1 --2- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2b80392a0 0x7fe2b803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00098c0 tx=0x7fe2c0006db0 comp rx=0 tx=0).stop 2024-09-19T08:55:43.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.598+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 msgr2=0x7fe2d01973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:43.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.598+0000 7fe2d5cc8640 1 --2- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 0x7fe2d01973a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4006010 tx=0x7fe2c4003c00 comp rx=0 tx=0).stop 2024-09-19T08:55:43.599 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.598+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 shutdown_connections 2024-09-19T08:55:43.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.598+0000 7fe2d5cc8640 1 --2- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2b80392a0 0x7fe2b803b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:43.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.598+0000 7fe2d5cc8640 1 --2- 172.21.15.64:0/699824346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2d0102860 0x7fe2d01973a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:43.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.598+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 >> 172.21.15.64:0/699824346 conn(0x7fe2d00fc2c0 msgr2=0x7fe2d01035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:43.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.599+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 shutdown_connections 2024-09-19T08:55:43.600 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:43.599+0000 7fe2d5cc8640 1 -- 172.21.15.64:0/699824346 wait complete. 2024-09-19T08:55:43.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:43 smithi064 systemd[1]: Starting Ceph mon.c for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T08:55:44.493 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 podman[35159]: 2024-09-19 08:55:44.378150379 +0000 UTC m=+0.112345232 container create 0a168ca63fbcd0d44f01cb6fd93e312540d2d7785335677fdb91cc245d3ea9b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:55:44.493 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 podman[35159]: 2024-09-19 08:55:44.283307591 +0000 UTC m=+0.017502466 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:55:44.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:44 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/699824346' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 podman[35159]: 2024-09-19 08:55:44.588813043 +0000 UTC m=+0.323007897 container init 0a168ca63fbcd0d44f01cb6fd93e312540d2d7785335677fdb91cc245d3ea9b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 podman[35159]: 2024-09-19 08:55:44.591780927 +0000 UTC m=+0.325975780 container start 0a168ca63fbcd0d44f01cb6fd93e312540d2d7785335677fdb91cc245d3ea9b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: pidfile_write: ignore empty --pid-file 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: load: jerasure load: lrc 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Git sha 0 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:55:44.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: DB SUMMARY 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: DB Session ID: PAVTE7BH46WGWB0X6GBU 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:55:44.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:55:44.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.env: 0x55c537777940 2024-09-19T08:55:44.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:55:44.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.info_log: 0x55c538dd96e0 2024-09-19T08:55:44.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:55:44.859 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.statistics: (nil) 2024-09-19T08:55:44.859 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.use_fsync: 0 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:55:44.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.db_log_dir: 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.wal_dir: 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:55:44.861 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.write_buffer_manager: 0x55c538de8dc0 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.unordered_write: 0 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:55:44.862 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.row_cache: None 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.wal_filter: None 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.wal_compression: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:55:44.863 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:55:44.864 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_open_files: -1 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Compression algorithms supported: 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: kZSTD supported: 0 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:55:44.865 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.merge_operator: 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_filter: None 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:55:44.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c538dd9320) 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: index_type: 0 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: data_block_index_type: 0 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: index_shortening: 1 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: checksum: 4 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: no_block_cache: 0 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: block_cache: 0x55c538dcd1f0 2024-09-19T08:55:44.867 INFO:journalctl@ceph.mon.c.smithi064.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: block_cache_options: 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: capacity : 536870912 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: num_shard_bits : 4 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: strict_capacity_limit : 0 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: block_cache_compressed: (nil) 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: persistent_cache: (nil) 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: block_size: 4096 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: block_size_deviation: 10 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: block_restart_interval: 16 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: index_block_restart_interval: 1 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: metadata_block_size: 4096 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: partition_filters: 0 2024-09-19T08:55:44.868 INFO:journalctl@ceph.mon.c.smithi064.stdout: use_delta_encoding: 1 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: filter_policy: bloomfilter 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: whole_key_filtering: 1 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: verify_compression: 0 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: format_version: 5 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: enable_index_compression: 1 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: block_align: 0 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: max_auto_readahead_size: 262144 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: prepopulate_block_cache: 0 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:55:44.869 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression: NoCompression 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.num_levels: 7 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:55:44.870 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:55:44.871 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:55:44.872 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:55:44.873 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:55:44.874 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.ttl: 2592000 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:55:44.875 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:55:44.876 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8729862d-5a78-4c60-938f-47e19c0f6858 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736144618554, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736144618977, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726736144, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8729862d-5a78-4c60-938f-47e19c0f6858", "db_session_id": "PAVTE7BH46WGWB0X6GBU", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736144619071, "job": 1, "event": "recovery_finished"} 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c538dfae00 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: DB pointer 0x55c538ef6000 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:55:44.877 INFO:journalctl@ceph.mon.c.smithi064.stdout: ** DB Stats ** 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: ** Compaction Stats [default] ** 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:55:44.878 INFO:journalctl@ceph.mon.c.smithi064.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: ** Compaction Stats [default] ** 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:55:44.879 INFO:journalctl@ceph.mon.c.smithi064.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: Block cache BinnedLRUCache@0x55c538dcd1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: using public_addr v2:172.21.15.64:0/0 -> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: starting mon.c rank -1 at public addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] at bind addrs [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(???) e0 preinit fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:44.880 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout: e1 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout: btime 2024-09-19T08:54:23:245014+0000 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout: legacy client fscid: -1 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout: 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout: No filesystems configured 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:55:44.881 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1831702130' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1831702130' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.882 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: Updating smithi064:/etc/ceph/ceph.conf 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c;count:3 2024-09-19T08:55:44.883 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: Deploying daemon mon.c on smithi064 2024-09-19T08:55:44.884 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:44.884 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/699824346' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:44.884 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 ceph-mon[35179]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:55:44.884 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 bash[35159]: 0a168ca63fbcd0d44f01cb6fd93e312540d2d7785335677fdb91cc245d3ea9b3 2024-09-19T08:55:44.884 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:44 smithi064 systemd[1]: Started Ceph mon.c for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T08:55:45.171 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:55:45.172 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:45.428 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:50.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: mon.a calling monitor election 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: mon.c calling monitor election 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:50.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: monmap epoch 2 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: last_changed 2024-09-19T08:55:44.644772+0000 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: min_mon_release 19 (squid) 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: election_strategy: 1 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:55:50.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: fsmap 2024-09-19T08:55:50.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:55:50.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: mgrmap e13: x(active, since 39s) 2024-09-19T08:55:50.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: overall HEALTH_OK 2024-09-19T08:55:50.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:50.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:50.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:50.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:50.051 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:55:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: mon.a calling monitor election 2024-09-19T08:55:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: mon.c calling monitor election 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: monmap epoch 2 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: last_changed 2024-09-19T08:55:44.644772+0000 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: min_mon_release 19 (squid) 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: election_strategy: 1 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:55:50.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: fsmap 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: mgrmap e13: x(active, since 39s) 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: overall HEALTH_OK 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:50.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:50.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.244+0000 7f961b412640 1 -- 172.21.15.64:0/1301619697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 msgr2=0x7f96000059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.244+0000 7f961b412640 1 --2- 172.21.15.64:0/1301619697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 0x7f96000059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9614069db0 tx=0x7f961002c490 comp rx=0 tx=0).stop 2024-09-19T08:55:50.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.244+0000 7f961b412640 1 -- 172.21.15.64:0/1301619697 shutdown_connections 2024-09-19T08:55:50.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.244+0000 7f961b412640 1 --2- 172.21.15.64:0/1301619697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 0x7f96000059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.244+0000 7f961b412640 1 -- 172.21.15.64:0/1301619697 >> 172.21.15.64:0/1301619697 conn(0x7f96140fb9f0 msgr2=0x7f96140fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.244+0000 7f961b412640 1 -- 172.21.15.64:0/1301619697 shutdown_connections 2024-09-19T08:55:50.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.244+0000 7f961b412640 1 -- 172.21.15.64:0/1301619697 wait complete. 2024-09-19T08:55:50.245 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.245+0000 7f961b412640 1 Processor -- start 2024-09-19T08:55:50.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.245+0000 7f961b412640 1 -- start start 2024-09-19T08:55:50.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f961b412640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 0x7f96141028e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f961b412640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 0x7f9614103280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f961b412640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9614108860 con 0x7f9600003530 2024-09-19T08:55:50.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f961b412640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f96141086e0 con 0x7f9614102e20 2024-09-19T08:55:50.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96189ad640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 0x7f9614103280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96189ad640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 0x7f9614103280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52044/0 (socket says 172.21.15.64:52044) 2024-09-19T08:55:50.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96191ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 0x7f96141028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96189ad640 1 -- 172.21.15.64:0/2085278143 learned_addr learned my addr 172.21.15.64:0/2085278143 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96189ad640 1 -- 172.21.15.64:0/2085278143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 msgr2=0x7f9614103280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96189ad640 1 -- 172.21.15.64:0/2085278143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 msgr2=0x7f9614103280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96189ad640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 0x7f9614103280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96189ad640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 0x7f9614103280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96191ae640 1 -- 172.21.15.64:0/2085278143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 msgr2=0x7f9614103280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96191ae640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 0x7f9614103280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.246+0000 7f96191ae640 1 -- 172.21.15.64:0/2085278143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96141047d0 con 0x7f9600003530 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.247+0000 7f96191ae640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 0x7f96141028e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9610036040 tx=0x7f96100329b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.247+0000 7f960a7fc640 1 -- 172.21.15.64:0/2085278143 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9610038040 con 0x7f9600003530 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.247+0000 7f960a7fc640 1 -- 172.21.15.64:0/2085278143 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9610032e70 con 0x7f9600003530 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.247+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96141a35c0 con 0x7f9600003530 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.247+0000 7f960a7fc640 1 -- 172.21.15.64:0/2085278143 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f96100049f0 con 0x7f9600003530 2024-09-19T08:55:50.248 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.247+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96141a3b50 con 0x7f9600003530 2024-09-19T08:55:50.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.248+0000 7f960a7fc640 1 -- 172.21.15.64:0/2085278143 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f9610043020 con 0x7f9600003530 2024-09-19T08:55:50.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.248+0000 7f960a7fc640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95f8039090 0x7f95f803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:50.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.248+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9614101d40 con 0x7f9600003530 2024-09-19T08:55:50.249 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.248+0000 7f960a7fc640 1 -- 172.21.15.64:0/2085278143 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f961006ea00 con 0x7f9600003530 2024-09-19T08:55:50.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.248+0000 7f96189ad640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95f8039090 0x7f95f803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:50.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.249+0000 7f96189ad640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95f8039090 0x7f95f803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9604009100 tx=0x7f9604008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:50.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.254+0000 7f960a7fc640 1 -- 172.21.15.64:0/2085278143 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f961004a020 con 0x7f9600003530 2024-09-19T08:55:50.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.502+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f96141a3e30 con 0x7f9600003530 2024-09-19T08:55:50.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.503+0000 7f960a7fc640 1 -- 172.21.15.64:0/2085278143 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7f961004cbc0 con 0x7f9600003530 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":2,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:55:44.644772Z","created":"2024-09-19T08:54:09.693383Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:55:50.503 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 2 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95f8039090 msgr2=0x7f95f803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95f8039090 0x7f95f803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9604009100 tx=0x7f9604008040 comp rx=0 tx=0).stop 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 msgr2=0x7f96141028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 0x7f96141028e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9610036040 tx=0x7f96100329b0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 shutdown_connections 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95f8039090 0x7f95f803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9614102e20 0x7f9614103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 --2- 172.21.15.64:0/2085278143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9600003530 0x7f96141028e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 >> 172.21.15.64:0/2085278143 conn(0x7f96140fb9f0 msgr2=0x7f9614104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 shutdown_connections 2024-09-19T08:55:50.505 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:50.505+0000 7f961b412640 1 -- 172.21.15.64:0/2085278143 wait complete. 2024-09-19T08:55:50.852 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:50 smithi064 ceph-mon[35179]: Deploying daemon mon.b on smithi022 2024-09-19T08:55:50.852 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:50 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/2085278143' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:50.852 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:50 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:50.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:50 smithi001 ceph-mon[30939]: Deploying daemon mon.b on smithi022 2024-09-19T08:55:50.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:50 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/2085278143' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:50.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:50 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:52.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:51 smithi001 ceph-mon[30939]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:52.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:51 smithi064 ceph-mon[35179]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:52.131 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:55:52.132 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:52.390 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:52.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.821+0000 7f1ec7023640 1 -- 172.21.15.64:0/1794226646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0106670 msgr2=0x7f1ec0106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.821+0000 7f1ec7023640 1 --2- 172.21.15.64:0/1794226646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0106670 0x7f1ec0106a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009880 tx=0x7f1eb402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.821+0000 7f1ec7023640 1 -- 172.21.15.64:0/1794226646 shutdown_connections 2024-09-19T08:55:52.832 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.821+0000 7f1ec7023640 1 --2- 172.21.15.64:0/1794226646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0106670 0x7f1ec0106a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.821+0000 7f1ec7023640 1 -- 172.21.15.64:0/1794226646 >> 172.21.15.64:0/1794226646 conn(0x7f1ec00fc280 msgr2=0x7f1ec00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.821+0000 7f1ec7023640 1 -- 172.21.15.64:0/1794226646 shutdown_connections 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.821+0000 7f1ec7023640 1 -- 172.21.15.64:0/1794226646 wait complete. 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec7023640 1 Processor -- start 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec7023640 1 -- start start 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec7023640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 0x7f1ec01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec7023640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0198810 0x7f1ec0198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec7023640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec010ade0 con 0x7f1ec0198810 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec7023640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec010ac60 con 0x7f1ec0106670 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec4dbf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 0x7f1ec01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec4dbf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 0x7f1ec01982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52060/0 (socket says 172.21.15.64:52060) 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ec4dbf640 1 -- 172.21.15.64:0/3452432149 learned_addr learned my addr 172.21.15.64:0/3452432149 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:55:52.833 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.822+0000 7f1ebffff640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0198810 0x7f1ec0198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ec4dbf640 1 -- 172.21.15.64:0/3452432149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 msgr2=0x7f1ec01982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ec4dbf640 1 -- 172.21.15.64:0/3452432149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 msgr2=0x7f1ec01982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ec4dbf640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 0x7f1ec01982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ec4dbf640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 0x7f1ec01982d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ebffff640 1 -- 172.21.15.64:0/3452432149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 msgr2=0x7f1ec01982d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ebffff640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 0x7f1ec01982d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ebffff640 1 -- 172.21.15.64:0/3452432149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec01a1340 con 0x7f1ec0198810 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ebffff640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0198810 0x7f1ec0198c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00b400 tx=0x7f1eac00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ebdffb640 1 -- 172.21.15.64:0/3452432149 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1eac011630 con 0x7f1ec0198810 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec01a1510 con 0x7f1ec0198810 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ebdffb640 1 -- 172.21.15.64:0/3452432149 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1eac011cd0 con 0x7f1ec0198810 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.823+0000 7f1ebdffb640 1 -- 172.21.15.64:0/3452432149 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1eac0193b0 con 0x7f1ec0198810 2024-09-19T08:55:52.834 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.824+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec01a1a70 con 0x7f1ec0198810 2024-09-19T08:55:52.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.824+0000 7f1ebdffb640 1 -- 172.21.15.64:0/3452432149 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f1eac018020 con 0x7f1ec0198810 2024-09-19T08:55:52.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.825+0000 7f1ebdffb640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1eb0039040 0x7f1eb003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.825+0000 7f1ebdffb640 1 -- 172.21.15.64:0/3452432149 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1eac04bee0 con 0x7f1ec0198810 2024-09-19T08:55:52.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.825+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec0101ce0 con 0x7f1ec0198810 2024-09-19T08:55:52.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.825+0000 7f1ec4dbf640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1eb0039040 0x7f1eb003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.825+0000 7f1ec4dbf640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1eb0039040 0x7f1eb003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40096c0 tx=0x7f1eb402aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.835 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:52.830+0000 7f1ebdffb640 1 -- 172.21.15.64:0/3452432149 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1eac01f020 con 0x7f1ec0198810 2024-09-19T08:55:53.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.072+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1ec01a1db0 con 0x7f1ec0198810 2024-09-19T08:55:53.072 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.073+0000 7f1ebdffb640 1 -- 172.21.15.64:0/3452432149 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7f1eac01a400 con 0x7f1ec0198810 2024-09-19T08:55:53.073 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:55:53.073 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":2,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:55:44.644772Z","created":"2024-09-19T08:54:09.693383Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:55:53.073 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 2 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1eb0039040 msgr2=0x7f1eb003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1eb0039040 0x7f1eb003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40096c0 tx=0x7f1eb402aad0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0198810 msgr2=0x7f1ec0198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0198810 0x7f1ec0198c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00b400 tx=0x7f1eac00b8c0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 shutdown_connections 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ec0198810 0x7f1ec0198c70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1eb0039040 0x7f1eb003b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 --2- 172.21.15.64:0/3452432149 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ec0106670 0x7f1ec01982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 >> 172.21.15.64:0/3452432149 conn(0x7f1ec00fc280 msgr2=0x7f1ec00fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 shutdown_connections 2024-09-19T08:55:53.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:53.075+0000 7f1ec7023640 1 -- 172.21.15.64:0/3452432149 wait complete. 2024-09-19T08:55:53.563 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T08:55:53.563 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T08:55:53.563 INFO:journalctl@ceph.mon.b.smithi022.stdout: e1 2024-09-19T08:55:53.563 INFO:journalctl@ceph.mon.b.smithi022.stdout: btime 2024-09-19T08:54:23:245014+0000 2024-09-19T08:55:53.563 INFO:journalctl@ceph.mon.b.smithi022.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:55:53.563 INFO:journalctl@ceph.mon.b.smithi022.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:55:53.564 INFO:journalctl@ceph.mon.b.smithi022.stdout: legacy client fscid: -1 2024-09-19T08:55:53.564 INFO:journalctl@ceph.mon.b.smithi022.stdout: 2024-09-19T08:55:53.564 INFO:journalctl@ceph.mon.b.smithi022.stdout: No filesystems configured 2024-09-19T08:55:53.564 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:55:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:55:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:55:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:55:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:55:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:55:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:55:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1831702130' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1831702130' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: Updating smithi064:/etc/ceph/ceph.conf 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:55:53.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c;count:3 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: Deploying daemon mon.c on smithi064 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/699824346' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.a calling monitor election 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.c calling monitor election 2024-09-19T08:55:53.962 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: monmap epoch 2 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: last_changed 2024-09-19T08:55:44.644772+0000 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: min_mon_release 19 (squid) 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: election_strategy: 1 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: fsmap 2024-09-19T08:55:53.963 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mgrmap e13: x(active, since 39s) 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: overall HEALTH_OK 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: Deploying daemon mon.b on smithi022 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/2085278143' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 ceph-mon[35107]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 bash[35087]: d3e4a5cd071fda7cbe554c15f1dfc9652a6398276ae6819d52db7d8c09e15ce0 2024-09-19T08:55:53.964 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:55:53 smithi022 systemd[1]: Started Ceph mon.b for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T08:55:54.570 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:55:54.570 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:55:54.828 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:55:58.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.861+0000 7f9184b39640 1 -- 172.21.15.64:0/2747441343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 msgr2=0x7f916c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:58.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.861+0000 7f9184b39640 1 --2- 172.21.15.64:0/2747441343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 0x7f916c0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9180102b10 tx=0x7f917002bdd0 comp rx=0 tx=0).stop 2024-09-19T08:55:58.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.861+0000 7f9184b39640 1 -- 172.21.15.64:0/2747441343 shutdown_connections 2024-09-19T08:55:58.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.861+0000 7f9184b39640 1 --2- 172.21.15.64:0/2747441343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 0x7f916c0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:58.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.861+0000 7f9184b39640 1 -- 172.21.15.64:0/2747441343 >> 172.21.15.64:0/2747441343 conn(0x7f91800fd380 msgr2=0x7f91800ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:58.864 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.861+0000 7f9184b39640 1 -- 172.21.15.64:0/2747441343 shutdown_connections 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.861+0000 7f9184b39640 1 -- 172.21.15.64:0/2747441343 wait complete. 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.862+0000 7f9184b39640 1 Processor -- start 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.862+0000 7f9184b39640 1 -- start start 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.862+0000 7f9184b39640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 0x7f9180197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.862+0000 7f9184b39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 0x7f918019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.862+0000 7f9184b39640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 0x7f918019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.862+0000 7f9184b39640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9180109880 con 0x7f916c003530 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.862+0000 7f9184b39640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9180109700 con 0x7f91801979d0 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.862+0000 7f9184b39640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9180109a00 con 0x7f918019c2a0 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 0x7f918019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:58.865 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 0x7f918019c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49124/0 (socket says 172.21.15.64:49124) 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917ed9d640 1 -- 172.21.15.64:0/1836935971 learned_addr learned my addr 172.21.15.64:0/1836935971 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917e59c640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 0x7f9180197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917dd9b640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 0x7f918019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917ed9d640 1 -- 172.21.15.64:0/1836935971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 msgr2=0x7f918019c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917ed9d640 1 -- 172.21.15.64:0/1836935971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 msgr2=0x7f918019c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917ed9d640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 0x7f918019c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917ed9d640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 0x7f918019c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917dd9b640 1 -- 172.21.15.64:0/1836935971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 msgr2=0x7f918019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917dd9b640 1 -- 172.21.15.64:0/1836935971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 msgr2=0x7f918019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917dd9b640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 0x7f918019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917dd9b640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 0x7f918019bd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917e59c640 1 -- 172.21.15.64:0/1836935971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 msgr2=0x7f918019c750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:55:58.866 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917e59c640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 0x7f918019c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917e59c640 1 -- 172.21.15.64:0/1836935971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 msgr2=0x7f918019bd60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917e59c640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 0x7f918019bd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917e59c640 1 -- 172.21.15.64:0/1836935971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91801a4010 con 0x7f916c003530 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.863+0000 7f917e59c640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 0x7f9180197490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9170009d60 tx=0x7f91700345f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.864+0000 7f91777fe640 1 -- 172.21.15.64:0/1836935971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170039070 con 0x7f916c003530 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.864+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91801a41e0 con 0x7f916c003530 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.864+0000 7f91777fe640 1 -- 172.21.15.64:0/1836935971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9170034ce0 con 0x7f916c003530 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.864+0000 7f91777fe640 1 -- 172.21.15.64:0/1836935971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91700058c0 con 0x7f916c003530 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.864+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91801a4690 con 0x7f916c003530 2024-09-19T08:55:58.867 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.864+0000 7f91777fe640 1 -- 172.21.15.64:0/1836935971 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f9170044060 con 0x7f916c003530 2024-09-19T08:55:58.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.865+0000 7f91777fe640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9160039730 0x7f916003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:58.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.865+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918010aa20 con 0x7f916c003530 2024-09-19T08:55:58.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.865+0000 7f91777fe640 1 -- 172.21.15.64:0/1836935971 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f917006e110 con 0x7f916c003530 2024-09-19T08:55:58.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.865+0000 7f917dd9b640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9160039730 0x7f916003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:58.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.865+0000 7f917dd9b640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9160039730 0x7f916003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9168006fd0 tx=0x7f9168008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:58.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:58.870+0000 7f91777fe640 1 -- 172.21.15.64:0/1836935971 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91700432c0 con 0x7f916c003530 2024-09-19T08:55:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:55:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: mon.c calling monitor election 2024-09-19T08:55:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: mon.a calling monitor election 2024-09-19T08:55:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: monmap epoch 3 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: last_changed 2024-09-19T08:55:53.569303+0000 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: min_mon_release 19 (squid) 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: election_strategy: 1 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:55:59.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: fsmap 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: mgrmap e13: x(active, since 48s) 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: overall HEALTH_OK 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:59.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: mon.c calling monitor election 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: mon.a calling monitor election 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: monmap epoch 3 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: last_changed 2024-09-19T08:55:53.569303+0000 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: min_mon_release 19 (squid) 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: election_strategy: 1 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: fsmap 2024-09-19T08:55:59.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: mgrmap e13: x(active, since 48s) 2024-09-19T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: overall HEALTH_OK 2024-09-19T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:59.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:55:59.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.122+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f91801987f0 con 0x7f916c003530 2024-09-19T08:55:59.122 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.123+0000 7f91777fe640 1 -- 172.21.15.64:0/1836935971 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1271 (secure 0 0 0) 0x7f91801987f0 con 0x7f916c003530 2024-09-19T08:55:59.123 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:55:59.123 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":3,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","modified":"2024-09-19T08:55:53.569303Z","created":"2024-09-19T08:54:09.693383Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:55:59.123 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 3 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9160039730 msgr2=0x7f916003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9160039730 0x7f916003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9168006fd0 tx=0x7f9168008040 comp rx=0 tx=0).stop 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 msgr2=0x7f9180197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 0x7f9180197490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9170009d60 tx=0x7f91700345f0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 shutdown_connections 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9160039730 0x7f916003bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f918019c2a0 0x7f918019c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91801979d0 0x7f918019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.125 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 --2- 172.21.15.64:0/1836935971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916c003530 0x7f9180197490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:59.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 >> 172.21.15.64:0/1836935971 conn(0x7f91800fd380 msgr2=0x7f91800ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:59.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 shutdown_connections 2024-09-19T08:55:59.126 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:55:59.125+0000 7f9184b39640 1 -- 172.21.15.64:0/1836935971 wait complete. 2024-09-19T08:55:59.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:59 smithi064 ceph-mon[35179]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:55:59.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:59 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:59.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:59 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/1836935971' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:55:59.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:55:59 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:00.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:59 smithi001 ceph-mon[30939]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:00.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:59 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:00.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:59 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/1836935971' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:56:00.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:55:59 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:00.374 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T08:56:00.374 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T08:56:00.635 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: mon.c calling monitor election 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: mon.a calling monitor election 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:00.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: monmap epoch 3 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: last_changed 2024-09-19T08:55:53.569303+0000 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: min_mon_release 19 (squid) 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: election_strategy: 1 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T08:56:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: fsmap 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: mgrmap e13: x(active, since 48s) 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: overall HEALTH_OK 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/1836935971' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:56:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:01.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.059+0000 7f47c8f8d640 1 -- 172.21.15.1:0/696198978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c4106540 msgr2=0x7f47c4106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:01.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.059+0000 7f47c8f8d640 1 --2- 172.21.15.1:0/696198978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c4106540 0x7f47c4106920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009810 tx=0x7f47bc02a540 comp rx=0 tx=0).stop 2024-09-19T08:56:01.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.059+0000 7f47c8f8d640 1 -- 172.21.15.1:0/696198978 shutdown_connections 2024-09-19T08:56:01.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.059+0000 7f47c8f8d640 1 --2- 172.21.15.1:0/696198978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c4106540 0x7f47c4106920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:01.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.059+0000 7f47c8f8d640 1 -- 172.21.15.1:0/696198978 >> 172.21.15.1:0/696198978 conn(0x7f47c4077310 msgr2=0x7f47c40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:01.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.059+0000 7f47c8f8d640 1 -- 172.21.15.1:0/696198978 shutdown_connections 2024-09-19T08:56:01.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.059+0000 7f47c8f8d640 1 -- 172.21.15.1:0/696198978 wait complete. 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.059+0000 7f47c8f8d640 1 Processor -- start 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c8f8d640 1 -- start start 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c8f8d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c4106540 0x7f47c4196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c8f8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c41965d0 0x7f47c4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c8f8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41a3700 0x7f47c41a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c8f8d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f47c410ac60 con 0x7f47c41a3700 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c8f8d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f47c410aae0 con 0x7f47c41965d0 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c8f8d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f47c410ade0 con 0x7f47c4106540 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41a3700 0x7f47c41a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41a3700 0x7f47c41a5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41128/0 (socket says 172.21.15.1:41128) 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 -- 172.21.15.1:0/1084626011 learned_addr learned my addr 172.21.15.1:0/1084626011 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c1d9b640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c41965d0 0x7f47c4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:01.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c259c640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c4106540 0x7f47c4196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 -- 172.21.15.1:0/1084626011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c4106540 msgr2=0x7f47c4196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c4106540 0x7f47c4196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 -- 172.21.15.1:0/1084626011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c41965d0 msgr2=0x7f47c4196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c41965d0 0x7f47c4196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 -- 172.21.15.1:0/1084626011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c41a6060 con 0x7f47c41a3700 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c1d9b640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c41965d0 0x7f47c4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.060+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41a3700 0x7f47c41a5af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47b400ba50 tx=0x7f47b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.061+0000 7f47bb7fe640 1 -- 172.21.15.1:0/1084626011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4019070 con 0x7f47c41a3700 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.061+0000 7f47bb7fe640 1 -- 172.21.15.1:0/1084626011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47b400cb80 con 0x7f47c41a3700 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.061+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c41a6350 con 0x7f47c41a3700 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.061+0000 7f47bb7fe640 1 -- 172.21.15.1:0/1084626011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4007750 con 0x7f47c41a3700 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.061+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c41a6910 con 0x7f47c41a3700 2024-09-19T08:56:01.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.062+0000 7f47bb7fe640 1 -- 172.21.15.1:0/1084626011 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f47b401c070 con 0x7f47c41a3700 2024-09-19T08:56:01.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.062+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c4101bb0 con 0x7f47c41a3700 2024-09-19T08:56:01.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.062+0000 7f47bb7fe640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47b0039730 0x7f47b003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:01.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.062+0000 7f47bb7fe640 1 -- 172.21.15.1:0/1084626011 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f47b404bd20 con 0x7f47c41a3700 2024-09-19T08:56:01.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.062+0000 7f47c259c640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47b0039730 0x7f47b003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:01.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.062+0000 7f47c259c640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47b0039730 0x7f47b003bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0097e0 tx=0x7f47bc009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:01.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.067+0000 7f47bb7fe640 1 -- 172.21.15.1:0/1084626011 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47b400cd30 con 0x7f47c41a3700 2024-09-19T08:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.244+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f47c41a6ca0 con 0x7f47c41a3700 2024-09-19T08:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.245+0000 7f47bb7fe640 1 -- 172.21.15.1:0/1084626011 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+269 (secure 0 0 0) 0x7f47b400e090 con 0x7f47c41a3700 2024-09-19T08:56:01.245 INFO:teuthology.orchestra.run.smithi001.stdout:# minimal ceph.conf for 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:56:01.245 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-09-19T08:56:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:56:01.245 INFO:teuthology.orchestra.run.smithi001.stdout: mon_host = [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47b0039730 msgr2=0x7f47b003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47b0039730 0x7f47b003bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0097e0 tx=0x7f47bc009590 comp rx=0 tx=0).stop 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41a3700 msgr2=0x7f47c41a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41a3700 0x7f47c41a5af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47b400ba50 tx=0x7f47b400bf10 comp rx=0 tx=0).stop 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 shutdown_connections 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41a3700 0x7f47c41a5af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c41965d0 0x7f47c4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47b0039730 0x7f47b003bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 --2- 172.21.15.1:0/1084626011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c4106540 0x7f47c4196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 >> 172.21.15.1:0/1084626011 conn(0x7f47c4077310 msgr2=0x7f47c40fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 shutdown_connections 2024-09-19T08:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:01.247+0000 7f47c8f8d640 1 -- 172.21.15.1:0/1084626011 wait complete. 2024-09-19T08:56:01.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: mon.b calling monitor election 2024-09-19T08:56:01.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:01.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T08:56:01.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-19T08:56:01.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: Updating smithi064:/etc/ceph/ceph.conf 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: Updating smithi022:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: Updating smithi001:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: Reconfiguring daemon mon.a on smithi001 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: mon.b calling monitor election 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: mon.c calling monitor election 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: mon.a calling monitor election 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: monmap epoch 3 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: last_changed 2024-09-19T08:55:53.569303+0000 2024-09-19T08:56:01.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: min_mon_release 19 (squid) 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: election_strategy: 1 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: fsmap 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: mgrmap e13: x(active, since 50s) 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: overall HEALTH_OK 2024-09-19T08:56:01.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:01 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1084626011' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:01.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: mon.b calling monitor election 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: Updating smithi064:/etc/ceph/ceph.conf 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: Updating smithi022:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: Updating smithi001:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: Reconfiguring daemon mon.a on smithi001 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: mon.b calling monitor election 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: mon.c calling monitor election 2024-09-19T08:56:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: mon.a calling monitor election 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: monmap epoch 3 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: last_changed 2024-09-19T08:55:53.569303+0000 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: min_mon_release 19 (squid) 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: election_strategy: 1 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:56:01.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T08:56:01.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: fsmap 2024-09-19T08:56:01.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:56:01.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: mgrmap e13: x(active, since 50s) 2024-09-19T08:56:01.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: overall HEALTH_OK 2024-09-19T08:56:01.858 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:01 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1084626011' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:01.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: mon.b calling monitor election 2024-09-19T08:56:01.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: Updating smithi064:/etc/ceph/ceph.conf 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: Updating smithi022:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: Updating smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: Updating smithi001:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: Reconfiguring daemon mon.a on smithi001 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: mon.b calling monitor election 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: mon.c calling monitor election 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: mon.a calling monitor election 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: monmap epoch 3 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T08:56:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: last_changed 2024-09-19T08:55:53.569303+0000 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: created 2024-09-19T08:54:09.693383+0000 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: min_mon_release 19 (squid) 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: election_strategy: 1 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: 1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.c 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: fsmap 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: mgrmap e13: x(active, since 50s) 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: overall HEALTH_OK 2024-09-19T08:56:01.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:01 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1084626011' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:02.424 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T08:56:02.425 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:56:02.425 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:56:02.456 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:56:02.456 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:56:02.526 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:56:02.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:56:02.560 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:56:02.560 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:56:02.629 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:56:02.629 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:56:02.662 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:56:02.662 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:56:02.731 INFO:tasks.cephadm:Adding mgr.x on smithi001 2024-09-19T08:56:02.731 INFO:tasks.cephadm:Adding mgr.y on smithi022 2024-09-19T08:56:02.731 INFO:tasks.cephadm:Adding mgr.z on smithi064 2024-09-19T08:56:02.731 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi001=x;smithi022=y;smithi064=z' 2024-09-19T08:56:02.795 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:02.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:02.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:56:03.018 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:56:03.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.472+0000 7fd0cb17f640 1 -- 172.21.15.64:0/2904417462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c4100610 msgr2=0x7fd0c4100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:03.474 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.472+0000 7fd0cb17f640 1 --2- 172.21.15.64:0/2904417462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c4100610 0x7fd0c4100a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009880 tx=0x7fd0b802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.472+0000 7fd0cb17f640 1 -- 172.21.15.64:0/2904417462 shutdown_connections 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.472+0000 7fd0cb17f640 1 --2- 172.21.15.64:0/2904417462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c4100610 0x7fd0c4100a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.472+0000 7fd0cb17f640 1 -- 172.21.15.64:0/2904417462 >> 172.21.15.64:0/2904417462 conn(0x7fd0c40fbdc0 msgr2=0x7fd0c40fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.473+0000 7fd0cb17f640 1 -- 172.21.15.64:0/2904417462 shutdown_connections 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.473+0000 7fd0cb17f640 1 -- 172.21.15.64:0/2904417462 wait complete. 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.473+0000 7fd0cb17f640 1 Processor -- start 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.473+0000 7fd0cb17f640 1 -- start start 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0cb17f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c4100610 0x7fd0c40fdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0cb17f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c40fc360 0x7fd0c40fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0cb17f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c40fcd20 0x7fd0c41a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0cb17f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4106830 con 0x7fd0c40fc360 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0cb17f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c41066b0 con 0x7fd0c40fcd20 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0cb17f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c41069b0 con 0x7fd0c4100610 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c4100610 0x7fd0c40fdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c4100610 0x7fd0c40fdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:49134/0 (socket says 172.21.15.64:49134) 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 -- 172.21.15.64:0/3451730898 learned_addr learned my addr 172.21.15.64:0/3451730898 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c3fff640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c40fc360 0x7fd0c40fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c971c640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c40fcd20 0x7fd0c41a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 -- 172.21.15.64:0/3451730898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c40fcd20 msgr2=0x7fd0c41a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c40fcd20 0x7fd0c41a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 -- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c40fc360 msgr2=0x7fd0c40fc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c40fc360 0x7fd0c40fc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 -- 172.21.15.64:0/3451730898 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c41a16d0 con 0x7fd0c4100610 2024-09-19T08:56:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c3fff640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c40fc360 0x7fd0c40fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c8f1b640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c4100610 0x7fd0c40fdd10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005ab0 tx=0x7fd0b8004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c1ffb640 1 -- 172.21.15.64:0/3451730898 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b803f030 con 0x7fd0c4100610 2024-09-19T08:56:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c41a1960 con 0x7fd0c4100610 2024-09-19T08:56:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c1ffb640 1 -- 172.21.15.64:0/3451730898 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd0b8003dc0 con 0x7fd0c4100610 2024-09-19T08:56:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.474+0000 7fd0c1ffb640 1 -- 172.21.15.64:0/3451730898 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8035070 con 0x7fd0c4100610 2024-09-19T08:56:03.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.475+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c41a1ec0 con 0x7fd0c4100610 2024-09-19T08:56:03.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.475+0000 7fd0c1ffb640 1 -- 172.21.15.64:0/3451730898 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fd0b8042030 con 0x7fd0c4100610 2024-09-19T08:56:03.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.476+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c4190910 con 0x7fd0c4100610 2024-09-19T08:56:03.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.476+0000 7fd0c1ffb640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd0b4039730 0x7fd0b403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:03.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.476+0000 7fd0c1ffb640 1 -- 172.21.15.64:0/3451730898 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd0b806cd70 con 0x7fd0c4100610 2024-09-19T08:56:03.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.476+0000 7fd0c3fff640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd0b4039730 0x7fd0b403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:03.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.477+0000 7fd0c3fff640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd0b4039730 0x7fd0b403bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006fd0 tx=0x7fd0b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:03.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.481+0000 7fd0c1ffb640 1 -- 172.21.15.64:0/3451730898 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd0b804c350 con 0x7fd0c4100610 2024-09-19T08:56:03.585 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:03 smithi022 ceph-mon[35107]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:03.586 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:03 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:03.586 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:03 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:03.586 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:03 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:56:03.586 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:03 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:56:03.586 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:03 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.667+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi022=y;smithi064=z", "target": ["mon-mgr", ""]}) -- 0x7fd0c40626c0 con 0x7fd0b4039730 2024-09-19T08:56:03.667 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:03 smithi064 ceph-mon[35179]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:03.668 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:03 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:03.668 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:03 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:03.668 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:03 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:56:03.668 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:03 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:56:03.668 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:03 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.673+0000 7fd0c1ffb640 1 -- 172.21.15.64:0/3451730898 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd0c40626c0 con 0x7fd0b4039730 2024-09-19T08:56:03.673 INFO:teuthology.orchestra.run.smithi064.stdout:Scheduled mgr update... 2024-09-19T08:56:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.675+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd0b4039730 msgr2=0x7fd0b403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:03.675 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.675+0000 7fd0cb17f640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd0b4039730 0x7fd0b403bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006fd0 tx=0x7fd0b0008040 comp rx=0 tx=0).stop 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c4100610 msgr2=0x7fd0c40fdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c4100610 0x7fd0c40fdd10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005ab0 tx=0x7fd0b8004430 comp rx=0 tx=0).stop 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 shutdown_connections 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0c40fcd20 0x7fd0c41a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd0c40fc360 0x7fd0c40fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd0b4039730 0x7fd0b403bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 --2- 172.21.15.64:0/3451730898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c4100610 0x7fd0c40fdd10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 >> 172.21.15.64:0/3451730898 conn(0x7fd0c40fbdc0 msgr2=0x7fd0c406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 shutdown_connections 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:56:03.676+0000 7fd0cb17f640 1 -- 172.21.15.64:0/3451730898 wait complete. 2024-09-19T08:56:03.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:03 smithi001 ceph-mon[30939]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:03.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:03 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:03.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:03 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:03.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:03 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:56:03.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:03 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:56:03.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:03 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:04.220 DEBUG:teuthology.orchestra.run.smithi022:mgr.y> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T08:56:04.222 DEBUG:teuthology.orchestra.run.smithi064:mgr.z> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T08:56:04.262 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T08:56:04.262 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T08:56:04.262 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:56:04.282 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:56:04.283 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-09-19T08:56:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:56:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:04.342 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T08:56:04.342 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:04.342 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:04.342 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 08:55:21.239565866 +0000 2024-09-19T08:56:04.342 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 08:50:48.238157439 +0000 2024-09-19T08:56:04.342 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 08:50:48.238157439 +0000 2024-09-19T08:56:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 08:50:48.238157439 +0000 2024-09-19T08:56:04.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:56:04.412 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T08:56:04.412 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T08:56:04.412 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000132422 s, 3.9 MB/s 2024-09-19T08:56:04.414 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:56:04.475 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-09-19T08:56:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:56:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:04.534 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T08:56:04.534 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:04.534 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:04.534 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 08:55:21.274565410 +0000 2024-09-19T08:56:04.534 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 08:50:48.567153377 +0000 2024-09-19T08:56:04.534 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 08:50:48.567153377 +0000 2024-09-19T08:56:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 08:50:48.567153377 +0000 2024-09-19T08:56:04.534 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:56:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T08:56:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T08:56:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000132952 s, 3.9 MB/s 2024-09-19T08:56:04.601 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:56:04.660 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 08:55:21.308564967 +0000 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 08:50:48.883149476 +0000 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 08:50:48.883149476 +0000 2024-09-19T08:56:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 08:50:48.883149476 +0000 2024-09-19T08:56:04.719 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:56:04.784 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T08:56:04.784 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T08:56:04.784 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000100573 s, 5.1 MB/s 2024-09-19T08:56:04.786 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:56:04.843 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-09-19T08:56:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:56:04.900 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:04.900 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:56:04.900 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:04.900 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:04.901 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 08:55:21.345564485 +0000 2024-09-19T08:56:04.901 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 08:50:49.212145414 +0000 2024-09-19T08:56:04.901 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 08:50:49.212145414 +0000 2024-09-19T08:56:04.901 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 08:50:49.212145414 +0000 2024-09-19T08:56:04.901 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: Reconfiguring daemon mon.b on smithi022 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi022=y;smithi064=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: Saving service mgr spec with placement smithi001=x;smithi022=y;smithi064=z;count:3 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:56:04.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:04.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:56:04.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: Reconfiguring daemon mon.b on smithi022 2024-09-19T08:56:04.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi022=y;smithi064=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:04.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: Saving service mgr spec with placement smithi001=x;smithi022=y;smithi064=z;count:3 2024-09-19T08:56:04.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:56:04.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:56:04.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:04.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:56:04.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: Reconfiguring daemon mon.b on smithi022 2024-09-19T08:56:04.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi022=y;smithi064=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:04.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: Saving service mgr spec with placement smithi001=x;smithi022=y;smithi064=z;count:3 2024-09-19T08:56:04.964 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.964 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.964 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:04.964 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:56:04.964 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:56:04.964 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T08:56:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T08:56:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.00011791 s, 4.3 MB/s 2024-09-19T08:56:04.967 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:56:05.025 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T08:56:05.025 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:56:05.044 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:56:05.044 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-09-19T08:56:05.103 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:56:05.103 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:05.103 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T08:56:05.103 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:05.103 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:05.103 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-19 08:55:53.015223337 +0000 2024-09-19T08:56:05.104 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-19 08:51:03.805016892 +0000 2024-09-19T08:56:05.104 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-19 08:51:03.805016892 +0000 2024-09-19T08:56:05.104 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-19 08:51:03.805016892 +0000 2024-09-19T08:56:05.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:56:05.171 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-19T08:56:05.172 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-19T08:56:05.172 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000127221 s, 4.0 MB/s 2024-09-19T08:56:05.173 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:56:05.232 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-09-19T08:56:05.289 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:56:05.289 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:05.290 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-19T08:56:05.290 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:05.290 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:05.290 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-19 08:55:53.016223325 +0000 2024-09-19T08:56:05.290 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-19 08:51:04.127013185 +0000 2024-09-19T08:56:05.290 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-19 08:51:04.127013185 +0000 2024-09-19T08:56:05.290 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-19 08:51:04.127013185 +0000 2024-09-19T08:56:05.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:56:05.355 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-19T08:56:05.355 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-19T08:56:05.355 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.00011251 s, 4.6 MB/s 2024-09-19T08:56:05.357 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:56:05.414 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-09-19T08:56:05.471 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:56:05.471 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:05.471 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:56:05.471 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:05.471 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:05.471 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-19 08:55:53.016223325 +0000 2024-09-19T08:56:05.472 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-19 08:51:04.454009419 +0000 2024-09-19T08:56:05.472 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-19 08:51:04.454009419 +0000 2024-09-19T08:56:05.472 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-19 08:51:04.454009419 +0000 2024-09-19T08:56:05.472 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:56:05.537 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-19T08:56:05.537 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-19T08:56:05.538 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.6848e-05 s, 5.3 MB/s 2024-09-19T08:56:05.539 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:56:05.597 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-09-19T08:56:05.652 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:56:05.652 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:05.653 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T08:56:05.653 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:05.653 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:05.653 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-19 08:55:53.016223325 +0000 2024-09-19T08:56:05.653 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-19 08:51:04.752005987 +0000 2024-09-19T08:56:05.653 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-19 08:51:04.752005987 +0000 2024-09-19T08:56:05.653 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-19 08:51:04.752005987 +0000 2024-09-19T08:56:05.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:56:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-19T08:56:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-19T08:56:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 8.9794e-05 s, 5.7 MB/s 2024-09-19T08:56:05.719 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:56:05.775 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-09-19T08:56:05.775 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:56:05.791 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:56:05.791 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2024-09-19T08:56:05.845 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:56:05.846 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:05.846 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T08:56:05.846 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:05.846 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:05.846 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-09-19 08:55:43.750887456 +0000 2024-09-19T08:56:05.846 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-09-19 08:51:09.613766278 +0000 2024-09-19T08:56:05.846 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-09-19 08:51:09.613766278 +0000 2024-09-19T08:56:05.846 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-09-19 08:51:09.613766278 +0000 2024-09-19T08:56:05.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:56:05.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-19T08:56:05.909 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-19T08:56:05.909 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000252286 s, 2.0 MB/s 2024-09-19T08:56:05.911 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:56:05.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:05 smithi022 ceph-mon[35107]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:05.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:05 smithi022 ceph-mon[35107]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:56:05.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:05 smithi022 ceph-mon[35107]: Reconfiguring daemon mon.c on smithi064 2024-09-19T08:56:05.967 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-09-19 08:55:43.751887436 +0000 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-09-19 08:51:09.966759321 +0000 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-09-19 08:51:09.966759321 +0000 2024-09-19T08:56:06.024 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-09-19 08:51:09.966759321 +0000 2024-09-19T08:56:06.025 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:56:06.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:05 smithi001 ceph-mon[30939]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:06.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:05 smithi001 ceph-mon[30939]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:56:06.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:05 smithi001 ceph-mon[30939]: Reconfiguring daemon mon.c on smithi064 2024-09-19T08:56:06.085 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:05 smithi064 ceph-mon[35179]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:06.085 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:05 smithi064 ceph-mon[35179]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:56:06.085 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:05 smithi064 ceph-mon[35179]: Reconfiguring daemon mon.c on smithi064 2024-09-19T08:56:06.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-19T08:56:06.090 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-19T08:56:06.090 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000249646 s, 2.1 MB/s 2024-09-19T08:56:06.090 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:56:06.146 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2024-09-19T08:56:06.202 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:56:06.202 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:06.202 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T08:56:06.202 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:06.203 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:06.203 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-09-19 08:55:43.751887436 +0000 2024-09-19T08:56:06.203 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-09-19 08:51:10.293752877 +0000 2024-09-19T08:56:06.203 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-09-19 08:51:10.293752877 +0000 2024-09-19T08:56:06.203 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-09-19 08:51:10.293752877 +0000 2024-09-19T08:56:06.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:56:06.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-19T08:56:06.265 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-19T08:56:06.265 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000200128 s, 2.6 MB/s 2024-09-19T08:56:06.266 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:56:06.323 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2024-09-19T08:56:06.378 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:56:06.378 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:56:06.378 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:56:06.378 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:56:06.378 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:56:06.378 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-09-19 08:55:43.751887436 +0000 2024-09-19T08:56:06.378 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-09-19 08:51:10.623746373 +0000 2024-09-19T08:56:06.379 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-09-19 08:51:10.623746373 +0000 2024-09-19T08:56:06.379 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-09-19 08:51:10.623746373 +0000 2024-09-19T08:56:06.379 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:56:06.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-09-19T08:56:06.443 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-09-19T08:56:06.443 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000180138 s, 2.8 MB/s 2024-09-19T08:56:06.444 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:56:06.499 INFO:tasks.cephadm:Deploying osd.0 on smithi001 with /dev/vg_nvme/lv_4... 2024-09-19T08:56:06.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:56:06.763 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:56:06.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:06.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:06.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:06 smithi001 ceph-mon[30939]: Deploying daemon mgr.z on smithi064 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:56:07.011 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:07.012 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:07.012 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:06 smithi064 ceph-mon[35179]: Deploying daemon mgr.z on smithi064 2024-09-19T08:56:07.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:07.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:07.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:07.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:07.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:07.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:07.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:07.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:56:07.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:07.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:07.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:06 smithi022 ceph-mon[35107]: Deploying daemon mgr.z on smithi064 2024-09-19T08:56:07.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:07 smithi001 ceph-mon[30939]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:08.004 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:07 smithi064 ceph-mon[35179]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:08.004 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:07.943+0000 7fa9f17d0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:56:08.004 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:08.004+0000 7fa9f17d0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:56:08.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:07 smithi022 ceph-mon[35107]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:08.355 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:08.158+0000 7fa9f17d0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:56:08.355 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:08.226+0000 7fa9f17d0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:56:08.853 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:08.379+0000 7fa9f17d0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:56:08.853 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:08.525+0000 7fa9f17d0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:56:08.853 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:08.853+0000 7fa9f17d0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:56:09.083 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:56:09.105 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:08.916+0000 7fa9f17d0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:56:09.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:09.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:56:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:08 smithi064 ceph-mon[35179]: Deploying daemon mgr.y on smithi022 2024-09-19T08:56:09.110 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_4 2024-09-19T08:56:09.297 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:56:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:08 smithi001 ceph-mon[30939]: Deploying daemon mgr.y on smithi022 2024-09-19T08:56:09.371 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:09.400 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:09.401 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.401 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.401 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:09.401 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:09.401 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:56:09.401 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:09.401 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:09.401 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:08 smithi022 ceph-mon[35107]: Deploying daemon mgr.y on smithi022 2024-09-19T08:56:09.605 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:09.109+0000 7fa9f17d0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:56:09.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 -- 172.21.15.1:0/2648631618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8102e00 msgr2=0x7fcce8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:09.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 --2- 172.21.15.1:0/2648631618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8102e00 0x7fcce8103280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009900 tx=0x7fccdc02a410 comp rx=0 tx=0).stop 2024-09-19T08:56:09.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 -- 172.21.15.1:0/2648631618 shutdown_connections 2024-09-19T08:56:09.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 --2- 172.21.15.1:0/2648631618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcce81037c0 0x7fcce810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 --2- 172.21.15.1:0/2648631618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8102e00 0x7fcce8103280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 --2- 172.21.15.1:0/2648631618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcce8101c00 0x7fcce8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 -- 172.21.15.1:0/2648631618 >> 172.21.15.1:0/2648631618 conn(0x7fcce80fd390 msgr2=0x7fcce80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 -- 172.21.15.1:0/2648631618 shutdown_connections 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.985+0000 7fccedcaa640 1 -- 172.21.15.1:0/2648631618 wait complete. 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fccedcaa640 1 Processor -- start 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fccedcaa640 1 -- start start 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fccedcaa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8101c00 0x7fcce8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fccedcaa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcce8102e00 0x7fcce80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fccedcaa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcce81037c0 0x7fcce8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fccedcaa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810d9c0 con 0x7fcce8101c00 2024-09-19T08:56:09.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fccedcaa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810d840 con 0x7fcce81037c0 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fccedcaa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810db40 con 0x7fcce8102e00 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8101c00 0x7fcce8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8101c00 0x7fcce8075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53532/0 (socket says 172.21.15.1:53532) 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fcce77fe640 1 -- 172.21.15.1:0/1681874027 learned_addr learned my addr 172.21.15.1:0/1681874027 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fcce6ffd640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcce8102e00 0x7fcce80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.986+0000 7fcce7fff640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcce81037c0 0x7fcce8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce77fe640 1 -- 172.21.15.1:0/1681874027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcce8102e00 msgr2=0x7fcce80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce77fe640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcce8102e00 0x7fcce80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce77fe640 1 -- 172.21.15.1:0/1681874027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcce81037c0 msgr2=0x7fcce8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce77fe640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcce81037c0 0x7fcce8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce77fe640 1 -- 172.21.15.1:0/1681874027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce80753e0 con 0x7fcce8101c00 2024-09-19T08:56:09.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce77fe640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8101c00 0x7fcce8075f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fccd800d950 tx=0x7fccd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8017020 con 0x7fcce8101c00 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce81a2140 con 0x7fcce8101c00 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fccd8009c30 con 0x7fcce8101c00 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd800f7e0 con 0x7fcce8101c00 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.987+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce81a2650 con 0x7fcce8101c00 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.988+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fccd801a020 con 0x7fcce8101c00 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.988+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce8108f30 con 0x7fcce8101c00 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.988+0000 7fcce4ff9640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fccd00394d0 0x7fccd003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.988+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fccd804c100 con 0x7fcce8101c00 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.988+0000 7fcce6ffd640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fccd00394d0 0x7fccd003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:09.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.989+0000 7fcce6ffd640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fccd00394d0 0x7fccd003b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fccdc006010 tx=0x7fccdc031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:09.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:09.993+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fccd8021070 con 0x7fcce8101c00 2024-09-19T08:56:10.089 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:09 smithi022 systemd[1]: Starting Ceph mgr.y for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T08:56:10.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:10.178+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcce8062630 con 0x7fccd00394d0 2024-09-19T08:56:10.355 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:10.028+0000 7fa9f17d0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:56:10.355 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:10.097+0000 7fa9f17d0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:56:10.396 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 podman[36458]: 2024-09-19 08:56:10.089528292 +0000 UTC m=+0.105046496 container create 0f323c73707c0487709da5effceb5a16247bb8d296a09eade72e1d51ac49cf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T08:56:10.397 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 podman[36458]: 2024-09-19 08:56:10.00066414 +0000 UTC m=+0.016182314 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:56:10.397 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 podman[36458]: 2024-09-19 08:56:10.266742973 +0000 UTC m=+0.282261138 container init 0f323c73707c0487709da5effceb5a16247bb8d296a09eade72e1d51ac49cf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T08:56:10.397 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 podman[36458]: 2024-09-19 08:56:10.269425214 +0000 UTC m=+0.284943376 container start 0f323c73707c0487709da5effceb5a16247bb8d296a09eade72e1d51ac49cf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:56:10.397 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mgr[36477]: -- 172.21.15.22:0/2766509752 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55833710d0e0 con 0x5583370ea800 2024-09-19T08:56:10.397 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 bash[36458]: 0f323c73707c0487709da5effceb5a16247bb8d296a09eade72e1d51ac49cf88 2024-09-19T08:56:10.397 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 systemd[1]: Started Ceph mgr.y for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T08:56:10.397 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:10.396+0000 7f3896560040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:56:10.687 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:10.458+0000 7f3896560040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:56:10.687 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:10.617+0000 7f3896560040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:56:10.687 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:10.687+0000 7f3896560040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:56:10.958 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:10.853+0000 7f3896560040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.146 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:11.147 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:10.872+0000 7fa9f17d0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:56:11.147 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:10.995+0000 7fa9f17d0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:56:11.147 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.145+0000 7fa9f17d0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:56:11.227 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:11.008+0000 7f3896560040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:56:11.227 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:11.227 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:11.227 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:11.227 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:11.227 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:11.227 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.227 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.228 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.228 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.228 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:11.439 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.213+0000 7fa9f17d0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:56:11.439 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.368+0000 7fa9f17d0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:56:11.439 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.439+0000 7fa9f17d0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:56:11.605 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:11.342+0000 7f3896560040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:56:11.606 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:11.406+0000 7f3896560040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:56:11.606 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:11.605+0000 7f3896560040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:56:11.740 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.501+0000 7fa9f17d0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:56:11.740 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.671+0000 7fa9f17d0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:56:11.740 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.740+0000 7fa9f17d0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:56:12.016 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.808+0000 7fa9f17d0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:56:12.016 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.894+0000 7fa9f17d0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:56:12.016 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:11.955+0000 7fa9f17d0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:56:12.017 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:12.016+0000 7fa9f17d0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:12.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:12.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:12.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:12 smithi001 ceph-mon[30939]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T08:56:12.958 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:12.534+0000 7f3896560040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:56:12.958 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:12.604+0000 7f3896560040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:56:12.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:12 smithi022 ceph-mon[35107]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T08:56:13.105 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z[36985]: 2024-09-19T08:56:12.842+0000 7fa9f17d0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:56:13.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:12 smithi064 ceph-mon[35179]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T08:56:13.619 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:13.365+0000 7f3896560040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:56:13.620 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:13.484+0000 7f3896560040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:56:13.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:13.707+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7fccd800f980 con 0x7fcce8101c00 2024-09-19T08:56:13.928 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:13.635+0000 7f3896560040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:56:13.928 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:13.699+0000 7f3896560040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:56:13.928 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:13.856+0000 7f3896560040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:56:13.928 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:13.927+0000 7f3896560040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:56:13.928 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4283077542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]: dispatch 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]: dispatch 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]': finished 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: Standby manager daemon z started 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:56:13.929 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4173961149' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4283077542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]: dispatch 2024-09-19T08:56:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]: dispatch 2024-09-19T08:56:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]': finished 2024-09-19T08:56:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:56:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: Standby manager daemon z started 2024-09-19T08:56:14.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:56:14.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:56:14.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:56:14.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:56:14.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:13 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4173961149' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:14.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:14.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4283077542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]: dispatch 2024-09-19T08:56:14.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]: dispatch 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5c346b8-5301-4325-8c5d-24bfdb5ac836"}]': finished 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: Standby manager daemon z started 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='mgr.? 172.21.15.64:0/1403024864' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:56:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:13 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4173961149' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:14.208 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:13.989+0000 7f3896560040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:56:14.208 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:14.154+0000 7f3896560040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:56:14.500 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:14.222+0000 7f3896560040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:56:14.500 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:14.290+0000 7f3896560040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:56:14.500 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:14.376+0000 7f3896560040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:56:14.501 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:14.438+0000 7f3896560040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:56:14.501 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:14.499+0000 7f3896560040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:56:14.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:14 smithi022 ceph-mon[35107]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:56:14.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:14 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:56:15.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:14 smithi001 ceph-mon[30939]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:56:15.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:56:15.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:14 smithi064 ceph-mon[35179]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T08:56:15.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:14 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:56:15.708 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 08:56:15 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y[36473]: 2024-09-19T08:56:15.328+0000 7f3896560040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:56:15.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:15.906+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fccd8010460 con 0x7fcce8101c00 2024-09-19T08:56:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:15 smithi001 ceph-mon[30939]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:15 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:15 smithi001 ceph-mon[30939]: Standby manager daemon y started 2024-09-19T08:56:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:15 smithi001 ceph-mon[30939]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:56:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:15 smithi001 ceph-mon[30939]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:56:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:15 smithi001 ceph-mon[30939]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:56:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:15 smithi001 ceph-mon[30939]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:56:16.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:15 smithi064 ceph-mon[35179]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:16.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:15 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:16.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:15 smithi064 ceph-mon[35179]: Standby manager daemon y started 2024-09-19T08:56:16.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:15 smithi064 ceph-mon[35179]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:56:16.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:15 smithi064 ceph-mon[35179]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:56:16.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:15 smithi064 ceph-mon[35179]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:56:16.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:15 smithi064 ceph-mon[35179]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:56:16.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:15 smithi022 ceph-mon[35107]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:16.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:15 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:16.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:15 smithi022 ceph-mon[35107]: Standby manager daemon y started 2024-09-19T08:56:16.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:15 smithi022 ceph-mon[35107]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:56:16.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:15 smithi022 ceph-mon[35107]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:56:16.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:15 smithi022 ceph-mon[35107]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:56:16.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:15 smithi022 ceph-mon[35107]: from='mgr.? 172.21.15.22:0/9558087' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:56:17.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:16 smithi022 ceph-mon[35107]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:17.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:16 smithi022 ceph-mon[35107]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:56:17.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:16 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:56:17.297 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:16 smithi001 ceph-mon[30939]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:17.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:16 smithi001 ceph-mon[30939]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:56:17.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:16 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:56:17.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:16 smithi064 ceph-mon[35179]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:17.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:16 smithi064 ceph-mon[35179]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T08:56:17.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:16 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:56:19.157 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:18 smithi064 ceph-mon[35179]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:19.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:18 smithi022 ceph-mon[35107]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:19.297 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:18 smithi001 ceph-mon[30939]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:21.506 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:21 smithi001 ceph-mon[30939]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:21.506 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:21 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:21.506 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:21 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:21.506 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:21 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:21.506 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:21 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:21.506 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:21 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:21.506 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:21 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:21.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:21 smithi022 ceph-mon[35107]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:21.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:21 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:21.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:21 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:21.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:21 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:21.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:21 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:21.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:21 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:21.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:21 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:21.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:21 smithi064 ceph-mon[35179]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:21.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:21 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:21.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:21 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:21.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:21 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:21.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:21 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:21.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:21 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:21.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:21 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:22.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:56:22.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:22.715 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:56:22.715 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:22.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:56:22.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:23 smithi001 ceph-mon[30939]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:23 smithi001 ceph-mon[30939]: Deploying daemon osd.0 on smithi001 2024-09-19T08:56:23.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:23 smithi022 ceph-mon[35107]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:23.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:23 smithi022 ceph-mon[35107]: Deploying daemon osd.0 on smithi001 2024-09-19T08:56:23.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:23 smithi064 ceph-mon[35179]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:23.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:23 smithi064 ceph-mon[35179]: Deploying daemon osd.0 on smithi001 2024-09-19T08:56:25.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:25 smithi022 ceph-mon[35107]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:25.760 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:25 smithi001 ceph-mon[30939]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:25.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:25 smithi064 ceph-mon[35179]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:27.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:27 smithi022 ceph-mon[35107]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:27.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:27 smithi001 ceph-mon[30939]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:27.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:27 smithi064 ceph-mon[35179]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:29 smithi001 ceph-mon[30939]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:29 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:29 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:29 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:29.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:29 smithi064 ceph-mon[35179]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:29.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:29 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:29.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:29 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:29.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:29 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:29.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:29 smithi022 ceph-mon[35107]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:29.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:29 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:29.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:29 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:29.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:29 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:31 smithi001 ceph-mon[30939]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:31.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:31.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:31.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:31 smithi064 ceph-mon[35179]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:31.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:31.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:31.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:31 smithi022 ceph-mon[35107]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:31.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:31.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:31.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:31.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:32.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.914+0000 7fcce4ff9640 1 -- 172.21.15.1:0/1681874027 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcce8062630 con 0x7fccd00394d0 2024-09-19T08:56:32.914 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 0 on host 'smithi001' 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fccd00394d0 msgr2=0x7fccd003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fccd00394d0 0x7fccd003b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fccdc006010 tx=0x7fccdc031640 comp rx=0 tx=0).stop 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8101c00 msgr2=0x7fcce8075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8101c00 0x7fcce8075f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fccd800d950 tx=0x7fccd800de10 comp rx=0 tx=0).stop 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 shutdown_connections 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcce81037c0 0x7fcce8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fccd00394d0 0x7fccd003b990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcce8102e00 0x7fcce80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 --2- 172.21.15.1:0/1681874027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcce8101c00 0x7fcce8075f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:32.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 >> 172.21.15.1:0/1681874027 conn(0x7fcce80fd390 msgr2=0x7fcce8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:32.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 shutdown_connections 2024-09-19T08:56:32.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:56:32.917+0000 7fccedcaa640 1 -- 172.21.15.1:0/1681874027 wait complete. 2024-09-19T08:56:33.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:33 smithi001 ceph-mon[30939]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:33.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:33 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:33.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:33 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:33.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:33 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:33.515 DEBUG:teuthology.orchestra.run.smithi001:osd.0> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T08:56:33.518 INFO:tasks.cephadm:Deploying osd.1 on smithi022 with /dev/vg_nvme/lv_4... 2024-09-19T08:56:33.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:56:33.764 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:56:33.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:33 smithi064 ceph-mon[35179]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:33.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:33 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:33.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:33 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:33.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:33 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:33.885 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:33 smithi022 ceph-mon[35107]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:33.885 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:33 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:33.885 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:33 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:33.885 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:33 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:35.042 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:56:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0[44801]: 2024-09-19T08:56:34.956+0000 7f3113de0640 -1 osd.0 0 log_to_monitors true 2024-09-19T08:56:35.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:35 smithi022 ceph-mon[35107]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:35.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:35 smithi022 ceph-mon[35107]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:56:35.783 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:35 smithi001 ceph-mon[30939]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:35.783 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:35 smithi001 ceph-mon[30939]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:56:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:35 smithi064 ceph-mon[35179]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:35 smithi064 ceph-mon[35179]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:56:36.100 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:56:36.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2024-09-19T08:56:36.382 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:56:36.672 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:56:36.672 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:56:36.672 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:56:36.672 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:36.672 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:56:36.673 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:36.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:56:36.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:56:36.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:56:36.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:36.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:36.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:36.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:36.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:56:36.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:56:36.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:36.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:56:36.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:56:36.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:56:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:36.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 -- 172.21.15.22:0/3896674211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60102690 msgr2=0x7f2f60108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:36.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 --2- 172.21.15.22:0/3896674211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60102690 0x7f2f60108f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009ca0 tx=0x7f2f5802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 -- 172.21.15.22:0/3896674211 shutdown_connections 2024-09-19T08:56:36.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 --2- 172.21.15.22:0/3896674211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60102690 0x7f2f60108f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 --2- 172.21.15.22:0/3896674211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f60101cd0 0x7f2f60102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 --2- 172.21.15.22:0/3896674211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f60100ad0 0x7f2f60100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 -- 172.21.15.22:0/3896674211 >> 172.21.15.22:0/3896674211 conn(0x7f2f600fc280 msgr2=0x7f2f600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:36.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 -- 172.21.15.22:0/3896674211 shutdown_connections 2024-09-19T08:56:36.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.878+0000 7f2f68415640 1 -- 172.21.15.22:0/3896674211 wait complete. 2024-09-19T08:56:36.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f68415640 1 Processor -- start 2024-09-19T08:56:36.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f68415640 1 -- start start 2024-09-19T08:56:36.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f68415640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:36.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f68415640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:36.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f68415640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f68415640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6010c880 con 0x7f2f60100ad0 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f68415640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6010c700 con 0x7f2f60101cd0 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f68415640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6010ca00 con 0x7f2f60102690 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f659b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f659b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55710/0 (socket says 172.21.15.22:55710) 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f659b0640 1 -- 172.21.15.22:0/864350652 learned_addr learned my addr 172.21.15.22:0/864350652 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f661b1640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f669b2640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f659b0640 1 -- 172.21.15.22:0/864350652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f60102690 msgr2=0x7f2f601035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f659b0640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f659b0640 1 -- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f60100ad0 msgr2=0x7f2f60104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f659b0640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.879+0000 7f2f659b0640 1 -- 172.21.15.22:0/864350652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f60103eb0 con 0x7f2f60101cd0 2024-09-19T08:56:36.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.880+0000 7f2f669b2640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:36.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.880+0000 7f2f659b0640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000e9f0 tx=0x7f2f5000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:36.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.880+0000 7f2f577fe640 1 -- 172.21.15.22:0/864350652 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000cd80 con 0x7f2f60101cd0 2024-09-19T08:56:36.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.880+0000 7f2f577fe640 1 -- 172.21.15.22:0/864350652 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f50010930 con 0x7f2f60101cd0 2024-09-19T08:56:36.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.880+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f601a20c0 con 0x7f2f60101cd0 2024-09-19T08:56:36.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.880+0000 7f2f577fe640 1 -- 172.21.15.22:0/864350652 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50018b00 con 0x7f2f60101cd0 2024-09-19T08:56:36.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.880+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f601a25d0 con 0x7f2f60101cd0 2024-09-19T08:56:36.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.881+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f601a2800 con 0x7f2f60101cd0 2024-09-19T08:56:36.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.882+0000 7f2f577fe640 1 -- 172.21.15.22:0/864350652 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f2f50018ca0 con 0x7f2f60101cd0 2024-09-19T08:56:36.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.883+0000 7f2f577fe640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2f4c0a3230 0x7f2f4c0a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:36.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.883+0000 7f2f577fe640 1 -- 172.21.15.22:0/864350652 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f2f500ce320 con 0x7f2f60101cd0 2024-09-19T08:56:36.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.883+0000 7f2f661b1640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2f4c0a3230 0x7f2f4c0a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:36.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.884+0000 7f2f661b1640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2f4c0a3230 0x7f2f4c0a56f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c005fd0 tx=0x7f2f5c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:36.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:36.887+0000 7f2f577fe640 1 -- 172.21.15.22:0/864350652 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f5009cbd0 con 0x7f2f60101cd0 2024-09-19T08:56:37.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:37.071+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2f600fe470 con 0x7f2f4c0a3230 2024-09-19T08:56:37.494 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0[44801]: 2024-09-19T08:56:37.148+0000 7f3110577640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T08:56:37.495 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0[44801]: 2024-09-19T08:56:37.151+0000 7f3107b72640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:56:37.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:37.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi001 2024-09-19T08:56:37.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T08:56:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' 2024-09-19T08:56:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi001 2024-09-19T08:56:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T08:56:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:37.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' 2024-09-19T08:56:37.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:37.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi001 2024-09-19T08:56:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T08:56:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:56:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:56:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: from='osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053]' entity='osd.0' 2024-09-19T08:56:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:38.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:38 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:56:38.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:38 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:56:38.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:38 smithi022 ceph-mon[35107]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:38.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:38 smithi022 ceph-mon[35107]: osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] boot 2024-09-19T08:56:38.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:38 smithi022 ceph-mon[35107]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:56:38.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:38 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:38.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:38 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:56:38.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:38 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:56:38.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:38 smithi001 ceph-mon[30939]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:38.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:38 smithi001 ceph-mon[30939]: osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] boot 2024-09-19T08:56:38.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:38 smithi001 ceph-mon[30939]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:56:38.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:38 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:38.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:38 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:56:38.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:38 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:56:38.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:38 smithi064 ceph-mon[35179]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:56:38.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:38 smithi064 ceph-mon[35179]: osd.0 [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] boot 2024-09-19T08:56:38.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:38 smithi064 ceph-mon[35179]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:56:38.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:38 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:56:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:39 smithi001 ceph-mon[30939]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:39 smithi001 ceph-mon[30939]: from='client.? 172.21.15.22:0/20862608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]: dispatch 2024-09-19T08:56:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:39 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]: dispatch 2024-09-19T08:56:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:39 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]': finished 2024-09-19T08:56:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:39 smithi001 ceph-mon[30939]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T08:56:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:39.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:39 smithi064 ceph-mon[35179]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:39 smithi064 ceph-mon[35179]: from='client.? 172.21.15.22:0/20862608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]: dispatch 2024-09-19T08:56:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:39 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]: dispatch 2024-09-19T08:56:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:39 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]': finished 2024-09-19T08:56:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:39 smithi064 ceph-mon[35179]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T08:56:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:39.957 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:39 smithi022 ceph-mon[35107]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:56:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:39 smithi022 ceph-mon[35107]: from='client.? 172.21.15.22:0/20862608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]: dispatch 2024-09-19T08:56:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:39 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]: dispatch 2024-09-19T08:56:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:39 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "577de251-29ca-43bb-bfa9-62d8edcf7606"}]': finished 2024-09-19T08:56:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:39 smithi022 ceph-mon[35107]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T08:56:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:56:40.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:40 smithi001 ceph-mon[30939]: from='client.? 172.21.15.22:0/1333028036' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:40.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:40 smithi064 ceph-mon[35179]: from='client.? 172.21.15.22:0/1333028036' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:40.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:40 smithi022 ceph-mon[35107]: from='client.? 172.21.15.22:0/1333028036' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:56:41.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:41 smithi001 ceph-mon[30939]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:41.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:41 smithi064 ceph-mon[35179]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:41.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:41 smithi022 ceph-mon[35107]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:43.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:43 smithi001 ceph-mon[30939]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:43.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:43 smithi064 ceph-mon[35179]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:43.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:43 smithi022 ceph-mon[35107]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:45.784 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:45 smithi022 ceph-mon[35107]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:45.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:45 smithi001 ceph-mon[30939]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:45.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:45 smithi064 ceph-mon[35179]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:47.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:47 smithi022 ceph-mon[35107]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:47.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:47 smithi001 ceph-mon[30939]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:47.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:47 smithi064 ceph-mon[35179]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:48.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:56:48.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:48.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:48 smithi001 ceph-mon[30939]: Deploying daemon osd.1 on smithi022 2024-09-19T08:56:48.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:56:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:48 smithi064 ceph-mon[35179]: Deploying daemon osd.1 on smithi022 2024-09-19T08:56:48.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:56:48.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:48.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:48 smithi022 ceph-mon[35107]: Deploying daemon osd.1 on smithi022 2024-09-19T08:56:49.597 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:49 smithi022 ceph-mon[35107]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:49.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:49 smithi001 ceph-mon[30939]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:49.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:49 smithi064 ceph-mon[35179]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:51 smithi001 ceph-mon[30939]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:51.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:51 smithi064 ceph-mon[35179]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:51.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:51 smithi022 ceph-mon[35107]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:53.690 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:53 smithi022 ceph-mon[35107]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:53.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:53 smithi001 ceph-mon[30939]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:53.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:53 smithi064 ceph-mon[35179]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:54.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:54 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:54.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:54 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:54.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:54 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:54.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:54 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:54.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:54 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:54.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:54 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:54.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:54 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:54.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:54 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:54.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:54 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:55.685 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:55 smithi022 ceph-mon[35107]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:55.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:55 smithi001 ceph-mon[30939]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:55.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:55 smithi064 ceph-mon[35179]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:57.823 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:57 smithi022 ceph-mon[35107]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:57.824 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:57.824 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:57.824 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:57.824 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:57.824 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:57.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:57 smithi064 ceph-mon[35179]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:57.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:57.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:57 smithi001 ceph-mon[30939]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.162+0000 7f2f577fe640 1 -- 172.21.15.22:0/864350652 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2f600fe470 con 0x7f2f4c0a3230 2024-09-19T08:56:58.162 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 1 on host 'smithi022' 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2f4c0a3230 msgr2=0x7f2f4c0a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2f4c0a3230 0x7f2f4c0a56f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c005fd0 tx=0x7f2f5c00b410 comp rx=0 tx=0).stop 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60101cd0 msgr2=0x7f2f601030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000e9f0 tx=0x7f2f5000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 shutdown_connections 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2f4c0a3230 0x7f2f4c0a56f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f60102690 0x7f2f601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f60101cd0 0x7f2f601030b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 --2- 172.21.15.22:0/864350652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f60100ad0 0x7f2f60104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 >> 172.21.15.22:0/864350652 conn(0x7f2f600fc280 msgr2=0x7f2f600fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:58.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 shutdown_connections 2024-09-19T08:56:58.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:56:58.165+0000 7f2f68415640 1 -- 172.21.15.22:0/864350652 wait complete. 2024-09-19T08:56:58.706 DEBUG:teuthology.orchestra.run.smithi022:osd.1> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T08:56:58.709 INFO:tasks.cephadm:Deploying osd.2 on smithi064 with /dev/vg_nvme/lv_4... 2024-09-19T08:56:58.709 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:56:58.730 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:58.730 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:58.730 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:58.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:58.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:58.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:58.968 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:56:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:56:59.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:56:59 smithi064 ceph-mon[35179]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:56:59.871 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:56:59 smithi022 ceph-mon[35107]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:57:00.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:56:59 smithi001 ceph-mon[30939]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:57:00.458 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:00 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1[39569]: 2024-09-19T08:57:00.347+0000 7f6c33648640 -1 osd.1 0 log_to_monitors true 2024-09-19T08:57:00.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:00 smithi001 ceph-mon[30939]: from='osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:57:00.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:00 smithi001 ceph-mon[30939]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:57:00.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:00 smithi064 ceph-mon[35179]: from='osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:57:00.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:00 smithi064 ceph-mon[35179]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:57:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:00 smithi022 ceph-mon[35107]: from='osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:57:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:00 smithi022 ceph-mon[35107]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:57:01.367 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:57:01.438 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_4 2024-09-19T08:57:01.687 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:57:01.807 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:01.808 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:01.958 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1[39569]: 2024-09-19T08:57:01.605+0000 7f6c2eda8640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:57:01.958 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1[39569]: 2024-09-19T08:57:01.609+0000 7f6c2b3e2640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:02.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:02.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:02.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:02.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3392340321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 msgr2=0x7f7c38103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3392340321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 0x7f7c38103280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009900 tx=0x7f7c2c02a410 comp rx=0 tx=0).stop 2024-09-19T08:57:02.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3392340321 shutdown_connections 2024-09-19T08:57:02.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3392340321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c381037c0 0x7f7c3810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3392340321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 0x7f7c38103280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3392340321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c38101c00 0x7f7c38102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3392340321 >> 172.21.15.64:0/3392340321 conn(0x7f7c380fd3b0 msgr2=0x7f7c380ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3392340321 shutdown_connections 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.252+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3392340321 wait complete. 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.253+0000 7f7c3d9d2640 1 Processor -- start 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.253+0000 7f7c3d9d2640 1 -- start start 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.253+0000 7f7c3d9d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c38101c00 0x7f7c38075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.253+0000 7f7c3d9d2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 0x7f7c380745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.253+0000 7f7c3d9d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c381037c0 0x7f7c38074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.253+0000 7f7c3d9d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3810d9c0 con 0x7f7c38101c00 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.253+0000 7f7c3d9d2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3810d840 con 0x7f7c381037c0 2024-09-19T08:57:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.253+0000 7f7c3d9d2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3810db40 con 0x7f7c38102e00 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 0x7f7c380745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 0x7f7c380745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:55508/0 (socket says 172.21.15.64:55508) 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 -- 172.21.15.64:0/3625713090 learned_addr learned my addr 172.21.15.64:0/3625713090 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c377fe640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c381037c0 0x7f7c38074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c36ffd640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c38101c00 0x7f7c38075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 -- 172.21.15.64:0/3625713090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c381037c0 msgr2=0x7f7c38074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c381037c0 0x7f7c38074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 -- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c38101c00 msgr2=0x7f7c38075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c38101c00 0x7f7c38075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 -- 172.21.15.64:0/3625713090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c380753e0 con 0x7f7c38102e00 2024-09-19T08:57:02.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c367fc640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 0x7f7c380745e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009a20 tx=0x7f7c2c004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c3c9d0640 1 -- 172.21.15.64:0/3625713090 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c03f030 con 0x7f7c38102e00 2024-09-19T08:57:02.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c381a2070 con 0x7f7c38102e00 2024-09-19T08:57:02.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.254+0000 7f7c3c9d0640 1 -- 172.21.15.64:0/3625713090 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c2c003d00 con 0x7f7c38102e00 2024-09-19T08:57:02.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.255+0000 7f7c3c9d0640 1 -- 172.21.15.64:0/3625713090 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c035070 con 0x7f7c38102e00 2024-09-19T08:57:02.257 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.255+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c381a2520 con 0x7f7c38102e00 2024-09-19T08:57:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.255+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c38108f30 con 0x7f7c38102e00 2024-09-19T08:57:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.257+0000 7f7c3c9d0640 1 -- 172.21.15.64:0/3625713090 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f7c2c042030 con 0x7f7c38102e00 2024-09-19T08:57:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.258+0000 7f7c3c9d0640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c200a31b0 0x7f7c200a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.258+0000 7f7c3c9d0640 1 -- 172.21.15.64:0/3625713090 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7f7c2c0eebb0 con 0x7f7c38102e00 2024-09-19T08:57:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.258+0000 7f7c36ffd640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c200a31b0 0x7f7c200a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.258 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.259+0000 7f7c36ffd640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c200a31b0 0x7f7c200a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c38102c60 tx=0x7f7c2800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.261 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.261+0000 7f7c3c9d0640 1 -- 172.21.15.64:0/3625713090 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c2c049030 con 0x7f7c38102e00 2024-09-19T08:57:02.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:02.445+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7c38062630 con 0x7f7c200a31b0 2024-09-19T08:57:02.850 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi022 2024-09-19T08:57:02.851 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-19T08:57:02.851 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:57:02.851 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:57:02.851 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:02.851 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:02.851 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:02.851 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:02.851 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:02.913 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi022 2024-09-19T08:57:02.913 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-19T08:57:02.913 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:57:02.913 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:57:02.913 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:02.913 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:02.914 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:02.914 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:02.914 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:03.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi022 2024-09-19T08:57:03.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-19T08:57:03.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:57:03.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:57:03.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:03.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:03.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:03.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:03.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:03.890 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:03 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:57:03.890 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:03 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:57:03.890 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:03 smithi064 ceph-mon[35179]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:57:03.890 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:03 smithi064 ceph-mon[35179]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:03.890 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:03 smithi064 ceph-mon[35179]: osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] boot 2024-09-19T08:57:03.890 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:03 smithi064 ceph-mon[35179]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T08:57:03.891 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:03 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:03.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:03 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:57:03.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:03 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:57:03.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:03 smithi022 ceph-mon[35107]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:57:03.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:03 smithi022 ceph-mon[35107]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:03.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:03 smithi022 ceph-mon[35107]: osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] boot 2024-09-19T08:57:03.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:03 smithi022 ceph-mon[35107]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T08:57:03.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:03 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:03 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:57:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:03 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:57:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:03 smithi001 ceph-mon[30939]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:57:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:03 smithi001 ceph-mon[30939]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:03 smithi001 ceph-mon[30939]: osd.1 [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] boot 2024-09-19T08:57:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:03 smithi001 ceph-mon[30939]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T08:57:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:03 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:57:04.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:04 smithi064 ceph-mon[35179]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:57:04.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:04 smithi022 ceph-mon[35107]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:57:05.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:04 smithi001 ceph-mon[30939]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:57:05.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:05 smithi064 ceph-mon[35179]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:05.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:05 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/1375451965' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]: dispatch 2024-09-19T08:57:05.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:05 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]: dispatch 2024-09-19T08:57:05.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:05 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]': finished 2024-09-19T08:57:05.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:05 smithi064 ceph-mon[35179]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:57:05.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:05 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:05.866 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:05 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/1947891160' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:05.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:05 smithi022 ceph-mon[35107]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:05.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:05 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/1375451965' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]: dispatch 2024-09-19T08:57:05.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:05 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]: dispatch 2024-09-19T08:57:05.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:05 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]': finished 2024-09-19T08:57:05.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:05 smithi022 ceph-mon[35107]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:57:05.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:05 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:05.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:05 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/1947891160' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:06.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:05 smithi001 ceph-mon[30939]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:06.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:05 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/1375451965' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]: dispatch 2024-09-19T08:57:06.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:05 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]: dispatch 2024-09-19T08:57:06.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:05 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08408ff4-bdd7-41e5-9ebd-6bbfdc17c155"}]': finished 2024-09-19T08:57:06.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:05 smithi001 ceph-mon[30939]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T08:57:06.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:05 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:06.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:05 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/1947891160' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:07.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:07 smithi022 ceph-mon[35107]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:07 smithi001 ceph-mon[30939]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:08.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:07 smithi064 ceph-mon[35179]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:09.936 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:09 smithi064 ceph-mon[35179]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:09.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:09 smithi022 ceph-mon[35107]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:09 smithi001 ceph-mon[30939]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:11.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:11 smithi064 ceph-mon[35179]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:11.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:11 smithi022 ceph-mon[35107]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:12.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:11 smithi001 ceph-mon[30939]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:13.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:13 smithi022 ceph-mon[35107]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:13.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:57:13.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:13.993 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:13 smithi064 ceph-mon[35179]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:13.993 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:57:13.993 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:14.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:13 smithi001 ceph-mon[30939]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:57:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:14.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:14 smithi022 ceph-mon[35107]: Deploying daemon osd.2 on smithi064 2024-09-19T08:57:15.008 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:14 smithi064 ceph-mon[35179]: Deploying daemon osd.2 on smithi064 2024-09-19T08:57:15.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:14 smithi001 ceph-mon[30939]: Deploying daemon osd.2 on smithi064 2024-09-19T08:57:15.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:15 smithi022 ceph-mon[35107]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:15 smithi001 ceph-mon[30939]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:16.055 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:15 smithi064 ceph-mon[35179]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:17.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:17 smithi022 ceph-mon[35107]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:18.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:17 smithi001 ceph-mon[30939]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:17 smithi064 ceph-mon[35179]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:19.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:19 smithi022 ceph-mon[35107]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:20.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:19 smithi001 ceph-mon[30939]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:20.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:19 smithi064 ceph-mon[35179]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:20.775 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:20 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:20.775 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:20 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:20.775 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:20 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:20 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:20 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:20 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:21.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:20 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:21.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:20 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:21.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:20 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:22.110 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:21 smithi064 ceph-mon[35179]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:22.145 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:21 smithi022 ceph-mon[35107]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:22.308 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:21 smithi001 ceph-mon[30939]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:23.384 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:23 smithi064 ceph-mon[35179]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:23.384 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:23.384 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:23.384 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:23.384 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:23.384 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.424+0000 7f7c3c9d0640 1 -- 172.21.15.64:0/3625713090 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7c38062630 con 0x7f7c200a31b0 2024-09-19T08:57:23.425 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 2 on host 'smithi064' 2024-09-19T08:57:23.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.426+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c200a31b0 msgr2=0x7f7c200a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.426+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c200a31b0 0x7f7c200a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c38102c60 tx=0x7f7c2800b390 comp rx=0 tx=0).stop 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.426+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 msgr2=0x7f7c380745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.426+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 0x7f7c380745e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009a20 tx=0x7f7c2c004430 comp rx=0 tx=0).stop 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.427+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 shutdown_connections 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.427+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c381037c0 0x7f7c38074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.427+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c200a31b0 0x7f7c200a5670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.427+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c38102e00 0x7f7c380745e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.427+0000 7f7c3d9d2640 1 --2- 172.21.15.64:0/3625713090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c38101c00 0x7f7c38075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.427+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 >> 172.21.15.64:0/3625713090 conn(0x7f7c380fd3b0 msgr2=0x7f7c38106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.427+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 shutdown_connections 2024-09-19T08:57:23.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:57:23.427+0000 7f7c3d9d2640 1 -- 172.21.15.64:0/3625713090 wait complete. 2024-09-19T08:57:23.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:23 smithi022 ceph-mon[35107]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:23.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:23.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:23.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:23.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:23.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:23 smithi001 ceph-mon[30939]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:24.063 DEBUG:teuthology.orchestra.run.smithi064:osd.2> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T08:57:24.106 INFO:tasks.cephadm:Deploying osd.3 on smithi001 with /dev/vg_nvme/lv_3... 2024-09-19T08:57:24.106 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:57:24.348 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:24 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:24.349 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:24 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:24.349 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:24 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:24.358 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:24.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:24 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:24.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:24 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:24.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:24 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:24.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:24 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:24.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:24 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:24.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:24 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:25.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:25 smithi001 ceph-mon[30939]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:25.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:25 smithi022 ceph-mon[35107]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:25.835 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:25 smithi064 ceph-mon[35179]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:26.105 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:25 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2[40169]: 2024-09-19T08:57:25.833+0000 7fd49432f640 -1 osd.2 0 log_to_monitors true 2024-09-19T08:57:26.620 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:26 smithi001 ceph-mon[30939]: from='osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:57:26.621 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:26 smithi001 ceph-mon[30939]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:57:26.649 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:26 smithi064 ceph-mon[35179]: from='osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:57:26.649 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:26 smithi064 ceph-mon[35179]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:57:26.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:26 smithi022 ceph-mon[35107]: from='osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:57:26.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:26 smithi022 ceph-mon[35107]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:57:26.809 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:57:26.841 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_3 2024-09-19T08:57:27.096 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:27.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:27.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:57:27.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:57:27.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:57:27.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:27.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:57:27.533 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi064 2024-09-19T08:57:27.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:27.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi064 to 17088M 2024-09-19T08:57:27.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:27.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:27.534 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 -- 172.21.15.1:0/1027570106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c1026c0 msgr2=0x7fda9c104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 --2- 172.21.15.1:0/1027570106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c1026c0 0x7fda9c104ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda98009900 tx=0x7fda9802a410 comp rx=0 tx=0).stop 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 -- 172.21.15.1:0/1027570106 shutdown_connections 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 --2- 172.21.15.1:0/1027570106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda9c107920 0x7fda9c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 --2- 172.21.15.1:0/1027570106 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda9c104ff0 0x7fda9c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 --2- 172.21.15.1:0/1027570106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c1026c0 0x7fda9c104ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 -- 172.21.15.1:0/1027570106 >> 172.21.15.1:0/1027570106 conn(0x7fda9c0fc280 msgr2=0x7fda9c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 -- 172.21.15.1:0/1027570106 shutdown_connections 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 -- 172.21.15.1:0/1027570106 wait complete. 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.544+0000 7fdaa3343640 1 Processor -- start 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa3343640 1 -- start start 2024-09-19T08:57:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa3343640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda9c1026c0 0x7fda9c198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa3343640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c104ff0 0x7fda9c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa3343640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda9c107920 0x7fda9c19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa3343640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c10d9b0 con 0x7fda9c104ff0 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa3343640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c10d830 con 0x7fda9c1026c0 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa3343640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c10db30 con 0x7fda9c107920 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c104ff0 0x7fda9c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c104ff0 0x7fda9c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59084/0 (socket says 172.21.15.1:59084) 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 -- 172.21.15.1:0/572323998 learned_addr learned my addr 172.21.15.1:0/572323998 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa18e0640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda9c107920 0x7fda9c19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa10df640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda9c1026c0 0x7fda9c198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 -- 172.21.15.1:0/572323998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda9c107920 msgr2=0x7fda9c19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda9c107920 0x7fda9c19f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 -- 172.21.15.1:0/572323998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda9c1026c0 msgr2=0x7fda9c198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda9c1026c0 0x7fda9c198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 -- 172.21.15.1:0/572323998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c19fc40 con 0x7fda9c104ff0 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa10df640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda9c1026c0 0x7fda9c198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.545+0000 7fdaa08de640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c104ff0 0x7fda9c198550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9f0 tx=0x7fda8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.546+0000 7fda927fc640 1 -- 172.21.15.1:0/572323998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00ccc0 con 0x7fda9c104ff0 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.546+0000 7fda927fc640 1 -- 172.21.15.1:0/572323998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda8c005520 con 0x7fda9c104ff0 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.546+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c19ff30 con 0x7fda9c104ff0 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.546+0000 7fda927fc640 1 -- 172.21.15.1:0/572323998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c010690 con 0x7fda9c104ff0 2024-09-19T08:57:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.546+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c1a0390 con 0x7fda9c104ff0 2024-09-19T08:57:27.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.547+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9c0fdd70 con 0x7fda9c104ff0 2024-09-19T08:57:27.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.548+0000 7fda927fc640 1 -- 172.21.15.1:0/572323998 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fda8c004f70 con 0x7fda9c104ff0 2024-09-19T08:57:27.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.549+0000 7fda927fc640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fda880a31e0 0x7fda880a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.549+0000 7fdaa10df640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fda880a31e0 0x7fda880a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.549+0000 7fda927fc640 1 -- 172.21.15.1:0/572323998 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fda8c0ce530 con 0x7fda9c104ff0 2024-09-19T08:57:27.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.549+0000 7fdaa10df640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fda880a31e0 0x7fda880a56a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda98000c00 tx=0x7fda98031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:27.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.553+0000 7fda927fc640 1 -- 172.21.15.1:0/572323998 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda8c09c9a0 con 0x7fda9c104ff0 2024-09-19T08:57:27.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:27.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:57:27.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:57:27.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi064 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi064 to 17088M 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:27.739+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fda9c062630 con 0x7fda880a31e0 2024-09-19T08:57:27.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi064 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi064 to 17088M 2024-09-19T08:57:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:27.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:27.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:27.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:28.605 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2[40169]: 2024-09-19T08:57:28.221+0000 7fd48fa8f640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:57:28.605 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2[40169]: 2024-09-19T08:57:28.230+0000 7fd4880c1640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:28 smithi064 ceph-mon[35179]: from='osd.2 ' entity='osd.2' 2024-09-19T08:57:28.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:57:28.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:57:28.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:28.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:28.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:28.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:28.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:28.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:28.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:28 smithi022 ceph-mon[35107]: from='osd.2 ' entity='osd.2' 2024-09-19T08:57:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:57:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:57:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:28 smithi001 ceph-mon[30939]: from='osd.2 ' entity='osd.2' 2024-09-19T08:57:29.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:29 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:57:29.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:29 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:57:29.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:29 smithi022 ceph-mon[35107]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:29.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:29 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:29.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:29 smithi022 ceph-mon[35107]: osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] boot 2024-09-19T08:57:29.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:29 smithi022 ceph-mon[35107]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:57:29.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:29 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:29.754 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:29 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:57:29.755 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:29 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:57:29.755 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:29 smithi001 ceph-mon[30939]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:29.755 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:29 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:29.755 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:29 smithi001 ceph-mon[30939]: osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] boot 2024-09-19T08:57:29.755 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:29 smithi001 ceph-mon[30939]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:57:29.755 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:29 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:29.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:29 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:57:29.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:29 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:57:29.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:29 smithi064 ceph-mon[35179]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:57:29.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:29 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:29.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:29 smithi064 ceph-mon[35179]: osd.2 [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] boot 2024-09-19T08:57:29.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:29 smithi064 ceph-mon[35179]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T08:57:29.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:29 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:57:30.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:30 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:30.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:30 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1899434227' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d782b6f-5fcf-4198-b8a9-cf4dc57f038a"}]: dispatch 2024-09-19T08:57:30.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:30 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:30.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:30 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1899434227' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d782b6f-5fcf-4198-b8a9-cf4dc57f038a"}]': finished 2024-09-19T08:57:30.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:30 smithi022 ceph-mon[35107]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T08:57:30.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:30 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:30.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:30 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:30.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:30 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:30.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:30 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1899434227' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d782b6f-5fcf-4198-b8a9-cf4dc57f038a"}]: dispatch 2024-09-19T08:57:30.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:30 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:30.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:30 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1899434227' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d782b6f-5fcf-4198-b8a9-cf4dc57f038a"}]': finished 2024-09-19T08:57:30.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:30 smithi001 ceph-mon[30939]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T08:57:30.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:30 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:30.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:30 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:30.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:30 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:30.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:30 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1899434227' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d782b6f-5fcf-4198-b8a9-cf4dc57f038a"}]: dispatch 2024-09-19T08:57:30.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:30 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:30.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:30 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1899434227' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d782b6f-5fcf-4198-b8a9-cf4dc57f038a"}]': finished 2024-09-19T08:57:30.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:30 smithi064 ceph-mon[35179]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T08:57:30.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:30 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:30.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:30 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:57:31.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:31 smithi022 ceph-mon[35107]: pgmap v77: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:31.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:31 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1830178105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:31.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:31.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:31 smithi022 ceph-mon[35107]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:57:31.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:31.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:31 smithi001 ceph-mon[30939]: pgmap v77: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:31.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:31 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1830178105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:31.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:31.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:31 smithi001 ceph-mon[30939]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:57:31.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:31.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:31 smithi064 ceph-mon[35179]: pgmap v77: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:31.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:31 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1830178105' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:31.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:57:31.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:31 smithi064 ceph-mon[35179]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T08:57:31.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:32.298 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:57:31 smithi001 sudo[49756]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:32.298 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:57:31 smithi001 sudo[49756]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:32.298 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:57:31 smithi001 sudo[49756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:32.298 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:57:31 smithi001 sudo[49756]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:32.455+0000 7fda927fc640 1 -- 172.21.15.1:0/572323998 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fda8c098910 con 0x7fda9c104ff0 2024-09-19T08:57:32.798 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:57:32 smithi001 sudo[50128]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:32.798 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:57:32 smithi001 sudo[50128]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:32.798 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:57:32 smithi001 sudo[50128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:32.798 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 08:57:32 smithi001 sudo[50128]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:32.930 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:32 smithi022 sudo[43450]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:32.930 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:32 smithi022 sudo[43450]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:32.930 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:32 smithi022 sudo[43450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:32.931 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:32 smithi022 sudo[43450]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:33.190 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:32 smithi022 sudo[43453]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:33.190 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:32 smithi022 sudo[43453]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:33.190 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:32 smithi022 sudo[43453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:33.191 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 08:57:32 smithi022 sudo[43453]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:33.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:33 smithi022 ceph-mon[35107]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:33.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:33 smithi022 ceph-mon[35107]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:57:33.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:33 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:33.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:33 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:33.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:33 smithi022 ceph-mon[35107]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:57:33.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:33 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:33.487 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:33 smithi064 sudo[43961]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:33.487 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:33 smithi064 sudo[43961]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:33.488 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:33 smithi064 sudo[43961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:33.488 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:33 smithi064 sudo[43961]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:33.488 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:33 smithi064 ceph-mon[35179]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:33.488 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:33 smithi064 ceph-mon[35179]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:57:33.488 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:33 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:33.488 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:33 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:33.488 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:33 smithi064 ceph-mon[35179]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:57:33.488 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:33 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:33.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 ceph-mon[30939]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:33.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 ceph-mon[30939]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T08:57:33.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:33.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:33.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 ceph-mon[30939]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:57:33.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:33.855 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:33 smithi064 sudo[43964]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:33.855 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:33 smithi064 sudo[43964]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:33.855 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:33 smithi064 sudo[43964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:33.856 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 08:57:33 smithi064 sudo[43964]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:34.297 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 sudo[50510]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 sudo[50510]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 sudo[50510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:33 smithi001 sudo[50510]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:34.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:34 smithi001 sudo[50701]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:34 smithi001 sudo[50701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:34 smithi001 sudo[50701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:34 smithi001 sudo[50701]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:34.942 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:34 smithi064 sudo[43967]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:34.942 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:34 smithi064 sudo[43967]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:34.943 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:34 smithi064 sudo[43967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:34.943 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:34 smithi064 sudo[43967]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:35.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:34 smithi064 sudo[43970]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:35.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:34 smithi064 sudo[43970]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:35.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:34 smithi064 sudo[43970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:35.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:34 smithi064 sudo[43970]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:35.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 sudo[43456]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:57:35.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 sudo[43456]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:35.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 sudo[43456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:35.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 sudo[43456]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:35.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:35.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:35.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:35.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:35.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:35.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:35.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 sudo[43459]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:57:35.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 sudo[43459]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 sudo[43459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 sudo[43459]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:36.792 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:36 smithi001 ceph-mon[30939]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:36.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:36 smithi001 ceph-mon[30939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:36.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:36 smithi001 ceph-mon[30939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:36.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:36 smithi001 ceph-mon[30939]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:36.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:36.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:36.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:36.793 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:36 smithi001 ceph-mon[30939]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:36.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:36 smithi064 ceph-mon[35179]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:36 smithi064 ceph-mon[35179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:36 smithi064 ceph-mon[35179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:36 smithi064 ceph-mon[35179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:36.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:36 smithi064 ceph-mon[35179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:36.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:36 smithi022 ceph-mon[35107]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:36.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:36 smithi022 ceph-mon[35107]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:36.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:36 smithi022 ceph-mon[35107]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:36.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:36 smithi022 ceph-mon[35107]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:57:36.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:57:36.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:57:36.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:57:36.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:36 smithi022 ceph-mon[35107]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:57:37.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:37 smithi001 ceph-mon[30939]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:37.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:37 smithi064 ceph-mon[35179]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:37.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:37 smithi022 ceph-mon[35107]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:39 smithi001 ceph-mon[30939]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:57:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:39.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:39 smithi001 ceph-mon[30939]: Deploying daemon osd.3 on smithi001 2024-09-19T08:57:39.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:39 smithi064 ceph-mon[35179]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:39.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:57:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:39 smithi064 ceph-mon[35179]: Deploying daemon osd.3 on smithi001 2024-09-19T08:57:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:39 smithi022 ceph-mon[35107]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:57:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:39 smithi022 ceph-mon[35107]: Deploying daemon osd.3 on smithi001 2024-09-19T08:57:41.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:41 smithi001 ceph-mon[30939]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T08:57:41.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:41 smithi064 ceph-mon[35179]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T08:57:41.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:41 smithi022 ceph-mon[35107]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T08:57:43.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:43 smithi001 ceph-mon[30939]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T08:57:43.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:43 smithi064 ceph-mon[35179]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T08:57:43.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:43 smithi022 ceph-mon[35107]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T08:57:45.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:45 smithi001 ceph-mon[30939]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:57:45.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:45.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:45.750 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:45.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:45 smithi064 ceph-mon[35179]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:57:45.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:45.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:45.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:45.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:45 smithi022 ceph-mon[35107]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T08:57:45.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:45.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:45.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:47.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:47 smithi001 ceph-mon[30939]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:47.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:47 smithi064 ceph-mon[35179]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:47.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:47 smithi022 ceph-mon[35107]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:48.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:48.901 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:48.901 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:48.901 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:48.901 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:48.901 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:48.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.946+0000 7fda927fc640 1 -- 172.21.15.1:0/572323998 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fda9c062630 con 0x7fda880a31e0 2024-09-19T08:57:48.947 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 3 on host 'smithi001' 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fda880a31e0 msgr2=0x7fda880a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fda880a31e0 0x7fda880a56a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda98000c00 tx=0x7fda98031640 comp rx=0 tx=0).stop 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c104ff0 msgr2=0x7fda9c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c104ff0 0x7fda9c198550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9f0 tx=0x7fda8c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 shutdown_connections 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fda880a31e0 0x7fda880a56a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda9c107920 0x7fda9c19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda9c104ff0 0x7fda9c198550 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 --2- 172.21.15.1:0/572323998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda9c1026c0 0x7fda9c198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 >> 172.21.15.1:0/572323998 conn(0x7fda9c0fc280 msgr2=0x7fda9c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 shutdown_connections 2024-09-19T08:57:48.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:57:48.949+0000 7fdaa3343640 1 -- 172.21.15.1:0/572323998 wait complete. 2024-09-19T08:57:48.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:48.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:48.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:48.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:48.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:49.610 DEBUG:teuthology.orchestra.run.smithi001:osd.3> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T08:57:49.612 INFO:tasks.cephadm:Deploying osd.4 on smithi022 with /dev/vg_nvme/lv_3... 2024-09-19T08:57:49.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:57:49.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:49 smithi064 ceph-mon[35179]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:49.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:49.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:49.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:49.874 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:57:49.938 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:49 smithi001 ceph-mon[30939]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:49.938 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:49.938 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:49.938 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:49.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:49 smithi022 ceph-mon[35107]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:49.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:49 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:49.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:49 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:49.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:49 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:51.363 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 08:57:51 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3[51742]: 2024-09-19T08:57:51.063+0000 7fcb05414640 -1 osd.3 0 log_to_monitors true 2024-09-19T08:57:51.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:51 smithi001 ceph-mon[30939]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:51 smithi001 ceph-mon[30939]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:57:51.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:51 smithi064 ceph-mon[35179]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:51.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:51 smithi064 ceph-mon[35179]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:57:51.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:51 smithi022 ceph-mon[35107]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T08:57:51.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:51 smithi022 ceph-mon[35107]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:57:52.289 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:57:52.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2024-09-19T08:57:52.579 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:57:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:57:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:57:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:57:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:52.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:52.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:52.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:52 smithi001 ceph-mon[30939]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:57:52.852 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:57:52.852 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:57:52.852 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:57:52.852 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:52.852 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.852 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.852 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:52.853 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:52.853 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.853 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:52.853 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:52.853 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.853 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:52 smithi022 ceph-mon[35107]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:57:52.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:57:52.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:57:52.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:57:52.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:57:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:52 smithi064 ceph-mon[35179]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:57:53.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 -- 172.21.15.22:0/3988330015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 msgr2=0x7fc3ac103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/3988330015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 0x7fc3ac103280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009900 tx=0x7fc39c02a410 comp rx=0 tx=0).stop 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 -- 172.21.15.22:0/3988330015 shutdown_connections 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/3988330015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3ac1037c0 0x7fc3ac10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/3988330015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 0x7fc3ac103280 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/3988330015 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3ac101c00 0x7fc3ac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 -- 172.21.15.22:0/3988330015 >> 172.21.15.22:0/3988330015 conn(0x7fc3ac0fd390 msgr2=0x7fc3ac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 -- 172.21.15.22:0/3988330015 shutdown_connections 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.026+0000 7fc3b1a51640 1 -- 172.21.15.22:0/3988330015 wait complete. 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3b1a51640 1 Processor -- start 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3b1a51640 1 -- start start 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3b1a51640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3ac101c00 0x7fc3ac197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3b1a51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 0x7fc3ac198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.040 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3b1a51640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3ac1037c0 0x7fc3ac19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3b1a51640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac10d9c0 con 0x7fc3ac101c00 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3b1a51640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac10d840 con 0x7fc3ac102e00 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3b1a51640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ac10db40 con 0x7fc3ac1037c0 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3aa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 0x7fc3ac198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3aa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 0x7fc3ac198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37482/0 (socket says 172.21.15.22:37482) 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3aa7fc640 1 -- 172.21.15.22:0/1963898599 learned_addr learned my addr 172.21.15.22:0/1963898599 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.027+0000 7fc3aaffd640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3ac101c00 0x7fc3ac197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3ab7fe640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3ac1037c0 0x7fc3ac19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3aa7fc640 1 -- 172.21.15.22:0/1963898599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3ac1037c0 msgr2=0x7fc3ac19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3aa7fc640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3ac1037c0 0x7fc3ac19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3aa7fc640 1 -- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3ac101c00 msgr2=0x7fc3ac197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3aa7fc640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3ac101c00 0x7fc3ac197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3aa7fc640 1 -- 172.21.15.22:0/1963898599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ac19fb80 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3aa7fc640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 0x7fc3ac198490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009a20 tx=0x7fc39c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3b0a4f640 1 -- 172.21.15.22:0/1963898599 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c03f030 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ac19fe10 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3b0a4f640 1 -- 172.21.15.22:0/1963898599 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc39c003d00 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3b0a4f640 1 -- 172.21.15.22:0/1963898599 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c035070 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.028+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ac1a0270 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.029+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ac108f30 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.030+0000 7fc3b0a4f640 1 -- 172.21.15.22:0/1963898599 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc39c042030 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.031+0000 7fc3b0a4f640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3940a3270 0x7fc3940a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.031+0000 7fc3b0a4f640 1 -- 172.21.15.22:0/1963898599 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7fc39c0eee40 con 0x7fc3ac102e00 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.031+0000 7fc3aaffd640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3940a3270 0x7fc3940a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.032+0000 7fc3aaffd640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3940a3270 0x7fc3940a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac102c60 tx=0x7fc3a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.038+0000 7fc3b0a4f640 1 -- 172.21.15.22:0/1963898599 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc39c0bc850 con 0x7fc3ac102e00 2024-09-19T08:57:53.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:57:53.226+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc3ac062630 con 0x7fc3940a3270 2024-09-19T08:57:53.604 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3[51742]: 2024-09-19T08:57:53.309+0000 7fcb00b74640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:57:53.604 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3[51742]: 2024-09-19T08:57:53.316+0000 7fcaf91a6640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:57:53.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:53.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi001 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] boot 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T08:57:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi001 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' 2024-09-19T08:57:53.893 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] boot 2024-09-19T08:57:53.894 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T08:57:53.894 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:57:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi001 2024-09-19T08:57:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T08:57:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:57:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:57:54.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:57:54.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:54.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: from='osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166]' entity='osd.3' 2024-09-19T08:57:54.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: osd.3 [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] boot 2024-09-19T08:57:54.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T08:57:54.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:57:54.928 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:54 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:57:54.928 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:54 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:57:54.928 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:54 smithi022 ceph-mon[35107]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:54.928 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:54 smithi022 ceph-mon[35107]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:57:55.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:54 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:57:55.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:54 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:57:55.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:54 smithi001 ceph-mon[30939]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:55.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:54 smithi001 ceph-mon[30939]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:57:55.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:54 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:57:55.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:54 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:57:55.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:54 smithi064 ceph-mon[35179]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:57:55.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:54 smithi064 ceph-mon[35179]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T08:57:55.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:55 smithi022 ceph-mon[35107]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:55.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:55 smithi022 ceph-mon[35107]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:57:56.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:55 smithi001 ceph-mon[30939]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:56.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:55 smithi001 ceph-mon[30939]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:57:56.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:55 smithi064 ceph-mon[35179]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:56.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:55 smithi064 ceph-mon[35179]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:57:56.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:56 smithi022 ceph-mon[35107]: from='client.? 172.21.15.22:0/3815509655' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]: dispatch 2024-09-19T08:57:56.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:56 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]: dispatch 2024-09-19T08:57:56.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:56 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]': finished 2024-09-19T08:57:56.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:56 smithi022 ceph-mon[35107]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T08:57:56.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:57:56.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:56 smithi022 ceph-mon[35107]: from='client.? 172.21.15.22:0/1815547868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:57.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:56 smithi001 ceph-mon[30939]: from='client.? 172.21.15.22:0/3815509655' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]: dispatch 2024-09-19T08:57:57.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:56 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]: dispatch 2024-09-19T08:57:57.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:56 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]': finished 2024-09-19T08:57:57.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:56 smithi001 ceph-mon[30939]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T08:57:57.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:57:57.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:56 smithi001 ceph-mon[30939]: from='client.? 172.21.15.22:0/1815547868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:57.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:56 smithi064 ceph-mon[35179]: from='client.? 172.21.15.22:0/3815509655' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]: dispatch 2024-09-19T08:57:57.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:56 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]: dispatch 2024-09-19T08:57:57.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:56 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa65b2e2-2de3-4303-8efd-76384894b8cf"}]': finished 2024-09-19T08:57:57.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:56 smithi064 ceph-mon[35179]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T08:57:57.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:57:57.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:56 smithi064 ceph-mon[35179]: from='client.? 172.21.15.22:0/1815547868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:57:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:57 smithi001 ceph-mon[30939]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:57 smithi001 ceph-mon[30939]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:57:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:57:58.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:57 smithi064 ceph-mon[35179]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:58.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:57 smithi064 ceph-mon[35179]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:57:58.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:57:58.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:57 smithi022 ceph-mon[35107]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:57:58.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:57 smithi022 ceph-mon[35107]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:57:58.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:00.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:57:59 smithi001 ceph-mon[30939]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:00.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:57:59 smithi064 ceph-mon[35179]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:00.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:57:59 smithi022 ceph-mon[35107]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:01 smithi022 ceph-mon[35107]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-19T08:58:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:01 smithi001 ceph-mon[30939]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-19T08:58:02.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:01 smithi064 ceph-mon[35179]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-19T08:58:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:03 smithi001 ceph-mon[30939]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T08:58:04.051 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:03 smithi022 ceph-mon[35107]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T08:58:04.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:03 smithi064 ceph-mon[35179]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T08:58:05.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:58:05.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:05.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:58:05.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:05.190 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:58:05.190 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:06.021 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:05 smithi022 ceph-mon[35107]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T08:58:06.022 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:05 smithi022 ceph-mon[35107]: Deploying daemon osd.4 on smithi022 2024-09-19T08:58:06.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:05 smithi001 ceph-mon[30939]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T08:58:06.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:05 smithi001 ceph-mon[30939]: Deploying daemon osd.4 on smithi022 2024-09-19T08:58:06.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:05 smithi064 ceph-mon[35179]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T08:58:06.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:05 smithi064 ceph-mon[35179]: Deploying daemon osd.4 on smithi022 2024-09-19T08:58:07.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:07 smithi022 ceph-mon[35107]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:58:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:07 smithi001 ceph-mon[30939]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:58:08.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:07 smithi064 ceph-mon[35179]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:58:09.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:09 smithi022 ceph-mon[35107]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T08:58:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:09 smithi001 ceph-mon[30939]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T08:58:10.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:09 smithi064 ceph-mon[35179]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T08:58:10.905 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:10.905 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:10.905 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:11.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:11.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:11.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:11.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:11.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:11.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:12.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:11 smithi001 ceph-mon[30939]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:58:12.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:11 smithi064 ceph-mon[35179]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:58:12.200 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:11 smithi022 ceph-mon[35107]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:58:13.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:13 smithi001 ceph-mon[30939]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:13.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:13.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:13.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:13.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:13.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:13.608 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:13 smithi064 ceph-mon[35179]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:13.608 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:13.609 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:13.609 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:13.609 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:13.609 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:13.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:13 smithi022 ceph-mon[35107]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:13.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:13.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:13.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:13.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:13.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:14.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.036+0000 7fc3b0a4f640 1 -- 172.21.15.22:0/1963898599 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc3ac062630 con 0x7fc3940a3270 2024-09-19T08:58:14.036 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 4 on host 'smithi022' 2024-09-19T08:58:14.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3940a3270 msgr2=0x7fc3940a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3940a3270 0x7fc3940a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac102c60 tx=0x7fc3a0005f90 comp rx=0 tx=0).stop 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 msgr2=0x7fc3ac198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 0x7fc3ac198490 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009a20 tx=0x7fc39c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 shutdown_connections 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3940a3270 0x7fc3940a5730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3ac1037c0 0x7fc3ac19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3ac102e00 0x7fc3ac198490 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.038+0000 7fc3b1a51640 1 --2- 172.21.15.22:0/1963898599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3ac101c00 0x7fc3ac197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.039+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 >> 172.21.15.22:0/1963898599 conn(0x7fc3ac0fd390 msgr2=0x7fc3ac106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.039+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 shutdown_connections 2024-09-19T08:58:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:58:14.039+0000 7fc3b1a51640 1 -- 172.21.15.22:0/1963898599 wait complete. 2024-09-19T08:58:14.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:14.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:14.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:14.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:14 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:14.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:14 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:14.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:14 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:14.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:14 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:14.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:14 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:14.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:14 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:14.641 DEBUG:teuthology.orchestra.run.smithi022:osd.4> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T08:58:14.643 INFO:tasks.cephadm:Deploying osd.5 on smithi064 with /dev/vg_nvme/lv_3... 2024-09-19T08:58:14.644 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:58:14.903 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:58:15.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:15 smithi022 ceph-mon[35107]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:15.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:15 smithi001 ceph-mon[30939]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:15.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:15 smithi064 ceph-mon[35179]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:16.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:16 smithi022 ceph-mon[35107]: from='osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:58:16.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:16 smithi022 ceph-mon[35107]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:58:16.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 08:58:16 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4[46216]: 2024-09-19T08:58:16.194+0000 7fe3b2748640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:58:16.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:16 smithi001 ceph-mon[30939]: from='osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:58:16.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:16 smithi001 ceph-mon[30939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:58:16.553 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:16 smithi064 ceph-mon[35179]: from='osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:58:16.553 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:16 smithi064 ceph-mon[35179]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:58:17.198 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:58:17.225 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_3 2024-09-19T08:58:17.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:17 smithi022 ceph-mon[35107]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:17.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:17 smithi022 ceph-mon[35107]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:58:17.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:17 smithi022 ceph-mon[35107]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:58:17.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:17 smithi022 ceph-mon[35107]: from='osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:58:17.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:17 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:17.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:17 smithi022 ceph-mon[35107]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:58:17.461 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 08:58:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4[46216]: 2024-09-19T08:58:17.302+0000 7fe3adea8640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:58:17.461 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 08:58:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4[46216]: 2024-09-19T08:58:17.307+0000 7fe3aa4e2640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:58:17.481 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:58:17.507 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:17 smithi064 ceph-mon[35179]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:17.507 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:17 smithi064 ceph-mon[35179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:58:17.507 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:17 smithi064 ceph-mon[35179]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:58:17.507 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:17 smithi064 ceph-mon[35179]: from='osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:58:17.507 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:17 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:17.507 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:17 smithi064 ceph-mon[35179]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:58:17.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:17 smithi001 ceph-mon[30939]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:17.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:17 smithi001 ceph-mon[30939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:58:17.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:17 smithi001 ceph-mon[30939]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:58:17.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:17 smithi001 ceph-mon[30939]: from='osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:58:17.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:17 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:17.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:17 smithi001 ceph-mon[30939]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:58:17.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 -- 172.21.15.64:0/3114672473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054102510 msgr2=0x7f1054108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.933 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 --2- 172.21.15.64:0/3114672473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054102510 0x7f1054108da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f104c009ca0 tx=0x7f104c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 -- 172.21.15.64:0/3114672473 shutdown_connections 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 --2- 172.21.15.64:0/3114672473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054102510 0x7f1054108da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 --2- 172.21.15.64:0/3114672473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1054101b50 0x7f1054101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 --2- 172.21.15.64:0/3114672473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1054100950 0x7f1054100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 -- 172.21.15.64:0/3114672473 >> 172.21.15.64:0/3114672473 conn(0x7f10540fc0e0 msgr2=0x7f10540fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 -- 172.21.15.64:0/3114672473 shutdown_connections 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.932+0000 7f1058da2640 1 -- 172.21.15.64:0/3114672473 wait complete. 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1058da2640 1 Processor -- start 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1058da2640 1 -- start start 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1058da2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054100950 0x7f105406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1058da2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1054101b50 0x7f105419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.934 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1058da2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1054102510 0x7f105419f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1058da2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f105410c7b0 con 0x7f1054101b50 2024-09-19T08:58:17.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1058da2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f105410c630 con 0x7f1054102510 2024-09-19T08:58:17.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1058da2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f105410c930 con 0x7f1054100950 2024-09-19T08:58:17.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f10537fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054100950 0x7f105406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1052ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1054101b50 0x7f105419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f10537fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054100950 0x7f105406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58622/0 (socket says 172.21.15.64:58622) 2024-09-19T08:58:17.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f10537fe640 1 -- 172.21.15.64:0/2060583582 learned_addr learned my addr 172.21.15.64:0/2060583582 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:58:17.935 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.933+0000 7f1053fff640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1054102510 0x7f105419f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f10537fe640 1 -- 172.21.15.64:0/2060583582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1054102510 msgr2=0x7f105419f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f10537fe640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1054102510 0x7f105419f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.939 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f10537fe640 1 -- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1054101b50 msgr2=0x7f105419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f10537fe640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1054101b50 0x7f105419cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f10537fe640 1 -- 172.21.15.64:0/2060583582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105419fae0 con 0x7f1054100950 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f1052ffd640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1054101b50 0x7f105419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f1053fff640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1054102510 0x7f105419f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f10537fe640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054100950 0x7f105406aad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f104400b450 tx=0x7f104400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f1050ff9640 1 -- 172.21.15.64:0/2060583582 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044015020 con 0x7f1054100950 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f1050ff9640 1 -- 172.21.15.64:0/2060583582 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1044011d90 con 0x7f1054100950 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541969e0 con 0x7f1054100950 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f1050ff9640 1 -- 172.21.15.64:0/2060583582 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104400f340 con 0x7f1054100950 2024-09-19T08:58:17.940 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.934+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1054196ff0 con 0x7f1054100950 2024-09-19T08:58:17.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.935+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10541989c0 con 0x7f1054100950 2024-09-19T08:58:17.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.936+0000 7f1050ff9640 1 -- 172.21.15.64:0/2060583582 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1044018020 con 0x7f1054100950 2024-09-19T08:58:17.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.937+0000 7f1050ff9640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f103c0a32c0 0x7f103c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.937+0000 7f1050ff9640 1 -- 172.21.15.64:0/2060583582 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f10440ce130 con 0x7f1054100950 2024-09-19T08:58:17.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.937+0000 7f1052ffd640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f103c0a32c0 0x7f103c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.941 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.938+0000 7f1052ffd640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f103c0a32c0 0x7f103c0a5780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f105406b050 tx=0x7f104800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:17.942+0000 7f1050ff9640 1 -- 172.21.15.64:0/2060583582 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f104401f020 con 0x7f1054100950 2024-09-19T08:58:18.129 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:18.129+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1054107800 con 0x7f103c0a32c0 2024-09-19T08:58:18.511 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:58:18.512 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:58:18.512 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:18.512 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:18.512 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi022 2024-09-19T08:58:18.512 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.512 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.512 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:18.512 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:18.513 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-19T08:58:18.513 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.513 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:18.513 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:18.513 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.513 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:18.513 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:18.513 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:18.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi022 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:18.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:18.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:18.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:18.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:58:18.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:58:18.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:18.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:18.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi022 2024-09-19T08:58:18.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:18.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:19.551 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:19 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:58:19.551 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:19 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:58:19.551 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:19 smithi064 ceph-mon[35179]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:19.551 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:19 smithi064 ceph-mon[35179]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:19.551 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:19 smithi064 ceph-mon[35179]: osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] boot 2024-09-19T08:58:19.552 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:19 smithi064 ceph-mon[35179]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T08:58:19.552 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:19.699 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:19 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:58:19.700 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:19 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:58:19.700 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:19 smithi001 ceph-mon[30939]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:19.700 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:19 smithi001 ceph-mon[30939]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:19.700 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:19 smithi001 ceph-mon[30939]: osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] boot 2024-09-19T08:58:19.700 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:19 smithi001 ceph-mon[30939]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T08:58:19.700 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:19.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:19 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:58:19.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:19 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:58:19.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:19 smithi022 ceph-mon[35107]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:58:19.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:19 smithi022 ceph-mon[35107]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:19.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:19 smithi022 ceph-mon[35107]: osd.4 [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] boot 2024-09-19T08:58:19.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:19 smithi022 ceph-mon[35107]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T08:58:19.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:58:20.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:20 smithi001 ceph-mon[30939]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:58:20.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:20 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/2692433067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]: dispatch 2024-09-19T08:58:20.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:20 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]: dispatch 2024-09-19T08:58:20.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:20 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]': finished 2024-09-19T08:58:20.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:20 smithi001 ceph-mon[30939]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:58:20.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:20 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:20.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:20 smithi064 ceph-mon[35179]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:58:20.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:20 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/2692433067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]: dispatch 2024-09-19T08:58:20.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:20 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]: dispatch 2024-09-19T08:58:20.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:20 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]': finished 2024-09-19T08:58:20.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:20 smithi064 ceph-mon[35179]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:58:20.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:20 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:20 smithi022 ceph-mon[35107]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T08:58:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:20 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/2692433067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]: dispatch 2024-09-19T08:58:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:20 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]: dispatch 2024-09-19T08:58:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:20 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d85e3728-551a-417f-9a1f-37a6c7e144e7"}]': finished 2024-09-19T08:58:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:20 smithi022 ceph-mon[35107]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T08:58:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:20 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:21.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:21 smithi001 ceph-mon[30939]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:21.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:21 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/1137635020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:21.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:21 smithi064 ceph-mon[35179]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:21.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:21 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/1137635020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:21.859 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:21 smithi022 ceph-mon[35107]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:21.859 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:21 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/1137635020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:23.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:23 smithi001 ceph-mon[30939]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:23.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:23 smithi064 ceph-mon[35179]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:23.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:23 smithi022 ceph-mon[35107]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:25.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:25 smithi064 ceph-mon[35179]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:25.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:25 smithi001 ceph-mon[30939]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:25.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:25 smithi022 ceph-mon[35107]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:27.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:27 smithi001 ceph-mon[30939]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:27.802 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:27 smithi064 ceph-mon[35179]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:27.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:27 smithi022 ceph-mon[35107]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:29.777 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:29 smithi064 ceph-mon[35179]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:29.777 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:29 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:58:29.777 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:29 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:29.777 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:29 smithi064 ceph-mon[35179]: Deploying daemon osd.5 on smithi064 2024-09-19T08:58:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:29 smithi001 ceph-mon[30939]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:29 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:58:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:29 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:29 smithi001 ceph-mon[30939]: Deploying daemon osd.5 on smithi064 2024-09-19T08:58:29.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:29 smithi022 ceph-mon[35107]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:29.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:29 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:58:29.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:29 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:29.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:29 smithi022 ceph-mon[35107]: Deploying daemon osd.5 on smithi064 2024-09-19T08:58:31.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:31 smithi001 ceph-mon[30939]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:31.814 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:31 smithi064 ceph-mon[35179]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:31.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:31 smithi022 ceph-mon[35107]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:33.685 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:33 smithi064 ceph-mon[35179]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:33.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:33 smithi001 ceph-mon[30939]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:33.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:33 smithi022 ceph-mon[35107]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:35 smithi064 ceph-mon[35179]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:35.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:35 smithi022 ceph-mon[35107]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:35.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:35.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:35.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:35 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:35 smithi001 ceph-mon[30939]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:35 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:37.844 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:37 smithi064 ceph-mon[35179]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:37.882 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.881+0000 7f1050ff9640 1 -- 172.21.15.64:0/2060583582 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1054107800 con 0x7f103c0a32c0 2024-09-19T08:58:37.882 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 5 on host 'smithi064' 2024-09-19T08:58:37.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.883+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f103c0a32c0 msgr2=0x7f103c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.883+0000 7f1058da2640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f103c0a32c0 0x7f103c0a5780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f105406b050 tx=0x7f104800a250 comp rx=0 tx=0).stop 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.883+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054100950 msgr2=0x7f105406aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.883+0000 7f1058da2640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054100950 0x7f105406aad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f104400b450 tx=0x7f104400b910 comp rx=0 tx=0).stop 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.884+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 shutdown_connections 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.884+0000 7f1058da2640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1054102510 0x7f105419f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.884+0000 7f1058da2640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1054101b50 0x7f105419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.884+0000 7f1058da2640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f103c0a32c0 0x7f103c0a5780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.884+0000 7f1058da2640 1 --2- 172.21.15.64:0/2060583582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1054100950 0x7f105406aad0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.884+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 >> 172.21.15.64:0/2060583582 conn(0x7f10540fc0e0 msgr2=0x7f1054104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.884+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 shutdown_connections 2024-09-19T08:58:37.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:58:37.884+0000 7f1058da2640 1 -- 172.21.15.64:0/2060583582 wait complete. 2024-09-19T08:58:37.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:37 smithi022 ceph-mon[35107]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:38.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:37 smithi001 ceph-mon[30939]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:38.441 DEBUG:teuthology.orchestra.run.smithi064:osd.5> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T08:58:38.443 INFO:tasks.cephadm:Deploying osd.6 on smithi001 with /dev/vg_nvme/lv_2... 2024-09-19T08:58:38.443 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:58:38.724 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:39.141 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:38 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.141 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:38 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.141 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:38 smithi064 ceph-mon[35179]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:39.141 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:38 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.141 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:38 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:38 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:38 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:38 smithi022 ceph-mon[35107]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:39.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:38 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:38 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:38 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:38 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:38 smithi001 ceph-mon[30939]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:39.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:38 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:39.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:38 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:41.059 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:40 smithi064 ceph-mon[35179]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:41.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:40 smithi022 ceph-mon[35107]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:41.255 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:40 smithi001 ceph-mon[30939]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:41.258 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:58:41.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_2 2024-09-19T08:58:41.326 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T08:58:41.120+0000 7f693d2b5640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:58:41.560 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:42.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/3910766605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c1078c0 msgr2=0x7f7c9c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:42.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/3910766605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c1078c0 0x7f7c9c109d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009ca0 tx=0x7f7c9402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/3910766605 shutdown_connections 2024-09-19T08:58:42.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/3910766605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c1078c0 0x7f7c9c109d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/3910766605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c9c104f90 0x7f7c9c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/3910766605 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c102660 0x7f7c9c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/3910766605 >> 172.21.15.1:0/3910766605 conn(0x7f7c9c0fc280 msgr2=0x7f7c9c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:42.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/3910766605 shutdown_connections 2024-09-19T08:58:42.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.087+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/3910766605 wait complete. 2024-09-19T08:58:42.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.088+0000 7f7ca1bc9640 1 Processor -- start 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.088+0000 7f7ca1bc9640 1 -- start start 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.088+0000 7f7ca1bc9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c9c102660 0x7f7c9c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.088+0000 7f7ca1bc9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c104f90 0x7f7c9c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.088+0000 7f7ca1bc9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1078c0 0x7f7c9c19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.088+0000 7f7ca1bc9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c10d990 con 0x7f7c9c104f90 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.088+0000 7f7ca1bc9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c10d810 con 0x7f7c9c102660 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.088+0000 7f7ca1bc9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c10db10 con 0x7f7c9c1078c0 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c104f90 0x7f7c9c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c104f90 0x7f7c9c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46192/0 (socket says 172.21.15.1:46192) 2024-09-19T08:58:42.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 -- 172.21.15.1:0/1241632000 learned_addr learned my addr 172.21.15.1:0/1241632000 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9b7fe640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c9c102660 0x7f7c9c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9bfff640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1078c0 0x7f7c9c19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 -- 172.21.15.1:0/1241632000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1078c0 msgr2=0x7f7c9c19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1078c0 0x7f7c9c19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 -- 172.21.15.1:0/1241632000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c9c102660 msgr2=0x7f7c9c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c9c102660 0x7f7c9c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 -- 172.21.15.1:0/1241632000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c19fbe0 con 0x7f7c9c104f90 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9b7fe640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c9c102660 0x7f7c9c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c9affd640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c104f90 0x7f7c9c1984f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400e9c0 tx=0x7f7c8400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c98ff9640 1 -- 172.21.15.1:0/1241632000 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400cd80 con 0x7f7c9c104f90 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c19fed0 con 0x7f7c9c104f90 2024-09-19T08:58:42.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c98ff9640 1 -- 172.21.15.1:0/1241632000 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c84005520 con 0x7f7c9c104f90 2024-09-19T08:58:42.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7c98ff9640 1 -- 172.21.15.1:0/1241632000 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84010690 con 0x7f7c9c104f90 2024-09-19T08:58:42.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.089+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c1a03d0 con 0x7f7c9c104f90 2024-09-19T08:58:42.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.090+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c0fdd70 con 0x7f7c9c104f90 2024-09-19T08:58:42.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.092+0000 7f7c98ff9640 1 -- 172.21.15.1:0/1241632000 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7c840046c0 con 0x7f7c9c104f90 2024-09-19T08:58:42.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.093+0000 7f7c98ff9640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c880a3270 0x7f7c880a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:42.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.094+0000 7f7c98ff9640 1 -- 172.21.15.1:0/1241632000 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4237+0+0 (secure 0 0 0) 0x7f7c840cef90 con 0x7f7c9c104f90 2024-09-19T08:58:42.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.094+0000 7f7c9b7fe640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c880a3270 0x7f7c880a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:42.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.094+0000 7f7c9b7fe640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c880a3270 0x7f7c880a5730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c005d00 tx=0x7f7c8c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:42.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.096+0000 7f7c98ff9640 1 -- 172.21.15.1:0/1241632000 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c84054210 con 0x7f7c9c104f90 2024-09-19T08:58:42.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:58:42.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi064 2024-09-19T08:58:42.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi064 to 8544M 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:58:42.282+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7c9c062630 con 0x7f7c880a3270 2024-09-19T08:58:42.283 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi064 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi064 to 8544M 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:42.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:42.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:42.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:42.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi064 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi064 to 8544M 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:42.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:43.256 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:43.257 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:58:43.257 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:58:43.257 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:58:43.257 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:43.257 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:43.257 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:43.257 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:43.257 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:42 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:43.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:58:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:58:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:58:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:42 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:43.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:43.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:58:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:58:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:58:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:58:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:58:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:58:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:42 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:44.105 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 08:58:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T08:58:43.742+0000 7f6938a15640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:58:44.105 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 08:58:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T08:58:43.749+0000 7f6931047640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:58:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:43 smithi064 ceph-mon[35179]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:58:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:43 smithi064 ceph-mon[35179]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:58:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:43 smithi064 ceph-mon[35179]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' 2024-09-19T08:58:44.194 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:43 smithi001 ceph-mon[30939]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:58:44.195 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:43 smithi001 ceph-mon[30939]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:58:44.195 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:44.195 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:44.195 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:43 smithi001 ceph-mon[30939]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' 2024-09-19T08:58:44.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:43 smithi022 ceph-mon[35107]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:58:44.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:43 smithi022 ceph-mon[35107]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:58:44.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:44.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:44.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:43 smithi022 ceph-mon[35107]: from='osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763]' entity='osd.5' 2024-09-19T08:58:45.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:58:45.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:58:45.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:45.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] boot 2024-09-19T08:58:45.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T08:58:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:58:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2906966652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd093d03-4420-450f-bae0-f4c8690138f6"}]: dispatch 2024-09-19T08:58:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2906966652' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd093d03-4420-450f-bae0-f4c8690138f6"}]': finished 2024-09-19T08:58:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T08:58:45.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:44 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:45.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:58:45.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] boot 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2906966652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd093d03-4420-450f-bae0-f4c8690138f6"}]: dispatch 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2906966652' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd093d03-4420-450f-bae0-f4c8690138f6"}]': finished 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T08:58:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:44 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:45.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:58:45.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:58:45.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:58:45.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: osd.5 [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] boot 2024-09-19T08:58:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T08:58:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:58:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:58:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2906966652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd093d03-4420-450f-bae0-f4c8690138f6"}]: dispatch 2024-09-19T08:58:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2906966652' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd093d03-4420-450f-bae0-f4c8690138f6"}]': finished 2024-09-19T08:58:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T08:58:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:44 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:46.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:45 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/123733656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:46.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:45 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/123733656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:46.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:45 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/123733656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:58:47.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:46 smithi001 ceph-mon[30939]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:47.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:46 smithi001 ceph-mon[30939]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T08:58:47.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:46 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:47.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:46 smithi064 ceph-mon[35179]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:47.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:46 smithi064 ceph-mon[35179]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T08:58:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:46 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:47.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:46 smithi022 ceph-mon[35107]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:47.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:46 smithi022 ceph-mon[35107]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T08:58:47.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:46 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:48.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:47 smithi001 ceph-mon[30939]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:58:48.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:48.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:47 smithi064 ceph-mon[35179]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:58:48.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:48.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:47 smithi022 ceph-mon[35107]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:58:48.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:58:49.257 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:48 smithi064 ceph-mon[35179]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:49.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:48 smithi001 ceph-mon[30939]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:48 smithi022 ceph-mon[35107]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:58:51.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:50 smithi001 ceph-mon[30939]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-19T08:58:51.260 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:50 smithi022 ceph-mon[35107]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-19T08:58:51.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:50 smithi064 ceph-mon[35179]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-19T08:58:53.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:52 smithi001 ceph-mon[30939]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T08:58:53.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:52 smithi064 ceph-mon[35179]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T08:58:53.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:52 smithi022 ceph-mon[35107]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T08:58:54.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:58:54.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:54.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:53 smithi001 ceph-mon[30939]: Deploying daemon osd.6 on smithi001 2024-09-19T08:58:54.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:58:54.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:54.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:53 smithi064 ceph-mon[35179]: Deploying daemon osd.6 on smithi001 2024-09-19T08:58:54.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:58:54.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:54.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:53 smithi022 ceph-mon[35107]: Deploying daemon osd.6 on smithi001 2024-09-19T08:58:55.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:54 smithi001 ceph-mon[30939]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:58:55.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:54 smithi064 ceph-mon[35179]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:58:55.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:54 smithi022 ceph-mon[35107]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:58:57.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:57 smithi001 ceph-mon[30939]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:58:57.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:57 smithi064 ceph-mon[35179]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:58:57.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:57 smithi022 ceph-mon[35107]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:58:59.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:59 smithi001 ceph-mon[30939]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T08:58:59.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:59 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:59.266 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:59 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:59.267 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:58:59 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:59.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:59 smithi064 ceph-mon[35179]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T08:58:59.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:59 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:59.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:59 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:59.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:58:59 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:59.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:59 smithi022 ceph-mon[35107]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T08:58:59.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:59 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:59.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:59 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:58:59.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:58:59 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:01.296 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:01 smithi001 ceph-mon[30939]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:59:01.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:01 smithi064 ceph-mon[35179]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:59:01.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:01 smithi022 ceph-mon[35107]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:59:02.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.692+0000 7f7c98ff9640 1 -- 172.21.15.1:0/1241632000 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7c9c062630 con 0x7f7c880a3270 2024-09-19T08:59:02.693 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 6 on host 'smithi001' 2024-09-19T08:59:02.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.694+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c880a3270 msgr2=0x7f7c880a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:02.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.694+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c880a3270 0x7f7c880a5730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c005d00 tx=0x7f7c8c005c70 comp rx=0 tx=0).stop 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.694+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c104f90 msgr2=0x7f7c9c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.694+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c104f90 0x7f7c9c1984f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400e9c0 tx=0x7f7c8400ee80 comp rx=0 tx=0).stop 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.694+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 shutdown_connections 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.694+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7c880a3270 0x7f7c880a5730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.695+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1078c0 0x7f7c9c19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.695+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c9c104f90 0x7f7c9c1984f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.695+0000 7f7ca1bc9640 1 --2- 172.21.15.1:0/1241632000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c9c102660 0x7f7c9c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.695+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 >> 172.21.15.1:0/1241632000 conn(0x7f7c9c0fc280 msgr2=0x7f7c9c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.695+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 shutdown_connections 2024-09-19T08:59:02.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:02.695+0000 7f7ca1bc9640 1 -- 172.21.15.1:0/1241632000 wait complete. 2024-09-19T08:59:02.988 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:02.988 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:02.989 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:02.989 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:02.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:02.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:02.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:02.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:02 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:02 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:03.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:03.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:03.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:02 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:03.299 DEBUG:teuthology.orchestra.run.smithi001:osd.6> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T08:59:03.302 INFO:tasks.cephadm:Deploying osd.7 on smithi022 with /dev/vg_nvme/lv_2... 2024-09-19T08:59:03.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:59:03.564 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:59:03.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:03 smithi001 ceph-mon[30939]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:03.937 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:03 smithi022 ceph-mon[35107]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:04.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:03 smithi064 ceph-mon[35179]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:05.548 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 08:59:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T08:59:05.253+0000 7f1f7930a640 -1 osd.6 0 log_to_monitors true 2024-09-19T08:59:05.913 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:05 smithi001 ceph-mon[30939]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:05.913 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:05 smithi001 ceph-mon[30939]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:59:05.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:05 smithi022 ceph-mon[35107]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:05.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:05 smithi022 ceph-mon[35107]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:59:06.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:05 smithi064 ceph-mon[35179]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:06.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:05 smithi064 ceph-mon[35179]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:59:06.151 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T08:59:06.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2024-09-19T08:59:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:59:06.836 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:06.837 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:06.838 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:06.838 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:06 smithi022 ceph-mon[35107]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:59:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.920+0000 7f29a2731640 1 -- 172.21.15.22:0/218170247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c102e00 msgr2=0x7f299c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.920+0000 7f29a2731640 1 --2- 172.21.15.22:0/218170247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c102e00 0x7f299c103280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2990009900 tx=0x7f299002a410 comp rx=0 tx=0).stop 2024-09-19T08:59:06.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.920+0000 7f29a2731640 1 -- 172.21.15.22:0/218170247 shutdown_connections 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.920+0000 7f29a2731640 1 --2- 172.21.15.22:0/218170247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f299c1037c0 0x7f299c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.920+0000 7f29a2731640 1 --2- 172.21.15.22:0/218170247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c102e00 0x7f299c103280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.920+0000 7f29a2731640 1 --2- 172.21.15.22:0/218170247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f299c101c00 0x7f299c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.920+0000 7f29a2731640 1 -- 172.21.15.22:0/218170247 >> 172.21.15.22:0/218170247 conn(0x7f299c0fd390 msgr2=0x7f299c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.921+0000 7f29a2731640 1 -- 172.21.15.22:0/218170247 shutdown_connections 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.921+0000 7f29a2731640 1 -- 172.21.15.22:0/218170247 wait complete. 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.921+0000 7f29a2731640 1 Processor -- start 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.921+0000 7f29a2731640 1 -- start start 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a2731640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f299c101c00 0x7f299c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a2731640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f299c102e00 0x7f299c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a2731640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c1037c0 0x7f299c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a2731640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f299c10da10 con 0x7f299c102e00 2024-09-19T08:59:06.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a2731640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f299c10d890 con 0x7f299c1037c0 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a2731640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f299c10db90 con 0x7f299c101c00 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c1037c0 0x7f299c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c1037c0 0x7f299c19f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51944/0 (socket says 172.21.15.22:51944) 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f299bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f299c101c00 0x7f299c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 -- 172.21.15.22:0/4294491351 learned_addr learned my addr 172.21.15.22:0/4294491351 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f299b7fe640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f299c102e00 0x7f299c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 -- 172.21.15.22:0/4294491351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f299c101c00 msgr2=0x7f299c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f299c101c00 0x7f299c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 -- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f299c102e00 msgr2=0x7f299c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f299c102e00 0x7f299c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 -- 172.21.15.22:0/4294491351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c19fb70 con 0x7f299c1037c0 2024-09-19T08:59:06.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a0cce640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c1037c0 0x7f299c19f500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f299400cce0 tx=0x7f299400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29997fa640 1 -- 172.21.15.22:0/4294491351 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299400f450 con 0x7f299c1037c0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29997fa640 1 -- 172.21.15.22:0/4294491351 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f299400faf0 con 0x7f299c1037c0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c19fe60 con 0x7f299c1037c0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29997fa640 1 -- 172.21.15.22:0/4294491351 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994018cc0 con 0x7f299c1037c0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.922+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1a02c0 con 0x7f299c1037c0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.924+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c108f30 con 0x7f299c1037c0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.925+0000 7f29997fa640 1 -- 172.21.15.22:0/4294491351 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f299400f5f0 con 0x7f299c1037c0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.926+0000 7f29997fa640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29840a3270 0x7f29840a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.926+0000 7f299bfff640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29840a3270 0x7f29840a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.926+0000 7f29997fa640 1 -- 172.21.15.22:0/4294491351 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7f29940cf0b0 con 0x7f299c1037c0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.926+0000 7f299bfff640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29840a3270 0x7f29840a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f298c005fd0 tx=0x7f298c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:06.929+0000 7f29997fa640 1 -- 172.21.15.22:0/4294491351 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2994014030 con 0x7f299c1037c0 2024-09-19T08:59:07.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:59:07.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:59:07.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:59:07.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:07.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:07.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:07.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:07.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:07.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:07.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:07.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:07.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:07.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:07.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:06 smithi001 ceph-mon[30939]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:59:07.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:07.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:06 smithi064 ceph-mon[35179]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T08:59:07.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:07.114+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f299c062630 con 0x7f29840a3270 2024-09-19T08:59:07.744 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T08:59:07.438+0000 7f1f74a6a640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T08:59:07.744 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T08:59:07.448+0000 7f1f6d09c640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi001 2024-09-19T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:07.783 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:07.784 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:07.784 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:07.784 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' 2024-09-19T08:59:07.784 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi001 2024-09-19T08:59:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T08:59:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:59:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:08.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:08.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' 2024-09-19T08:59:08.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:08.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi001 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: from='osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551]' entity='osd.6' 2024-09-19T08:59:08.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:09.029 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:08 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:59:09.030 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:08 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:59:09.030 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:08 smithi022 ceph-mon[35107]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:09.030 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:08 smithi022 ceph-mon[35107]: osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] boot 2024-09-19T08:59:09.030 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:08 smithi022 ceph-mon[35107]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T08:59:09.030 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:09.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:08 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:59:09.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:08 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:59:09.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:08 smithi001 ceph-mon[30939]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:09.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:08 smithi001 ceph-mon[30939]: osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] boot 2024-09-19T08:59:09.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:08 smithi001 ceph-mon[30939]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T08:59:09.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:09.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:08 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:59:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:08 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:59:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:08 smithi064 ceph-mon[35179]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:08 smithi064 ceph-mon[35179]: osd.6 [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] boot 2024-09-19T08:59:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:08 smithi064 ceph-mon[35179]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T08:59:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:59:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:09 smithi001 ceph-mon[30939]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:09 smithi001 ceph-mon[30939]: from='client.? 172.21.15.22:0/45725255' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]: dispatch 2024-09-19T08:59:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:09 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]: dispatch 2024-09-19T08:59:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:09 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]': finished 2024-09-19T08:59:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:09 smithi001 ceph-mon[30939]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T08:59:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:10.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:09 smithi064 ceph-mon[35179]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:10.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:09 smithi064 ceph-mon[35179]: from='client.? 172.21.15.22:0/45725255' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]: dispatch 2024-09-19T08:59:10.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:09 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]: dispatch 2024-09-19T08:59:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:09 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]': finished 2024-09-19T08:59:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:09 smithi064 ceph-mon[35179]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T08:59:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:09 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:10.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:09 smithi022 ceph-mon[35107]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:59:10.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:09 smithi022 ceph-mon[35107]: from='client.? 172.21.15.22:0/45725255' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]: dispatch 2024-09-19T08:59:10.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:09 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]: dispatch 2024-09-19T08:59:10.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:09 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c26c0c5-ee92-4ec9-8adc-6dde6335b42b"}]': finished 2024-09-19T08:59:10.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:09 smithi022 ceph-mon[35107]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T08:59:10.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:09 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:11.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:10 smithi001 ceph-mon[30939]: from='client.? 172.21.15.22:0/2176760852' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:11.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:10 smithi064 ceph-mon[35179]: from='client.? 172.21.15.22:0/2176760852' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:11.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:10 smithi022 ceph-mon[35107]: from='client.? 172.21.15.22:0/2176760852' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:12.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:11 smithi001 ceph-mon[30939]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:12.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:11 smithi064 ceph-mon[35179]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:12.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:11 smithi022 ceph-mon[35107]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:13 smithi001 ceph-mon[30939]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:14.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:13 smithi064 ceph-mon[35179]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:14.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:13 smithi022 ceph-mon[35107]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:15 smithi001 ceph-mon[30939]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:16.070 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:15 smithi022 ceph-mon[35107]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:16.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:15 smithi064 ceph-mon[35179]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:17.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:17 smithi022 ceph-mon[35107]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:18.047 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:17 smithi001 ceph-mon[30939]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:18.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:17 smithi064 ceph-mon[35179]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:19.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:59:19.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:19.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:59:19.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:19.139 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:59:19.139 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:19.858 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:19 smithi022 ceph-mon[35107]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:19.859 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:19 smithi022 ceph-mon[35107]: Deploying daemon osd.7 on smithi022 2024-09-19T08:59:20.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:19 smithi001 ceph-mon[30939]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:20.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:19 smithi001 ceph-mon[30939]: Deploying daemon osd.7 on smithi022 2024-09-19T08:59:20.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:19 smithi064 ceph-mon[35179]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:20.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:19 smithi064 ceph-mon[35179]: Deploying daemon osd.7 on smithi022 2024-09-19T08:59:22.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:21 smithi001 ceph-mon[30939]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:22.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:21 smithi064 ceph-mon[35179]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:22.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:21 smithi022 ceph-mon[35107]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:23.940 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:23 smithi022 ceph-mon[35107]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:24.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:23 smithi001 ceph-mon[30939]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:24.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:23 smithi064 ceph-mon[35179]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:24.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:24 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:24.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:24 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:24.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:24 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:25.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:24 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:25.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:24 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:25.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:24 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:25.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:24 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:25.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:24 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:25.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:24 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:25.870 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:25 smithi022 ceph-mon[35107]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:26.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:25 smithi001 ceph-mon[30939]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:26.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:25 smithi064 ceph-mon[35179]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:27.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.122+0000 7f29997fa640 1 -- 172.21.15.22:0/4294491351 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f299c062630 con 0x7f29840a3270 2024-09-19T08:59:27.122 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 7 on host 'smithi022' 2024-09-19T08:59:27.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29840a3270 msgr2=0x7f29840a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:27.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29840a3270 0x7f29840a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f298c005fd0 tx=0x7f298c00b390 comp rx=0 tx=0).stop 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c1037c0 msgr2=0x7f299c19f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c1037c0 0x7f299c19f500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f299400cce0 tx=0x7f299400a620 comp rx=0 tx=0).stop 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 shutdown_connections 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c1037c0 0x7f299c19f500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f299c102e00 0x7f299c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29840a3270 0x7f29840a5730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.124+0000 7f29a2731640 1 --2- 172.21.15.22:0/4294491351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f299c101c00 0x7f299c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.125+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 >> 172.21.15.22:0/4294491351 conn(0x7f299c0fd390 msgr2=0x7f299c106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.125+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 shutdown_connections 2024-09-19T08:59:27.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T08:59:27.125+0000 7f29a2731640 1 -- 172.21.15.22:0/4294491351 wait complete. 2024-09-19T08:59:27.792 DEBUG:teuthology.orchestra.run.smithi022:osd.7> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T08:59:27.795 INFO:tasks.cephadm:Deploying osd.8 on smithi064 with /dev/vg_nvme/lv_2... 2024-09-19T08:59:27.795 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:59:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:27 smithi001 ceph-mon[30939]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:27 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:28.054 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:59:28.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:27 smithi064 ceph-mon[35179]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:28.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:28.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:27 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:28.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:27 smithi022 ceph-mon[35107]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:28.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:28.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:27 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:29.185 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:28 smithi064 ceph-mon[35179]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:29.185 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:29.185 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:29.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:28 smithi022 ceph-mon[35107]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:29.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:29.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:29.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:28 smithi001 ceph-mon[30939]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:29.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:29.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:30.607 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T08:59:30.631 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_2 2024-09-19T08:59:30.694 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 08:59:30 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T08:59:30.253+0000 7f1d5c1cb640 -1 osd.7 0 log_to_monitors true 2024-09-19T08:59:30.881 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:59:30.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:30 smithi022 ceph-mon[35107]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:30.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:30 smithi022 ceph-mon[35107]: from='osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:59:30.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:30 smithi022 ceph-mon[35107]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:59:31.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:30 smithi001 ceph-mon[30939]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:31.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:30 smithi001 ceph-mon[30939]: from='osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:59:31.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:30 smithi001 ceph-mon[30939]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:59:31.183 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:30 smithi064 ceph-mon[35179]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:31.183 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:30 smithi064 ceph-mon[35179]: from='osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:59:31.183 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:30 smithi064 ceph-mon[35179]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:59:31.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 -- 172.21.15.64:0/561585501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 msgr2=0x7f55b0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:31.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 --2- 172.21.15.64:0/561585501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 0x7f55b0109d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009ca0 tx=0x7f55a802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:31.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 -- 172.21.15.64:0/561585501 shutdown_connections 2024-09-19T08:59:31.386 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 --2- 172.21.15.64:0/561585501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 0x7f55b0109d10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:31.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 --2- 172.21.15.64:0/561585501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55b0104ff0 0x7f55b01073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:31.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 --2- 172.21.15.64:0/561585501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55b01026c0 0x7f55b0104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:31.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 -- 172.21.15.64:0/561585501 >> 172.21.15.64:0/561585501 conn(0x7f55b00fc280 msgr2=0x7f55b00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:31.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 -- 172.21.15.64:0/561585501 shutdown_connections 2024-09-19T08:59:31.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 -- 172.21.15.64:0/561585501 wait complete. 2024-09-19T08:59:31.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.386+0000 7f55b6240640 1 Processor -- start 2024-09-19T08:59:31.387 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55b6240640 1 -- start start 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55b6240640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55b01026c0 0x7f55b0197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55b6240640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55b0104ff0 0x7f55b01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55b6240640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 0x7f55b019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55b6240640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55b010d9b0 con 0x7f55b01026c0 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55b6240640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f55b010d830 con 0x7f55b0104ff0 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55b6240640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f55b010db30 con 0x7f55b0107920 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55affff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 0x7f55b019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55b01026c0 0x7f55b0197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:31.389 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55affff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 0x7f55b019f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59478/0 (socket says 172.21.15.64:59478) 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55affff640 1 -- 172.21.15.64:0/3484756637 learned_addr learned my addr 172.21.15.64:0/3484756637 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55aeffd640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55b0104ff0 0x7f55b01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55affff640 1 -- 172.21.15.64:0/3484756637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55b0104ff0 msgr2=0x7f55b01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55affff640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55b0104ff0 0x7f55b01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55affff640 1 -- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55b01026c0 msgr2=0x7f55b0197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55affff640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55b01026c0 0x7f55b0197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55affff640 1 -- 172.21.15.64:0/3484756637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b019fba0 con 0x7f55b0107920 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.387+0000 7f55af7fe640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55b01026c0 0x7f55b0197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.388+0000 7f55affff640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 0x7f55b019f530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f55a8031a40 tx=0x7f55a8031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.388+0000 7f55acff9640 1 -- 172.21.15.64:0/3484756637 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a802fbe0 con 0x7f55b0107920 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.388+0000 7f55acff9640 1 -- 172.21.15.64:0/3484756637 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55a802fd80 con 0x7f55b0107920 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.388+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b019fe30 con 0x7f55b0107920 2024-09-19T08:59:31.390 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.388+0000 7f55acff9640 1 -- 172.21.15.64:0/3484756637 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8046980 con 0x7f55b0107920 2024-09-19T08:59:31.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.388+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b01a0330 con 0x7f55b0107920 2024-09-19T08:59:31.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.389+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b00fdd70 con 0x7f55b0107920 2024-09-19T08:59:31.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.390+0000 7f55acff9640 1 -- 172.21.15.64:0/3484756637 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f55a8030ce0 con 0x7f55b0107920 2024-09-19T08:59:31.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.391+0000 7f55acff9640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f559c0a32f0 0x7f559c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:31.391 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.391+0000 7f55acff9640 1 -- 172.21.15.64:0/3484756637 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5101+0+0 (secure 0 0 0) 0x7f55a80f0200 con 0x7f55b0107920 2024-09-19T08:59:31.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.392+0000 7f55af7fe640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f559c0a32f0 0x7f559c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:31.392 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.392+0000 7f55af7fe640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f559c0a32f0 0x7f559c0a57b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5598005fd0 tx=0x7f559800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:31.395 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.395+0000 7f55acff9640 1 -- 172.21.15.64:0/3484756637 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55a80bdba0 con 0x7f55b0107920 2024-09-19T08:59:31.581 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:31.581+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f55b0062630 con 0x7f559c0a32f0 2024-09-19T08:59:32.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi022 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:32.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.217 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:59:32.217 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi022 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.218 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:32.219 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:59:32.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:59:32.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T08:59:32.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:32.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T08:59:32.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi022 2024-09-19T08:59:32.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:32.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:32.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:32.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:32.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:32.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:32.944 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T08:59:32.629+0000 7f1d5792b640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T08:59:32.944 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T08:59:32.640+0000 7f1d4ff5d640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:59:33.203 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:33.203 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:59:33.203 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:59:33.203 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:33.203 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:33.203 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: from='osd.7 ' entity='osd.7' 2024-09-19T08:59:33.204 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] boot 2024-09-19T08:59:33.204 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T08:59:33.204 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:32 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:33.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:33.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:59:33.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:59:33.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:33.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:33.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: from='osd.7 ' entity='osd.7' 2024-09-19T08:59:33.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] boot 2024-09-19T08:59:33.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T08:59:33.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:32 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: from='osd.7 ' entity='osd.7' 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: osd.7 [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] boot 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T08:59:33.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:59:34.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:33 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:59:34.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:33 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:59:34.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:33 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/4000264831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]: dispatch 2024-09-19T08:59:34.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:33 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]: dispatch 2024-09-19T08:59:34.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:33 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]': finished 2024-09-19T08:59:34.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:33 smithi022 ceph-mon[35107]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T08:59:34.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:33 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:34.215 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:33 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:59:34.215 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:33 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:59:34.215 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:33 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/4000264831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]: dispatch 2024-09-19T08:59:34.215 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:33 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]: dispatch 2024-09-19T08:59:34.215 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:33 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]': finished 2024-09-19T08:59:34.215 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:33 smithi064 ceph-mon[35179]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T08:59:34.215 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:33 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:33 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:59:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:33 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:59:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:33 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/4000264831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]: dispatch 2024-09-19T08:59:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:33 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]: dispatch 2024-09-19T08:59:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:33 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6eab8176-97e8-4a26-9293-64dacf2752e5"}]': finished 2024-09-19T08:59:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:33 smithi001 ceph-mon[30939]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T08:59:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:33 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:35.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:34 smithi001 ceph-mon[30939]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:35.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:34 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/2691874175' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:35.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:34 smithi001 ceph-mon[30939]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T08:59:35.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:35.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:35 smithi064 ceph-mon[35179]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:35.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:35 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/2691874175' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:35.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:35 smithi064 ceph-mon[35179]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T08:59:35.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:35 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:35.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:34 smithi022 ceph-mon[35107]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:35.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:34 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/2691874175' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:59:35.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:34 smithi022 ceph-mon[35107]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T08:59:35.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:36.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:36 smithi001 ceph-mon[30939]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T08:59:36.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:36 smithi001 ceph-mon[30939]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T08:59:36.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:36 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:36.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:36 smithi064 ceph-mon[35179]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T08:59:36.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:36 smithi064 ceph-mon[35179]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T08:59:36.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:36 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:36.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:36 smithi022 ceph-mon[35107]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T08:59:36.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:36 smithi022 ceph-mon[35107]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T08:59:36.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:36 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:37.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:37 smithi001 ceph-mon[30939]: pgmap v171: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:59:37.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:37 smithi001 ceph-mon[30939]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T08:59:37.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:37.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:37 smithi064 ceph-mon[35179]: pgmap v171: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:59:37.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:37 smithi064 ceph-mon[35179]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T08:59:37.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:37.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:37 smithi022 ceph-mon[35107]: pgmap v171: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:59:37.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:37 smithi022 ceph-mon[35107]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T08:59:37.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:39.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:39 smithi001 ceph-mon[30939]: pgmap v174: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:59:39.321 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:39 smithi064 ceph-mon[35179]: pgmap v174: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:59:39.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:39 smithi022 ceph-mon[35107]: pgmap v174: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:59:40.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:40 smithi064 ceph-mon[35179]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T08:59:40.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:40 smithi064 ceph-mon[35179]: Cluster is now healthy 2024-09-19T08:59:40.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:40 smithi022 ceph-mon[35107]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T08:59:40.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:40 smithi022 ceph-mon[35107]: Cluster is now healthy 2024-09-19T08:59:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:40 smithi001 ceph-mon[30939]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T08:59:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:40 smithi001 ceph-mon[30939]: Cluster is now healthy 2024-09-19T08:59:41.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:41 smithi064 ceph-mon[35179]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:41.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:41 smithi022 ceph-mon[35107]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:41.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:41 smithi001 ceph-mon[30939]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:43.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:43 smithi064 ceph-mon[35179]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:43.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:59:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:43 smithi064 ceph-mon[35179]: Deploying daemon osd.8 on smithi064 2024-09-19T08:59:43.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:43 smithi022 ceph-mon[35107]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:43.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:59:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:43.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:43 smithi022 ceph-mon[35107]: Deploying daemon osd.8 on smithi064 2024-09-19T08:59:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:43 smithi001 ceph-mon[30939]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:59:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:43 smithi001 ceph-mon[30939]: Deploying daemon osd.8 on smithi064 2024-09-19T08:59:45.353 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:45 smithi064 ceph-mon[35179]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:45.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:45 smithi022 ceph-mon[35107]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:45.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:45 smithi001 ceph-mon[30939]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:47.251 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:47 smithi064 ceph-mon[35179]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:47.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:47 smithi022 ceph-mon[35107]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:47.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:47 smithi001 ceph-mon[30939]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:49 smithi022 ceph-mon[35107]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:49 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:49 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:49 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:49.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:49 smithi001 ceph-mon[30939]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:49.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:49.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:49.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:49.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:49 smithi064 ceph-mon[35179]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:49.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:49.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:49.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.340 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:51 smithi064 ceph-mon[35179]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:51.341 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:51 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.341 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:51 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.341 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:51 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:51.341 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:51 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:51.341 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:51 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:51 smithi022 ceph-mon[35107]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:51.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:51 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:51 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:51 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:51.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:51 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:51.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:51 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:51 smithi001 ceph-mon[30939]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:51.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:51 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:51 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:51 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:51.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:51 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:51.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:51 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:51.963 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.962+0000 7f55acff9640 1 -- 172.21.15.64:0/3484756637 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f55b0062630 con 0x7f559c0a32f0 2024-09-19T08:59:51.963 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 8 on host 'smithi064' 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f559c0a32f0 msgr2=0x7f559c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f559c0a32f0 0x7f559c0a57b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5598005fd0 tx=0x7f559800b390 comp rx=0 tx=0).stop 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 msgr2=0x7f55b019f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 0x7f55b019f530 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f55a8031a40 tx=0x7f55a8031ee0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 shutdown_connections 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f559c0a32f0 0x7f559c0a57b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b0107920 0x7f55b019f530 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55b0104ff0 0x7f55b01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 --2- 172.21.15.64:0/3484756637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55b01026c0 0x7f55b0197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 >> 172.21.15.64:0/3484756637 conn(0x7f55b00fc280 msgr2=0x7f55b0102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:51.966 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 shutdown_connections 2024-09-19T08:59:51.967 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T08:59:51.965+0000 7f55b6240640 1 -- 172.21.15.64:0/3484756637 wait complete. 2024-09-19T08:59:52.269 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:52.270 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:52.270 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:52.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:52.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:52.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:52.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:52.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:52.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:52.591 DEBUG:teuthology.orchestra.run.smithi064:osd.8> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T08:59:52.593 INFO:tasks.cephadm:Deploying osd.9 on smithi001 with /dev/vg_nvme/lv_1... 2024-09-19T08:59:52.594 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:59:52.859 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:53.240 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:53 smithi001 ceph-mon[30939]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:53.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:53 smithi064 ceph-mon[35179]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:53.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:53 smithi022 ceph-mon[35107]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:55.032 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 08:59:54 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T08:59:54.731+0000 7fb0a813b640 -1 osd.8 0 log_to_monitors true 2024-09-19T08:59:55.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:55 smithi001 ceph-mon[30939]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:55.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:55 smithi001 ceph-mon[30939]: from='osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:59:55.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:55 smithi001 ceph-mon[30939]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:59:55.332 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:55 smithi064 ceph-mon[35179]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:55.332 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:55 smithi064 ceph-mon[35179]: from='osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:59:55.333 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:55 smithi064 ceph-mon[35179]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:59:55.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:55 smithi022 ceph-mon[35107]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:55.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:55 smithi022 ceph-mon[35107]: from='osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:59:55.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:55 smithi022 ceph-mon[35107]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:59:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T08:59:55.684 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_1 2024-09-19T08:59:55.946 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:56.386 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:59:56.386 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:59:56.386 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:56.386 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:59:56.386 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:59:56.386 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi064 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi064 to 5696M 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:56.387 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.384+0000 7f6674c9a640 1 -- 172.21.15.1:0/430502229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66701078c0 msgr2=0x7f6670109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:56.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.384+0000 7f6674c9a640 1 --2- 172.21.15.1:0/430502229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66701078c0 0x7f6670109d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6668009ca0 tx=0x7f666802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.384+0000 7f6674c9a640 1 -- 172.21.15.1:0/430502229 shutdown_connections 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.384+0000 7f6674c9a640 1 --2- 172.21.15.1:0/430502229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66701078c0 0x7f6670109d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.384+0000 7f6674c9a640 1 --2- 172.21.15.1:0/430502229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6670104f90 0x7f6670107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.384+0000 7f6674c9a640 1 --2- 172.21.15.1:0/430502229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6670102660 0x7f6670104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.384+0000 7f6674c9a640 1 -- 172.21.15.1:0/430502229 >> 172.21.15.1:0/430502229 conn(0x7f66700fc280 msgr2=0x7f66700fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.385+0000 7f6674c9a640 1 -- 172.21.15.1:0/430502229 shutdown_connections 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.385+0000 7f6674c9a640 1 -- 172.21.15.1:0/430502229 wait complete. 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f6674c9a640 1 Processor -- start 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f6674c9a640 1 -- start start 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f6674c9a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6670102660 0x7f6670197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f6674c9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6670104f90 0x7f66701984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:56.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f6674c9a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66701078c0 0x7f667019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f6674c9a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f667010d9b0 con 0x7f6670104f90 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f6674c9a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f667010d830 con 0x7f66701078c0 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f6674c9a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f667010db30 con 0x7f6670102660 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6670104f90 0x7f66701984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6670104f90 0x7f66701984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52412/0 (socket says 172.21.15.1:52412) 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666dd9b640 1 -- 172.21.15.1:0/4113704752 learned_addr learned my addr 172.21.15.1:0/4113704752 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666e59c640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6670102660 0x7f6670197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666ed9d640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66701078c0 0x7f667019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666dd9b640 1 -- 172.21.15.1:0/4113704752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6670102660 msgr2=0x7f6670197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666dd9b640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6670102660 0x7f6670197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666dd9b640 1 -- 172.21.15.1:0/4113704752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66701078c0 msgr2=0x7f667019f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:56.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666dd9b640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66701078c0 0x7f667019f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666dd9b640 1 -- 172.21.15.1:0/4113704752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667019fbb0 con 0x7f6670104f90 2024-09-19T08:59:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666ed9d640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66701078c0 0x7f667019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.386+0000 7f666e59c640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6670102660 0x7f6670197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.387+0000 7f666dd9b640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6670104f90 0x7f66701984c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f666400e9f0 tx=0x7f666400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.387+0000 7f665f7fe640 1 -- 172.21.15.1:0/4113704752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666400ccc0 con 0x7f6670104f90 2024-09-19T08:59:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.387+0000 7f665f7fe640 1 -- 172.21.15.1:0/4113704752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6664005520 con 0x7f6670104f90 2024-09-19T08:59:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.387+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667019fea0 con 0x7f6670104f90 2024-09-19T08:59:56.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.387+0000 7f665f7fe640 1 -- 172.21.15.1:0/4113704752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664010690 con 0x7f6670104f90 2024-09-19T08:59:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.387+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66701a0300 con 0x7f6670104f90 2024-09-19T08:59:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.388+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66700fdd70 con 0x7f6670104f90 2024-09-19T08:59:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.389+0000 7f665f7fe640 1 -- 172.21.15.1:0/4113704752 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6664004f70 con 0x7f6670104f90 2024-09-19T08:59:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.390+0000 7f665f7fe640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66580a3270 0x7f66580a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.390+0000 7f666e59c640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66580a3270 0x7f66580a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.390+0000 7f665f7fe640 1 -- 172.21.15.1:0/4113704752 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5549+0+0 (secure 0 0 0) 0x7f66640cf340 con 0x7f6670104f90 2024-09-19T08:59:56.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.391+0000 7f666e59c640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66580a3270 0x7f66580a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6660009c20 tx=0x7f6660005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:56.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.394+0000 7f665f7fe640 1 -- 172.21.15.1:0/4113704752 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f666409ca90 con 0x7f6670104f90 2024-09-19T08:59:56.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:59:56.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:59:56.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:56.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:59:56.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:59:56.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi064 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi064 to 5696M 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:56.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T08:59:56.581+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6670062630 con 0x7f66580a3270 2024-09-19T08:59:56.605 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T08:59:56.140+0000 7fb0a389b640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T08:59:56.606 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T08:59:56.153+0000 7fb09fed5640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:59:56.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:59:56.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:59:56.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:56.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:59:56.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T08:59:56.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi064 2024-09-19T08:59:56.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:56.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi064 to 5696M 2024-09-19T08:59:56.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:56.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:56.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:56.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:57.262 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:57.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:57.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:59:57.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:59:57.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:57.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:57.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:57.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:57.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:57.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:59:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:58.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:58 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T08:59:58.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:58 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T08:59:58.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:58.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:58 smithi022 ceph-mon[35107]: osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] boot 2024-09-19T08:59:58.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:58 smithi022 ceph-mon[35107]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T08:59:58.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:58.484 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:58 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T08:59:58.484 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:58 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T08:59:58.484 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:58.484 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:58 smithi001 ceph-mon[30939]: osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] boot 2024-09-19T08:59:58.484 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:58 smithi001 ceph-mon[30939]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T08:59:58.484 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:58.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:58 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T08:59:58.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:58 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T08:59:58.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:58.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:58 smithi064 ceph-mon[35179]: osd.8 [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] boot 2024-09-19T08:59:58.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:58 smithi064 ceph-mon[35179]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T08:59:58.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:59:59.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:59 smithi022 ceph-mon[35107]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:59.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 08:59:59 smithi022 ceph-mon[35107]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T08:59:59.496 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:59 smithi001 ceph-mon[30939]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:59.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 08:59:59 smithi001 ceph-mon[30939]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T08:59:59.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:59 smithi064 ceph-mon[35179]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:59:59.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 08:59:59 smithi064 ceph-mon[35179]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T09:00:00.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:00 smithi022 ceph-mon[35107]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:00:00.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:00 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2622338947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c8cb115-549f-42fd-8bff-98586d00e5d2"}]: dispatch 2024-09-19T09:00:00.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:00 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2622338947' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c8cb115-549f-42fd-8bff-98586d00e5d2"}]': finished 2024-09-19T09:00:00.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:00 smithi022 ceph-mon[35107]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:00:00.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:00 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:00.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:00 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3386270255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:00.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:00 smithi022 ceph-mon[35107]: overall HEALTH_OK 2024-09-19T09:00:00.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:00 smithi001 ceph-mon[30939]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:00:00.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:00 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2622338947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c8cb115-549f-42fd-8bff-98586d00e5d2"}]: dispatch 2024-09-19T09:00:00.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:00 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2622338947' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c8cb115-549f-42fd-8bff-98586d00e5d2"}]': finished 2024-09-19T09:00:00.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:00 smithi001 ceph-mon[30939]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:00:00.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:00 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:00.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:00 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3386270255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:00.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:00 smithi001 ceph-mon[30939]: overall HEALTH_OK 2024-09-19T09:00:00.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:00 smithi064 ceph-mon[35179]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:00:00.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:00 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2622338947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c8cb115-549f-42fd-8bff-98586d00e5d2"}]: dispatch 2024-09-19T09:00:00.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:00 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2622338947' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c8cb115-549f-42fd-8bff-98586d00e5d2"}]': finished 2024-09-19T09:00:00.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:00 smithi064 ceph-mon[35179]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:00:00.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:00 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:00.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:00 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3386270255' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:00.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:00 smithi064 ceph-mon[35179]: overall HEALTH_OK 2024-09-19T09:00:01.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:01 smithi022 ceph-mon[35107]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:01.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:01 smithi022 ceph-mon[35107]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:00:01.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:01.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:01 smithi001 ceph-mon[30939]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:01.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:01 smithi001 ceph-mon[30939]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:00:01.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:01.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:01 smithi064 ceph-mon[35179]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:01.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:01 smithi064 ceph-mon[35179]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:00:01.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:03.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:03 smithi022 ceph-mon[35107]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:03.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:03 smithi022 ceph-mon[35107]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:00:03.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:03 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:03.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:03 smithi001 ceph-mon[30939]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:03.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:03 smithi001 ceph-mon[30939]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:00:03.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:03 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:03.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:03 smithi064 ceph-mon[35179]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:03.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:03 smithi064 ceph-mon[35179]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:00:03.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:03 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:05.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:05 smithi022 ceph-mon[35107]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T09:00:05.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:05 smithi001 ceph-mon[30939]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T09:00:05.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:05 smithi064 ceph-mon[35179]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-09-19T09:00:07.407 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:07 smithi001 ceph-mon[30939]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T09:00:07.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:07 smithi022 ceph-mon[35107]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T09:00:07.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:07 smithi064 ceph-mon[35179]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-19T09:00:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:09 smithi001 ceph-mon[30939]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:00:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:00:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:09 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:09 smithi001 ceph-mon[30939]: Deploying daemon osd.9 on smithi001 2024-09-19T09:00:09.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:09 smithi022 ceph-mon[35107]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:00:09.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:09 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:00:09.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:09 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:09.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:09 smithi022 ceph-mon[35107]: Deploying daemon osd.9 on smithi001 2024-09-19T09:00:09.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:09 smithi064 ceph-mon[35179]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:00:09.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:09 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:00:09.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:09 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:09.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:09 smithi064 ceph-mon[35179]: Deploying daemon osd.9 on smithi001 2024-09-19T09:00:11.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:11 smithi022 ceph-mon[35107]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T09:00:11.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:11 smithi001 ceph-mon[30939]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T09:00:11.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:11 smithi064 ceph-mon[35179]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T09:00:13.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:13 smithi022 ceph-mon[35107]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:00:13.493 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:13 smithi001 ceph-mon[30939]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:00:13.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:13 smithi064 ceph-mon[35179]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:00:14.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:14 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:14.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:14 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:14.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:14 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:14.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:14.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:14.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:14 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:14.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:14 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:14.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:14 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:14.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:14 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:15.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:15 smithi001 ceph-mon[30939]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T09:00:15.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:15 smithi022 ceph-mon[35107]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T09:00:15.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:15 smithi064 ceph-mon[35179]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T09:00:17.454 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:17 smithi001 ceph-mon[30939]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:17.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:17 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:17 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:17 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:17.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:17 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:17.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:17 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:17 smithi022 ceph-mon[35107]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:17.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:17 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:17 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:17 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:17.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:17 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:17.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:17 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:17 smithi064 ceph-mon[35179]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:17.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:17 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:17 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:17 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:17.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:17 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:17.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:17 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:17.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.895+0000 7f665f7fe640 1 -- 172.21.15.1:0/4113704752 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6670062630 con 0x7f66580a3270 2024-09-19T09:00:17.895 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 9 on host 'smithi001' 2024-09-19T09:00:17.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66580a3270 msgr2=0x7f66580a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66580a3270 0x7f66580a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6660009c20 tx=0x7f6660005f90 comp rx=0 tx=0).stop 2024-09-19T09:00:17.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6670104f90 msgr2=0x7f66701984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6670104f90 0x7f66701984c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f666400e9f0 tx=0x7f666400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 shutdown_connections 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66701078c0 0x7f667019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6670104f90 0x7f66701984c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66580a3270 0x7f66580a5730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 --2- 172.21.15.1:0/4113704752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6670102660 0x7f6670197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.898+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 >> 172.21.15.1:0/4113704752 conn(0x7f66700fc280 msgr2=0x7f6670102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.899+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 shutdown_connections 2024-09-19T09:00:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:00:17.899+0000 7f6674c9a640 1 -- 172.21.15.1:0/4113704752 wait complete. 2024-09-19T09:00:18.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:18.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:18.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:18 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:18.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:18.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:18.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:18 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:18.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:18.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:18.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:18 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:18.681 DEBUG:teuthology.orchestra.run.smithi001:osd.9> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T09:00:18.684 INFO:tasks.cephadm:Deploying osd.10 on smithi022 with /dev/vg_nvme/lv_1... 2024-09-19T09:00:18.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:00:18.947 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:00:19.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:19 smithi001 ceph-mon[30939]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:19.395 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:19 smithi022 ceph-mon[35107]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:19.507 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:19 smithi064 ceph-mon[35179]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:20.798 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:00:20 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:00:20.451+0000 7f0a8739f640 -1 osd.9 0 log_to_monitors true 2024-09-19T09:00:21.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:21 smithi022 ceph-mon[35107]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:21.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:21 smithi022 ceph-mon[35107]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:00:21.491 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:21 smithi001 ceph-mon[30939]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:21.491 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:21 smithi001 ceph-mon[30939]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:00:21.577 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:00:21.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_1 2024-09-19T09:00:21.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:21 smithi064 ceph-mon[35179]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:21.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:21 smithi064 ceph-mon[35179]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:00:21.866 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:00:22.288 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:00:22.288 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:00:22.288 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:00:22.288 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:22.288 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi001 2024-09-19T09:00:22.288 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:22.289 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3841741270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc107970 msgr2=0x7f9ecc109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3841741270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc107970 0x7f9ecc109d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009ca0 tx=0x7f9ec402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3841741270 shutdown_connections 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3841741270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc107970 0x7f9ecc109d60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3841741270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ecc100230 0x7f9ecc107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3841741270 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ecc0ff860 0x7f9ecc0ffc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3841741270 >> 172.21.15.22:0/3841741270 conn(0x7f9ecc0fb610 msgr2=0x7f9ecc0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3841741270 shutdown_connections 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.372+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3841741270 wait complete. 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ed13b2640 1 Processor -- start 2024-09-19T09:00:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ed13b2640 1 -- start start 2024-09-19T09:00:22.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ed13b2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc0ff860 0x7f9ecc197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:22.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ed13b2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ecc100230 0x7f9ecc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:22.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ed13b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ecc107970 0x7f9ecc19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ed13b2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc10d990 con 0x7f9ecc107970 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ed13b2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc10d810 con 0x7f9ecc0ff860 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ed13b2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc10db10 con 0x7f9ecc100230 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ecaffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc0ff860 0x7f9ecc197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ecaffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc0ff860 0x7f9ecc197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41280/0 (socket says 172.21.15.22:41280) 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ecaffd640 1 -- 172.21.15.22:0/3325192233 learned_addr learned my addr 172.21.15.22:0/3325192233 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.373+0000 7f9ecb7fe640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ecc107970 0x7f9ecc19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ec27fc640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ecc100230 0x7f9ecc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ecaffd640 1 -- 172.21.15.22:0/3325192233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ecc100230 msgr2=0x7f9ecc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ecaffd640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ecc100230 0x7f9ecc198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ecaffd640 1 -- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ecc107970 msgr2=0x7f9ecc19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ecaffd640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ecc107970 0x7f9ecc19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ecaffd640 1 -- 172.21.15.22:0/3325192233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc19fb80 con 0x7f9ecc0ff860 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ecaffd640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc0ff860 0x7f9ecc197f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00e9c0 tx=0x7f9ebc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ec8ff9640 1 -- 172.21.15.22:0/3325192233 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00cd80 con 0x7f9ecc0ff860 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ec8ff9640 1 -- 172.21.15.22:0/3325192233 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ebc0035f0 con 0x7f9ecc0ff860 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ecc19fe70 con 0x7f9ecc0ff860 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ec8ff9640 1 -- 172.21.15.22:0/3325192233 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc010690 con 0x7f9ecc0ff860 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.374+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ecc1a0320 con 0x7f9ecc0ff860 2024-09-19T09:00:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.375+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ecc1a05e0 con 0x7f9ecc0ff860 2024-09-19T09:00:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.377+0000 7f9ec8ff9640 1 -- 172.21.15.22:0/3325192233 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9ebc0037a0 con 0x7f9ecc0ff860 2024-09-19T09:00:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.377+0000 7f9ec8ff9640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9eb80a32f0 0x7f9eb80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.377+0000 7f9ec8ff9640 1 -- 172.21.15.22:0/3325192233 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7f9ebc0cf500 con 0x7f9ecc0ff860 2024-09-19T09:00:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.377+0000 7f9ec27fc640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9eb80a32f0 0x7f9eb80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.378+0000 7f9ec27fc640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9eb80a32f0 0x7f9eb80a57b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4005fd0 tx=0x7f9eb4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:22.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.380+0000 7f9ec8ff9640 1 -- 172.21.15.22:0/3325192233 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ebc09cbd0 con 0x7f9ecc0ff860 2024-09-19T09:00:22.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:00:22.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:00:22.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:00:22.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:22.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi001 2024-09-19T09:00:22.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:22.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:22.566+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9ecc1a07b0 con 0x7f9eb80a32f0 2024-09-19T09:00:22.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi001 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:22.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T09:00:22.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:22.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:22.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:22.607 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:23.190 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:00:22.969+0000 7f0a82aff640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T09:00:23.190 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:00:22 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:00:22.981+0000 7f0a7b131640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:00:23.299 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:23.299 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:00:23.299 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:00:23.299 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:23.299 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:23.300 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:23.300 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:00:23.300 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:00:23.300 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:23.300 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:23 smithi022 ceph-mon[35107]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' 2024-09-19T09:00:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:00:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:00:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:23.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:23.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:00:23.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:00:23.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:23.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:23 smithi001 ceph-mon[30939]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' 2024-09-19T09:00:23.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:23.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:23 smithi064 ceph-mon[35179]: from='osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901]' entity='osd.9' 2024-09-19T09:00:24.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:24 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T09:00:24.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:24 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T09:00:24.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:24 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:24.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:24 smithi022 ceph-mon[35107]: osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] boot 2024-09-19T09:00:24.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:24 smithi022 ceph-mon[35107]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T09:00:24.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:24 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:24 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T09:00:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:24 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T09:00:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:24 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:24 smithi001 ceph-mon[30939]: osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] boot 2024-09-19T09:00:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:24 smithi001 ceph-mon[30939]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T09:00:24.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:24 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:24.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:24 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T09:00:24.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:24 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T09:00:24.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:24 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:24.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:24 smithi064 ceph-mon[35179]: osd.9 [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] boot 2024-09-19T09:00:24.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:24 smithi064 ceph-mon[35179]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T09:00:24.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:24 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:00:25.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:25 smithi022 ceph-mon[35107]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:25.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:25 smithi022 ceph-mon[35107]: from='client.? 172.21.15.22:0/2328658478' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]: dispatch 2024-09-19T09:00:25.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:25 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]: dispatch 2024-09-19T09:00:25.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:25 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]': finished 2024-09-19T09:00:25.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:25 smithi022 ceph-mon[35107]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T09:00:25.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:25 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:25 smithi001 ceph-mon[30939]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:25 smithi001 ceph-mon[30939]: from='client.? 172.21.15.22:0/2328658478' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]: dispatch 2024-09-19T09:00:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:25 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]: dispatch 2024-09-19T09:00:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:25 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]': finished 2024-09-19T09:00:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:25 smithi001 ceph-mon[30939]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T09:00:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:25 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:25.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:25 smithi064 ceph-mon[35179]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:00:25.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:25 smithi064 ceph-mon[35179]: from='client.? 172.21.15.22:0/2328658478' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]: dispatch 2024-09-19T09:00:25.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:25 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]: dispatch 2024-09-19T09:00:25.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:25 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6a50ba5-0cc9-4be8-bb6c-26b5043c6303"}]': finished 2024-09-19T09:00:25.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:25 smithi064 ceph-mon[35179]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T09:00:25.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:25 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:26.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:26 smithi022 ceph-mon[35107]: from='client.? 172.21.15.22:0/556284893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:26.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:26 smithi001 ceph-mon[30939]: from='client.? 172.21.15.22:0/556284893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:26.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:26 smithi064 ceph-mon[35179]: from='client.? 172.21.15.22:0/556284893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:27.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:27 smithi022 ceph-mon[35107]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:27.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:27 smithi001 ceph-mon[30939]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:27.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:27 smithi064 ceph-mon[35179]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:29.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:29 smithi022 ceph-mon[35107]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:29.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:29 smithi001 ceph-mon[30939]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:29.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:29 smithi064 ceph-mon[35179]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:31.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:31 smithi022 ceph-mon[35107]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:31.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:31 smithi001 ceph-mon[30939]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:31.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:31 smithi064 ceph-mon[35179]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:33.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:33 smithi022 ceph-mon[35107]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:33.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:33 smithi001 ceph-mon[30939]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:33.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:33 smithi064 ceph-mon[35179]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:34.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:00:34.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:34.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:34 smithi001 ceph-mon[30939]: Deploying daemon osd.10 on smithi022 2024-09-19T09:00:34.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:00:34.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:34.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:34 smithi064 ceph-mon[35179]: Deploying daemon osd.10 on smithi022 2024-09-19T09:00:34.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:00:34.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:34.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:34 smithi022 ceph-mon[35107]: Deploying daemon osd.10 on smithi022 2024-09-19T09:00:35.513 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:35 smithi022 ceph-mon[35107]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:35.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:35 smithi001 ceph-mon[30939]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:35.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:35 smithi064 ceph-mon[35179]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:37.297 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:37 smithi022 ceph-mon[35107]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:37.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:37 smithi001 ceph-mon[30939]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:37.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:37 smithi064 ceph-mon[35179]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:39.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:39 smithi022 ceph-mon[35107]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:39.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:39 smithi001 ceph-mon[30939]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:39.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:39 smithi064 ceph-mon[35179]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:40.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:40 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:40.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:40 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:40.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:40 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:40.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:40 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:40.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:40 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:40.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:40 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:40.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:40 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:41.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:41 smithi001 ceph-mon[30939]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:41.565 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:41 smithi022 ceph-mon[35107]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:41.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:41 smithi064 ceph-mon[35179]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:42.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.721+0000 7f9ec8ff9640 1 -- 172.21.15.22:0/3325192233 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9ecc1a07b0 con 0x7f9eb80a32f0 2024-09-19T09:00:42.721 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 10 on host 'smithi022' 2024-09-19T09:00:42.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9eb80a32f0 msgr2=0x7f9eb80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9eb80a32f0 0x7f9eb80a57b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4005fd0 tx=0x7f9eb4005850 comp rx=0 tx=0).stop 2024-09-19T09:00:42.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc0ff860 msgr2=0x7f9ecc197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc0ff860 0x7f9ecc197f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00e9c0 tx=0x7f9ebc00ee80 comp rx=0 tx=0).stop 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 shutdown_connections 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ecc107970 0x7f9ecc19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9eb80a32f0 0x7f9eb80a57b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ecc100230 0x7f9ecc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 --2- 172.21.15.22:0/3325192233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ecc0ff860 0x7f9ecc197f50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 >> 172.21.15.22:0/3325192233 conn(0x7f9ecc0fb610 msgr2=0x7f9ecc0fc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 shutdown_connections 2024-09-19T09:00:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:00:42.723+0000 7f9ed13b2640 1 -- 172.21.15.22:0/3325192233 wait complete. 2024-09-19T09:00:43.326 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:43.326 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.326 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.326 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:43.326 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:43.326 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.326 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:43.327 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.327 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:43 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.353 DEBUG:teuthology.orchestra.run.smithi022:osd.10> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T09:00:43.356 INFO:tasks.cephadm:Deploying osd.11 on smithi064 with /dev/vg_nvme/lv_1... 2024-09-19T09:00:43.356 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:43 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:43.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:43.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:43 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:43.618 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:00:45.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:45 smithi022 ceph-mon[35107]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:45.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:45 smithi064 ceph-mon[35179]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:45.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:45 smithi001 ceph-mon[30939]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:45.709 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:00:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:00:45.584+0000 7fa9f2a7b640 -1 osd.10 0 log_to_monitors true 2024-09-19T09:00:46.065 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:46 smithi022 ceph-mon[35107]: from='osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:00:46.065 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:46 smithi022 ceph-mon[35107]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:00:46.107 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-09-19T09:00:46.133 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:46 smithi064 ceph-mon[35179]: from='osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:00:46.134 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:46 smithi064 ceph-mon[35179]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:00:46.135 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi064:vg_nvme/lv_1 2024-09-19T09:00:46.394 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:00:46.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:46 smithi001 ceph-mon[30939]: from='osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:00:46.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:46 smithi001 ceph-mon[30939]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:00:46.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 -- 172.21.15.64:0/1092518203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf841026d0 msgr2=0x7faf84108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 --2- 172.21.15.64:0/1092518203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf841026d0 0x7faf84108f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009ca0 tx=0x7faf7c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 -- 172.21.15.64:0/1092518203 shutdown_connections 2024-09-19T09:00:46.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 --2- 172.21.15.64:0/1092518203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf841026d0 0x7faf84108f60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.851 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 --2- 172.21.15.64:0/1092518203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf84101d10 0x7faf84102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 --2- 172.21.15.64:0/1092518203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf84100b10 0x7faf84100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 -- 172.21.15.64:0/1092518203 >> 172.21.15.64:0/1092518203 conn(0x7faf840fc2a0 msgr2=0x7faf840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 -- 172.21.15.64:0/1092518203 shutdown_connections 2024-09-19T09:00:46.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.850+0000 7faf8918e640 1 -- 172.21.15.64:0/1092518203 wait complete. 2024-09-19T09:00:46.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf8918e640 1 Processor -- start 2024-09-19T09:00:46.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf8918e640 1 -- start start 2024-09-19T09:00:46.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf8918e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf84100b10 0x7faf84104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf8918e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf84101d10 0x7faf841030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf8918e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf841026d0 0x7faf84103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf8918e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf8410c8d0 con 0x7faf84101d10 2024-09-19T09:00:46.855 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf8918e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf8410c750 con 0x7faf841026d0 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf8918e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faf8410ca50 con 0x7faf84100b10 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf82d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf84100b10 0x7faf84104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.851+0000 7faf82d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf84100b10 0x7faf84104aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:59814/0 (socket says 172.21.15.64:59814) 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf82d9d640 1 -- 172.21.15.64:0/2514663199 learned_addr learned my addr 172.21.15.64:0/2514663199 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf8359e640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf841026d0 0x7faf84103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf8259c640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf84101d10 0x7faf841030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf82d9d640 1 -- 172.21.15.64:0/2514663199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf841026d0 msgr2=0x7faf84103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf82d9d640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf841026d0 0x7faf84103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf82d9d640 1 -- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf84101d10 msgr2=0x7faf841030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf82d9d640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf84101d10 0x7faf841030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf82d9d640 1 -- 172.21.15.64:0/2514663199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf84103ef0 con 0x7faf84100b10 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf82d9d640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf84100b10 0x7faf84104aa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c970 tx=0x7faf7400cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.856 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf6bfff640 1 -- 172.21.15.64:0/2514663199 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74004220 con 0x7faf84100b10 2024-09-19T09:00:46.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf841a20f0 con 0x7faf84100b10 2024-09-19T09:00:46.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf6bfff640 1 -- 172.21.15.64:0/2514663199 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf740043c0 con 0x7faf84100b10 2024-09-19T09:00:46.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf6bfff640 1 -- 172.21.15.64:0/2514663199 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7400f450 con 0x7faf84100b10 2024-09-19T09:00:46.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.852+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf841a2600 con 0x7faf84100b10 2024-09-19T09:00:46.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.853+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf841a2890 con 0x7faf84100b10 2024-09-19T09:00:46.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.855+0000 7faf6bfff640 1 -- 172.21.15.64:0/2514663199 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7faf740079b0 con 0x7faf84100b10 2024-09-19T09:00:46.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.856+0000 7faf6bfff640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faf6c0a3240 0x7faf6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.856+0000 7faf6bfff640 1 -- 172.21.15.64:0/2514663199 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6398+0+0 (secure 0 0 0) 0x7faf740cf0b0 con 0x7faf84100b10 2024-09-19T09:00:46.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.856+0000 7faf8259c640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faf6c0a3240 0x7faf6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.857+0000 7faf8259c640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faf6c0a3240 0x7faf6c0a5700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf84104820 tx=0x7faf7800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:46.859+0000 7faf6bfff640 1 -- 172.21.15.64:0/2514663199 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf74014030 con 0x7faf84100b10 2024-09-19T09:00:47.042 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:00:47.043+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faf841a2a60 con 0x7faf6c0a3240 2024-09-19T09:00:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:00:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:00:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T09:00:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:00:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi022 2024-09-19T09:00:47.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:00:47.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:47.458 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:00:47.071+0000 7fa9ee1db640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T09:00:47.459 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:00:47.086+0000 7fa9ea815640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:00:47.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:47.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:00:47.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi022 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-19T09:00:47.461 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.461 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:47.461 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:47.461 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.461 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:00:47.461 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:00:47.461 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:47.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:47.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:00:47.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:00:47.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T09:00:47.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:47.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:00:47.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi022 2024-09-19T09:00:47.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:00:47.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:48.330 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:48 smithi064 ceph-mon[35179]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:48.330 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:48 smithi064 ceph-mon[35179]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:00:48.330 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:48 smithi064 ceph-mon[35179]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:00:48.330 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:48.330 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:48.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:48 smithi022 ceph-mon[35107]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:48.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:48 smithi022 ceph-mon[35107]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:00:48.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:48 smithi022 ceph-mon[35107]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:00:48.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:48.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:48.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:48 smithi001 ceph-mon[30939]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:00:48.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:48 smithi001 ceph-mon[30939]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:00:48.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:48 smithi001 ceph-mon[30939]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:00:48.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:48.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:49.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:49 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T09:00:49.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:49 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T09:00:49.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:49 smithi064 ceph-mon[35179]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:49.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:49.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:49 smithi064 ceph-mon[35179]: osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] boot 2024-09-19T09:00:49.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:49 smithi064 ceph-mon[35179]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T09:00:49.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:49 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:49.449 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:49 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T09:00:49.449 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:49 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T09:00:49.449 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:49 smithi001 ceph-mon[30939]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:49.449 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:49.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:49 smithi001 ceph-mon[30939]: osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] boot 2024-09-19T09:00:49.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:49 smithi001 ceph-mon[30939]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T09:00:49.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:49 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:49 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T09:00:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:49 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T09:00:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:49 smithi022 ceph-mon[35107]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:00:49.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:49 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:49.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:49 smithi022 ceph-mon[35107]: osd.10 [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] boot 2024-09-19T09:00:49.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:49 smithi022 ceph-mon[35107]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T09:00:49.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:49 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:00:50.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:50 smithi064 ceph-mon[35179]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T09:00:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:50 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/3824887794' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]: dispatch 2024-09-19T09:00:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:50 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]: dispatch 2024-09-19T09:00:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:50 smithi064 ceph-mon[35179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]': finished 2024-09-19T09:00:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:50 smithi064 ceph-mon[35179]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T09:00:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:50 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:50 smithi064 ceph-mon[35179]: from='client.? 172.21.15.64:0/1465402699' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:50.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:50 smithi022 ceph-mon[35107]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T09:00:50.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:50 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/3824887794' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]: dispatch 2024-09-19T09:00:50.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:50 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]: dispatch 2024-09-19T09:00:50.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:50 smithi022 ceph-mon[35107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]': finished 2024-09-19T09:00:50.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:50 smithi022 ceph-mon[35107]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T09:00:50.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:50 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:50.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:50 smithi022 ceph-mon[35107]: from='client.? 172.21.15.64:0/1465402699' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:50.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:50 smithi001 ceph-mon[30939]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T09:00:50.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:50 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/3824887794' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]: dispatch 2024-09-19T09:00:50.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:50 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]: dispatch 2024-09-19T09:00:50.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:50 smithi001 ceph-mon[30939]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea01a956-f246-4e9e-b294-9f24ae3b250d"}]': finished 2024-09-19T09:00:50.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:50 smithi001 ceph-mon[30939]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T09:00:50.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:50 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:50.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:50 smithi001 ceph-mon[30939]: from='client.? 172.21.15.64:0/1465402699' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:00:51.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:51 smithi064 ceph-mon[35179]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:00:51.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:51 smithi064 ceph-mon[35179]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:00:51.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:51 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:51.649 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:51 smithi022 ceph-mon[35107]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:00:51.649 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:51 smithi022 ceph-mon[35107]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:00:51.649 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:51 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:51 smithi001 ceph-mon[30939]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:00:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:51 smithi001 ceph-mon[30939]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:00:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:51 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:52.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:52 smithi064 ceph-mon[35179]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:00:52.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:52 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:52.639 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:52 smithi022 ceph-mon[35107]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:00:52.640 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:52 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:52 smithi001 ceph-mon[30939]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:00:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:52 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:00:53.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:53 smithi064 ceph-mon[35179]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:00:53.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:53 smithi022 ceph-mon[35107]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:00:53.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:53 smithi001 ceph-mon[30939]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:00:55.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:55 smithi064 ceph-mon[35179]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-19T09:00:55.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:55 smithi022 ceph-mon[35107]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-19T09:00:55.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:55 smithi001 ceph-mon[30939]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-19T09:00:57.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:57 smithi064 ceph-mon[35179]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-19T09:00:57.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:57 smithi022 ceph-mon[35107]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-19T09:00:57.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:57 smithi001 ceph-mon[30939]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-19T09:00:58.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:00:58.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:58.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:00:58.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:58.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:00:58.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:59.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:59 smithi064 ceph-mon[35179]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:00:59.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:00:59 smithi064 ceph-mon[35179]: Deploying daemon osd.11 on smithi064 2024-09-19T09:00:59.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:59 smithi022 ceph-mon[35107]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:00:59.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:00:59 smithi022 ceph-mon[35107]: Deploying daemon osd.11 on smithi064 2024-09-19T09:00:59.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:59 smithi001 ceph-mon[30939]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:00:59.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:00:59 smithi001 ceph-mon[30939]: Deploying daemon osd.11 on smithi064 2024-09-19T09:01:01.594 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:01 smithi064 ceph-mon[35179]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T09:01:01.595 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:01 smithi001 ceph-mon[30939]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T09:01:01.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:01 smithi022 ceph-mon[35107]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-19T09:01:03.603 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:03 smithi064 ceph-mon[35179]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T09:01:03.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:03 smithi022 ceph-mon[35107]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T09:01:03.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:03 smithi001 ceph-mon[30939]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T09:01:04.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:04.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:04.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:04 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:04.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:04.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:04.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:04 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:04.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:04.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:04.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:04 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:05.483 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:05 smithi064 ceph-mon[35179]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:01:05.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:05 smithi022 ceph-mon[35107]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:01:05.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:05 smithi001 ceph-mon[30939]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:01:07.142 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.142+0000 7faf6bfff640 1 -- 172.21.15.64:0/2514663199 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7faf841a2a60 con 0x7faf6c0a3240 2024-09-19T09:01:07.143 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 11 on host 'smithi064' 2024-09-19T09:01:07.144 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.144+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faf6c0a3240 msgr2=0x7faf6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.144+0000 7faf8918e640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faf6c0a3240 0x7faf6c0a5700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faf84104820 tx=0x7faf7800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.144+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf84100b10 msgr2=0x7faf84104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.144+0000 7faf8918e640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf84100b10 0x7faf84104aa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c970 tx=0x7faf7400cd70 comp rx=0 tx=0).stop 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.145+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 shutdown_connections 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.145+0000 7faf8918e640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf841026d0 0x7faf84103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.145+0000 7faf8918e640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf84101d10 0x7faf841030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.145+0000 7faf8918e640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faf6c0a3240 0x7faf6c0a5700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.145+0000 7faf8918e640 1 --2- 172.21.15.64:0/2514663199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf84100b10 0x7faf84104aa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.145+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 >> 172.21.15.64:0/2514663199 conn(0x7faf840fc2a0 msgr2=0x7faf840fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.145+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 shutdown_connections 2024-09-19T09:01:07.145 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:07.145+0000 7faf8918e640 1 -- 172.21.15.64:0/2514663199 wait complete. 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.706 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:07 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:07.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:07.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:07.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:07.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:07 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.732 DEBUG:teuthology.orchestra.run.smithi064:osd.11> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T09:01:07.735 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T09:01:07.735 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:01:07.763 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:07.763 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:07.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:07.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:07.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:07.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:07 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:08.003 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:08.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 -- 172.21.15.1:0/808044451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154101c00 msgr2=0x7f3154102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 --2- 172.21.15.1:0/808044451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154101c00 0x7f3154102000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3148009900 tx=0x7f314802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:08.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 -- 172.21.15.1:0/808044451 shutdown_connections 2024-09-19T09:01:08.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 --2- 172.21.15.1:0/808044451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31541037c0 0x7f315410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 --2- 172.21.15.1:0/808044451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3154102e00 0x7f3154103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 --2- 172.21.15.1:0/808044451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154101c00 0x7f3154102000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 -- 172.21.15.1:0/808044451 >> 172.21.15.1:0/808044451 conn(0x7f31540fd390 msgr2=0x7f31540ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 -- 172.21.15.1:0/808044451 shutdown_connections 2024-09-19T09:01:08.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 -- 172.21.15.1:0/808044451 wait complete. 2024-09-19T09:01:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 Processor -- start 2024-09-19T09:01:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 -- start start 2024-09-19T09:01:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.445+0000 7f315b238640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154101c00 0x7f3154197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f315b238640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102e00 0x7f3154198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f315b238640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541037c0 0x7f315419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f315b238640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f315410d9c0 con 0x7f3154102e00 2024-09-19T09:01:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f315b238640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f315410d840 con 0x7f3154101c00 2024-09-19T09:01:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f315b238640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f315410db40 con 0x7f31541037c0 2024-09-19T09:01:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541037c0 0x7f315419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f3153fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102e00 0x7f3154198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541037c0 0x7f315419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:36488/0 (socket says 172.21.15.1:36488) 2024-09-19T09:01:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 -- 172.21.15.1:0/359250883 learned_addr learned my addr 172.21.15.1:0/359250883 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f3158fd4640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154101c00 0x7f3154197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 -- 172.21.15.1:0/359250883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154101c00 msgr2=0x7f3154197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154101c00 0x7f3154197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 -- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102e00 msgr2=0x7f3154198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102e00 0x7f3154198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 -- 172.21.15.1:0/359250883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315419fbf0 con 0x7f31541037c0 2024-09-19T09:01:08.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f3153fff640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102e00 0x7f3154198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:08.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.446+0000 7f31597d5640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541037c0 0x7f315419f580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f314c00eaa0 tx=0x7f314c00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.447+0000 7f3151ffb640 1 -- 172.21.15.1:0/359250883 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c00cdb0 con 0x7f31541037c0 2024-09-19T09:01:08.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.447+0000 7f3151ffb640 1 -- 172.21.15.1:0/359250883 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f314c004b20 con 0x7f31541037c0 2024-09-19T09:01:08.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.447+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315419fee0 con 0x7f31541037c0 2024-09-19T09:01:08.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.447+0000 7f3151ffb640 1 -- 172.21.15.1:0/359250883 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c011760 con 0x7f31541037c0 2024-09-19T09:01:08.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.447+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541a0340 con 0x7f31541037c0 2024-09-19T09:01:08.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.448+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3154108fb0 con 0x7f31541037c0 2024-09-19T09:01:08.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.449+0000 7f3151ffb640 1 -- 172.21.15.1:0/359250883 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f314c005020 con 0x7f31541037c0 2024-09-19T09:01:08.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.449+0000 7f3151ffb640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31440a3270 0x7f31440a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:08.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.449+0000 7f3158fd4640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31440a3270 0x7f31440a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:08.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.449+0000 7f3151ffb640 1 -- 172.21.15.1:0/359250883 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7f314c0cf540 con 0x7f31541037c0 2024-09-19T09:01:08.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.450+0000 7f3158fd4640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31440a3270 0x7f31440a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3148031570 tx=0x7f3148031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:08.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.453+0000 7f3151ffb640 1 -- 172.21.15.1:0/359250883 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f314c016030 con 0x7f31541037c0 2024-09-19T09:01:08.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.634+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3154062df0 con 0x7f31541037c0 2024-09-19T09:01:08.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.634+0000 7f3151ffb640 1 -- 172.21.15.1:0/359250883 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f314c09c150 con 0x7f31541037c0 2024-09-19T09:01:08.635 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:08.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31440a3270 msgr2=0x7f31440a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31440a3270 0x7f31440a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3148031570 tx=0x7f3148031640 comp rx=0 tx=0).stop 2024-09-19T09:01:08.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541037c0 msgr2=0x7f315419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:08.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541037c0 0x7f315419f580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f314c00eaa0 tx=0x7f314c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:01:08.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 shutdown_connections 2024-09-19T09:01:08.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31440a3270 0x7f31440a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541037c0 0x7f315419f580 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102e00 0x7f3154198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 --2- 172.21.15.1:0/359250883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154101c00 0x7f3154197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:08.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 >> 172.21.15.1:0/359250883 conn(0x7f31540fd390 msgr2=0x7f3154106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:08.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 shutdown_connections 2024-09-19T09:01:08.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:08.637+0000 7f315b238640 1 -- 172.21.15.1:0/359250883 wait complete. 2024-09-19T09:01:09.386 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726736448,"num_in_osds":12,"osd_in_since":1726736449,"num_remapped_pgs":0} 2024-09-19T09:01:09.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:09 smithi022 ceph-mon[35107]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:09.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:09 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/359250883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:09.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:09 smithi001 ceph-mon[30939]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:09.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:09 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/359250883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:09.810 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:09 smithi064 ceph-mon[35179]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:09.810 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:09 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/359250883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:10.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:01:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:01:10.195+0000 7fceb345f640 -1 osd.11 0 log_to_monitors true 2024-09-19T09:01:10.387 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:01:10.660 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:10.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:10 smithi022 ceph-mon[35107]: from='osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:01:10.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:10 smithi022 ceph-mon[35107]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:01:10.781 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:10 smithi001 ceph-mon[30939]: from='osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:01:10.781 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:10 smithi001 ceph-mon[30939]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:01:10.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:10 smithi064 ceph-mon[35179]: from='osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:01:10.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:10 smithi064 ceph-mon[35179]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:01:11.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 -- 172.21.15.1:0/2053562860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82081037c0 msgr2=0x7f820810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:11.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 --2- 172.21.15.1:0/2053562860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82081037c0 0x7f820810a050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8200009ca0 tx=0x7f820002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 -- 172.21.15.1:0/2053562860 shutdown_connections 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 --2- 172.21.15.1:0/2053562860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82081037c0 0x7f820810a050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 --2- 172.21.15.1:0/2053562860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8208102e00 0x7f8208103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 --2- 172.21.15.1:0/2053562860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8208101c00 0x7f8208102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 -- 172.21.15.1:0/2053562860 >> 172.21.15.1:0/2053562860 conn(0x7f82080fd390 msgr2=0x7f82080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 -- 172.21.15.1:0/2053562860 shutdown_connections 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.243+0000 7f820e84d640 1 -- 172.21.15.1:0/2053562860 wait complete. 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820e84d640 1 Processor -- start 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820e84d640 1 -- start start 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820e84d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8208101c00 0x7f8208197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820e84d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8208102e00 0x7f8208198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820e84d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82081037c0 0x7f820819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820e84d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f820810d9e0 con 0x7f8208102e00 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820e84d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f820810d860 con 0x7f8208101c00 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820e84d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f820810db60 con 0x7f82081037c0 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f81fffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8208102e00 0x7f8208198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f81fffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8208102e00 0x7f8208198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45204/0 (socket says 172.21.15.1:45204) 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f81fffff640 1 -- 172.21.15.1:0/1979981415 learned_addr learned my addr 172.21.15.1:0/1979981415 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f820cdea640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82081037c0 0x7f820819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f8207fff640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8208101c00 0x7f8208197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f81fffff640 1 -- 172.21.15.1:0/1979981415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82081037c0 msgr2=0x7f820819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f81fffff640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82081037c0 0x7f820819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f81fffff640 1 -- 172.21.15.1:0/1979981415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8208101c00 msgr2=0x7f8208197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f81fffff640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8208101c00 0x7f8208197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f81fffff640 1 -- 172.21.15.1:0/1979981415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820819fb70 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.244+0000 7f8207fff640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8208101c00 0x7f8208197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.245+0000 7f81fffff640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8208102e00 0x7f8208198480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c970 tx=0x7f81f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.245+0000 7f8205ffb640 1 -- 172.21.15.1:0/1979981415 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0007bb0 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.245+0000 7f8205ffb640 1 -- 172.21.15.1:0/1979981415 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81f0007d50 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.245+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820819fe60 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.245+0000 7f8205ffb640 1 -- 172.21.15.1:0/1979981415 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f000f4b0 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.245+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82081a02c0 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.246+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8208108f30 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.247+0000 7f8205ffb640 1 -- 172.21.15.1:0/1979981415 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f81f00046c0 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.248+0000 7f8205ffb640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81f40a3270 0x7f81f40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.248+0000 7f8207fff640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81f40a3270 0x7f81f40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.248+0000 7f8205ffb640 1 -- 172.21.15.1:0/1979981415 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6831+0+0 (secure 0 0 0) 0x7f81f00cf120 con 0x7f8208102e00 2024-09-19T09:01:11.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.248+0000 7f8207fff640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81f40a3270 0x7f81f40a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f81f80058c0 tx=0x7f81f8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:11.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.252+0000 7f8205ffb640 1 -- 172.21.15.1:0/1979981415 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81f0014030 con 0x7f8208102e00 2024-09-19T09:01:11.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.426+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8208062e90 con 0x7f8208102e00 2024-09-19T09:01:11.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.427+0000 7f8205ffb640 1 -- 172.21.15.1:0/1979981415 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f81f009c370 con 0x7f8208102e00 2024-09-19T09:01:11.427 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:11.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81f40a3270 msgr2=0x7f81f40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:11.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81f40a3270 0x7f81f40a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f81f80058c0 tx=0x7f81f8005850 comp rx=0 tx=0).stop 2024-09-19T09:01:11.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8208102e00 msgr2=0x7f8208198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:11.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8208102e00 0x7f8208198480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c970 tx=0x7f81f000ce30 comp rx=0 tx=0).stop 2024-09-19T09:01:11.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 shutdown_connections 2024-09-19T09:01:11.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81f40a3270 0x7f81f40a5730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82081037c0 0x7f820819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8208102e00 0x7f8208198480 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 --2- 172.21.15.1:0/1979981415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8208101c00 0x7f8208197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:11.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 >> 172.21.15.1:0/1979981415 conn(0x7f82080fd390 msgr2=0x7f8208106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:11.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 shutdown_connections 2024-09-19T09:01:11.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:11.429+0000 7f820e84d640 1 -- 172.21.15.1:0/1979981415 wait complete. 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: Detected new or changed devices on smithi064 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: Adjusting osd_memory_target on smithi064 to 4272M 2024-09-19T09:01:11.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:11.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:11.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:11 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1979981415' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:01:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: Detected new or changed devices on smithi064 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: Adjusting osd_memory_target on smithi064 to 4272M 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:11.800 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:11.800 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.800 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:11 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1979981415' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:11.855 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:01:11.457+0000 7fceaebbf640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T09:01:11.856 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:01:11.473+0000 7fceab1f9640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]: dispatch 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: Detected new or changed devices on smithi064 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: Adjusting osd_memory_target on smithi064 to 4272M 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:11.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:11 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1979981415' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:12.103 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726736448,"num_in_osds":12,"osd_in_since":1726736449,"num_remapped_pgs":0} 2024-09-19T09:01:12.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:12 smithi001 ceph-mon[30939]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T09:01:12.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:12 smithi001 ceph-mon[30939]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:01:12.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:12.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:12.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:12 smithi064 ceph-mon[35179]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T09:01:12.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:12 smithi064 ceph-mon[35179]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:01:12.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:12.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:12.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:12 smithi022 ceph-mon[35107]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-09-19T09:01:12.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:12 smithi022 ceph-mon[35107]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:01:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:13.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:01:13.372 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:13.761 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:13 smithi001 ceph-mon[30939]: purged_snaps scrub starts 2024-09-19T09:01:13.761 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:13 smithi001 ceph-mon[30939]: purged_snaps scrub ok 2024-09-19T09:01:13.762 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:13 smithi001 ceph-mon[30939]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:13.762 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:13 smithi001 ceph-mon[30939]: osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] boot 2024-09-19T09:01:13.762 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:13 smithi001 ceph-mon[30939]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T09:01:13.762 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:13.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:13 smithi064 ceph-mon[35179]: purged_snaps scrub starts 2024-09-19T09:01:13.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:13 smithi064 ceph-mon[35179]: purged_snaps scrub ok 2024-09-19T09:01:13.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:13 smithi064 ceph-mon[35179]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:13.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:13 smithi064 ceph-mon[35179]: osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] boot 2024-09-19T09:01:13.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:13 smithi064 ceph-mon[35179]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T09:01:13.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:13.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:13 smithi022 ceph-mon[35107]: purged_snaps scrub starts 2024-09-19T09:01:13.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:13 smithi022 ceph-mon[35107]: purged_snaps scrub ok 2024-09-19T09:01:13.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:13 smithi022 ceph-mon[35107]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:01:13.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:13 smithi022 ceph-mon[35107]: osd.11 [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] boot 2024-09-19T09:01:13.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:13 smithi022 ceph-mon[35107]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T09:01:13.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:01:13.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 -- 172.21.15.1:0/2964851019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c1037c0 msgr2=0x7faa5c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 --2- 172.21.15.1:0/2964851019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c1037c0 0x7faa5c10a050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa54009900 tx=0x7faa5402a410 comp rx=0 tx=0).stop 2024-09-19T09:01:13.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 -- 172.21.15.1:0/2964851019 shutdown_connections 2024-09-19T09:01:13.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 --2- 172.21.15.1:0/2964851019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c1037c0 0x7faa5c10a050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 --2- 172.21.15.1:0/2964851019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa5c102e00 0x7faa5c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 --2- 172.21.15.1:0/2964851019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5c101c00 0x7faa5c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 -- 172.21.15.1:0/2964851019 >> 172.21.15.1:0/2964851019 conn(0x7faa5c0fd3b0 msgr2=0x7faa5c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 -- 172.21.15.1:0/2964851019 shutdown_connections 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 -- 172.21.15.1:0/2964851019 wait complete. 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.974+0000 7faa61266640 1 Processor -- start 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa61266640 1 -- start start 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa61266640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5c101c00 0x7faa5c1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa61266640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c102e00 0x7faa5c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa61266640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa61266640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10dac0 con 0x7faa5c102e00 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa61266640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10d940 con 0x7faa5c1037c0 2024-09-19T09:01:13.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa61266640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10dc40 con 0x7faa5c101c00 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c102e00 0x7faa5c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c102e00 0x7faa5c198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47466/0 (socket says 172.21.15.1:47466) 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5a7fc640 1 -- 172.21.15.1:0/2539464537 learned_addr learned my addr 172.21.15.1:0/2539464537 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5affd640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5c101c00 0x7faa5c1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5b7fe640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5a7fc640 1 -- 172.21.15.1:0/2539464537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5c101c00 msgr2=0x7faa5c1980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5a7fc640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5c101c00 0x7faa5c1980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5a7fc640 1 -- 172.21.15.1:0/2539464537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa5c1037c0 msgr2=0x7faa5c19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.975+0000 7faa5a7fc640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.976+0000 7faa5a7fc640 1 -- 172.21.15.1:0/2539464537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5c19fd10 con 0x7faa5c102e00 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.976+0000 7faa5b7fe640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.976+0000 7faa5a7fc640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c102e00 0x7faa5c198620 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faa4400b4a0 tx=0x7faa4400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.976+0000 7faa53fff640 1 -- 172.21.15.1:0/2539464537 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44014070 con 0x7faa5c102e00 2024-09-19T09:01:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.976+0000 7faa53fff640 1 -- 172.21.15.1:0/2539464537 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa44010b10 con 0x7faa5c102e00 2024-09-19T09:01:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.976+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5c19ffa0 con 0x7faa5c102e00 2024-09-19T09:01:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.976+0000 7faa53fff640 1 -- 172.21.15.1:0/2539464537 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44017d60 con 0x7faa5c102e00 2024-09-19T09:01:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.977+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5c1a0580 con 0x7faa5c102e00 2024-09-19T09:01:13.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.977+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5c102080 con 0x7faa5c102e00 2024-09-19T09:01:13.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.978+0000 7faa53fff640 1 -- 172.21.15.1:0/2539464537 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7faa44017070 con 0x7faa5c102e00 2024-09-19T09:01:13.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.979+0000 7faa53fff640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faa480a32f0 0x7faa480a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.979+0000 7faa5affd640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faa480a32f0 0x7faa480a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.979+0000 7faa53fff640 1 -- 172.21.15.1:0/2539464537 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7faa440ce7f0 con 0x7faa5c102e00 2024-09-19T09:01:13.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.979+0000 7faa5affd640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faa480a32f0 0x7faa480a57b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa5c102c60 tx=0x7faa4c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:13.983+0000 7faa53fff640 1 -- 172.21.15.1:0/2539464537 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa4409b910 con 0x7faa5c102e00 2024-09-19T09:01:14.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.161+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7faa5c062df0 con 0x7faa5c102e00 2024-09-19T09:01:14.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.161+0000 7faa53fff640 1 -- 172.21.15.1:0/2539464537 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7faa4409b210 con 0x7faa5c102e00 2024-09-19T09:01:14.162 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:14.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faa480a32f0 msgr2=0x7faa480a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faa480a32f0 0x7faa480a57b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa5c102c60 tx=0x7faa4c00d040 comp rx=0 tx=0).stop 2024-09-19T09:01:14.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c102e00 msgr2=0x7faa5c198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c102e00 0x7faa5c198620 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faa4400b4a0 tx=0x7faa4400b960 comp rx=0 tx=0).stop 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 shutdown_connections 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa5c102e00 0x7faa5c198620 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faa480a32f0 0x7faa480a57b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 --2- 172.21.15.1:0/2539464537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa5c101c00 0x7faa5c1980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 >> 172.21.15.1:0/2539464537 conn(0x7faa5c0fd3b0 msgr2=0x7faa5c106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 shutdown_connections 2024-09-19T09:01:14.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:14.163+0000 7faa61266640 1 -- 172.21.15.1:0/2539464537 wait complete. 2024-09-19T09:01:14.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:14 smithi001 ceph-mon[30939]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:01:14.731 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:14 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2539464537' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:14.759 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1726736472,"num_in_osds":12,"osd_in_since":1726736449,"num_remapped_pgs":0} 2024-09-19T09:01:14.760 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:01:14.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:14 smithi064 ceph-mon[35179]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:01:14.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:14 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2539464537' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:14.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:14 smithi022 ceph-mon[35107]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:01:14.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:14 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2539464537' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:01:15.012 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:15.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 -- 172.21.15.1:0/2340242109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 msgr2=0x7f3aac10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 --2- 172.21.15.1:0/2340242109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 0x7f3aac10bbb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009900 tx=0x7f3a9c02a480 comp rx=0 tx=0).stop 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 -- 172.21.15.1:0/2340242109 shutdown_connections 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 --2- 172.21.15.1:0/2340242109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aac10c180 0x7f3aac10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 --2- 172.21.15.1:0/2340242109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 0x7f3aac10bbb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 --2- 172.21.15.1:0/2340242109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aac102da0 0x7f3aac103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 -- 172.21.15.1:0/2340242109 >> 172.21.15.1:0/2340242109 conn(0x7f3aac0fc7a0 msgr2=0x7f3aac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 -- 172.21.15.1:0/2340242109 shutdown_connections 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.447+0000 7f3ab4711640 1 -- 172.21.15.1:0/2340242109 wait complete. 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab4711640 1 Processor -- start 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab4711640 1 -- start start 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab4711640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aac102da0 0x7f3aac1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab4711640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 0x7f3aac198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab4711640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aac10c180 0x7f3aac19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab4711640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac112080 con 0x7f3aac1036c0 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab4711640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac111f00 con 0x7f3aac102da0 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab4711640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3aac112200 con 0x7f3aac10c180 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab1cac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 0x7f3aac198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab1cac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 0x7f3aac198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47492/0 (socket says 172.21.15.1:47492) 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab1cac640 1 -- 172.21.15.1:0/1065349070 learned_addr learned my addr 172.21.15.1:0/1065349070 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.448+0000 7f3ab24ad640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aac102da0 0x7f3aac1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab2cae640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aac10c180 0x7f3aac19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab1cac640 1 -- 172.21.15.1:0/1065349070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aac10c180 msgr2=0x7f3aac19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab1cac640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aac10c180 0x7f3aac19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab1cac640 1 -- 172.21.15.1:0/1065349070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aac102da0 msgr2=0x7f3aac1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab1cac640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aac102da0 0x7f3aac1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab1cac640 1 -- 172.21.15.1:0/1065349070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aac19d490 con 0x7f3aac1036c0 2024-09-19T09:01:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab2cae640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aac10c180 0x7f3aac19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab1cac640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 0x7f3aac198a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c006010 tx=0x7f3a9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3aa37fe640 1 -- 172.21.15.1:0/1065349070 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c03f030 con 0x7f3aac1036c0 2024-09-19T09:01:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aac19d720 con 0x7f3aac1036c0 2024-09-19T09:01:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3aa37fe640 1 -- 172.21.15.1:0/1065349070 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a9c003d00 con 0x7f3aac1036c0 2024-09-19T09:01:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3aa37fe640 1 -- 172.21.15.1:0/1065349070 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c035070 con 0x7f3aac1036c0 2024-09-19T09:01:15.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.449+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aac1a5060 con 0x7f3aac1036c0 2024-09-19T09:01:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.451+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aac103180 con 0x7f3aac1036c0 2024-09-19T09:01:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.452+0000 7f3aa37fe640 1 -- 172.21.15.1:0/1065349070 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3a9c042030 con 0x7f3aac1036c0 2024-09-19T09:01:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.452+0000 7f3aa37fe640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a980a3240 0x7f3a980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.453+0000 7f3ab24ad640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a980a3240 0x7f3a980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.453+0000 7f3aa37fe640 1 -- 172.21.15.1:0/1065349070 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3a9c0effe0 con 0x7f3aac1036c0 2024-09-19T09:01:15.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.453+0000 7f3ab24ad640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a980a3240 0x7f3a980a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800abe0 tx=0x7f3aa800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:15.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.456+0000 7f3aa37fe640 1 -- 172.21.15.1:0/1065349070 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a9c0bd160 con 0x7f3aac1036c0 2024-09-19T09:01:15.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.637+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3aac1071c0 con 0x7f3aac1036c0 2024-09-19T09:01:15.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.637+0000 7f3aa37fe640 1 -- 172.21.15.1:0/1065349070 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18327 (secure 0 0 0) 0x7f3a9c0bca60 con 0x7f3aac1036c0 2024-09-19T09:01:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:15.639 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":73,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:01:13.459918+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.639+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a980a3240 msgr2=0x7f3a980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.639+0000 7f3ab4711640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a980a3240 0x7f3a980a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800abe0 tx=0x7f3aa800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 msgr2=0x7f3aac198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 0x7f3aac198a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c006010 tx=0x7f3a9c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 shutdown_connections 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a980a3240 0x7f3a980a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3aac10c180 0x7f3aac19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3aac1036c0 0x7f3aac198a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 --2- 172.21.15.1:0/1065349070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3aac102da0 0x7f3aac1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 >> 172.21.15.1:0/1065349070 conn(0x7f3aac0fc7a0 msgr2=0x7f3aac0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:15.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 shutdown_connections 2024-09-19T09:01:15.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:15.640+0000 7f3ab4711640 1 -- 172.21.15.1:0/1065349070 wait complete. 2024-09-19T09:01:15.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:15 smithi001 ceph-mon[30939]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:15.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:15 smithi064 ceph-mon[35179]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:15.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:15 smithi022 ceph-mon[35107]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:16.304 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:57:30.365239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:01:16.304 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T09:01:16.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:16 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1065349070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:16.560 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:16.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:16 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1065349070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:16.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:16 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1065349070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:01:17.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 -- 172.21.15.1:0/125603812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074590 msgr2=0x7f9e40074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/125603812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074590 0x7f9e40074970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009900 tx=0x7f9e3c02a480 comp rx=0 tx=0).stop 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 -- 172.21.15.1:0/125603812 shutdown_connections 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/125603812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e40112b90 0x7f9e40114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/125603812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e40074eb0 0x7f9e40112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/125603812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074590 0x7f9e40074970 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 -- 172.21.15.1:0/125603812 >> 172.21.15.1:0/125603812 conn(0x7f9e400fd8c0 msgr2=0x7f9e400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 -- 172.21.15.1:0/125603812 shutdown_connections 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.042+0000 7f9e47f2e640 1 -- 172.21.15.1:0/125603812 wait complete. 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e47f2e640 1 Processor -- start 2024-09-19T09:01:17.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e47f2e640 1 -- start start 2024-09-19T09:01:17.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e47f2e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e40074590 0x7f9e401a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e47f2e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074eb0 0x7f9e401a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e47f2e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e40112b90 0x7f9e4019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e47f2e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9e401186b0 con 0x7f9e40074eb0 2024-09-19T09:01:17.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e47f2e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9e40118530 con 0x7f9e40112b90 2024-09-19T09:01:17.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e47f2e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9e40118830 con 0x7f9e40074590 2024-09-19T09:01:17.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e454c9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074eb0 0x7f9e401a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e454c9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074eb0 0x7f9e401a4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47498/0 (socket says 172.21.15.1:47498) 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e454c9640 1 -- 172.21.15.1:0/551280254 learned_addr learned my addr 172.21.15.1:0/551280254 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e45cca640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e40074590 0x7f9e401a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.043+0000 7f9e464cb640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e40112b90 0x7f9e4019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e454c9640 1 -- 172.21.15.1:0/551280254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e40074590 msgr2=0x7f9e401a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e454c9640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e40074590 0x7f9e401a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e454c9640 1 -- 172.21.15.1:0/551280254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e40112b90 msgr2=0x7f9e4019e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e454c9640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e40112b90 0x7f9e4019e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e454c9640 1 -- 172.21.15.1:0/551280254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4019f0f0 con 0x7f9e40074eb0 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e454c9640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074eb0 0x7f9e401a4d40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000d950 tx=0x7f9e3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e36ffd640 1 -- 172.21.15.1:0/551280254 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30017070 con 0x7f9e40074eb0 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e36ffd640 1 -- 172.21.15.1:0/551280254 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e30009c30 con 0x7f9e40074eb0 2024-09-19T09:01:17.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4019f3e0 con 0x7f9e40074eb0 2024-09-19T09:01:17.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e36ffd640 1 -- 172.21.15.1:0/551280254 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000f740 con 0x7f9e40074eb0 2024-09-19T09:01:17.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.044+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e401ab6d0 con 0x7f9e40074eb0 2024-09-19T09:01:17.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.045+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e40074970 con 0x7f9e40074eb0 2024-09-19T09:01:17.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.046+0000 7f9e36ffd640 1 -- 172.21.15.1:0/551280254 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9e30010a80 con 0x7f9e40074eb0 2024-09-19T09:01:17.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.047+0000 7f9e36ffd640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9e2c0a3240 0x7f9e2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.047+0000 7f9e45cca640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9e2c0a3240 0x7f9e2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.047+0000 7f9e36ffd640 1 -- 172.21.15.1:0/551280254 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f9e300cf100 con 0x7f9e40074eb0 2024-09-19T09:01:17.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.048+0000 7f9e45cca640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9e2c0a3240 0x7f9e2c0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e4019fb00 tx=0x7f9e3c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:17.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.050+0000 7f9e36ffd640 1 -- 172.21.15.1:0/551280254 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e30009de0 con 0x7f9e40074eb0 2024-09-19T09:01:17.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.224+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9e401ab9c0 con 0x7f9e40074eb0 2024-09-19T09:01:17.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.224+0000 7f9e36ffd640 1 -- 172.21.15.1:0/551280254 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f9e3009c220 con 0x7f9e40074eb0 2024-09-19T09:01:17.226 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-19T09:01:17.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.226+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9e2c0a3240 msgr2=0x7f9e2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.226+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9e2c0a3240 0x7f9e2c0a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e4019fb00 tx=0x7f9e3c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.226+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074eb0 msgr2=0x7f9e401a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.226+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074eb0 0x7f9e401a4d40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000d950 tx=0x7f9e3000de10 comp rx=0 tx=0).stop 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.226+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 shutdown_connections 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.226+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e40112b90 0x7f9e4019e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.226+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e40074eb0 0x7f9e401a4d40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.226+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9e2c0a3240 0x7f9e2c0a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.227+0000 7f9e47f2e640 1 --2- 172.21.15.1:0/551280254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e40074590 0x7f9e401a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.227+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 >> 172.21.15.1:0/551280254 conn(0x7f9e400fd8c0 msgr2=0x7f9e400ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.227+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 shutdown_connections 2024-09-19T09:01:17.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:17.227+0000 7f9e47f2e640 1 -- 172.21.15.1:0/551280254 wait complete. 2024-09-19T09:01:17.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:17 smithi001 ceph-mon[30939]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:17.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:17 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/551280254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:01:17.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:17 smithi064 ceph-mon[35179]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:17.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:17 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/551280254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:01:17.953 INFO:tasks.cephadm:Adding mds.a on smithi001 2024-09-19T09:01:17.953 INFO:tasks.cephadm:Adding mds.d on smithi001 2024-09-19T09:01:17.953 INFO:tasks.cephadm:Adding mds.g on smithi001 2024-09-19T09:01:17.953 INFO:tasks.cephadm:Adding mds.j on smithi001 2024-09-19T09:01:17.953 INFO:tasks.cephadm:Adding mds.b on smithi022 2024-09-19T09:01:17.954 INFO:tasks.cephadm:Adding mds.e on smithi022 2024-09-19T09:01:17.954 INFO:tasks.cephadm:Adding mds.h on smithi022 2024-09-19T09:01:17.954 INFO:tasks.cephadm:Adding mds.k on smithi022 2024-09-19T09:01:17.954 INFO:tasks.cephadm:Adding mds.c on smithi064 2024-09-19T09:01:17.954 INFO:tasks.cephadm:Adding mds.f on smithi064 2024-09-19T09:01:17.955 INFO:tasks.cephadm:Adding mds.i on smithi064 2024-09-19T09:01:17.955 INFO:tasks.cephadm:Adding mds.l on smithi064 2024-09-19T09:01:17.955 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l' 2024-09-19T09:01:17.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:17 smithi022 ceph-mon[35107]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:17.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:17 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/551280254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:01:18.221 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:01:18.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 -- 172.21.15.64:0/796229460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 msgr2=0x7f3204107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 --2- 172.21.15.64:0/796229460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 0x7f3204107380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3200009900 tx=0x7f320002a410 comp rx=0 tx=0).stop 2024-09-19T09:01:18.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 -- 172.21.15.64:0/796229460 shutdown_connections 2024-09-19T09:01:18.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 --2- 172.21.15.64:0/796229460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32041078c0 0x7f3204109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.753 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 --2- 172.21.15.64:0/796229460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 0x7f3204107380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 --2- 172.21.15.64:0/796229460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3204102660 0x7f3204104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 -- 172.21.15.64:0/796229460 >> 172.21.15.64:0/796229460 conn(0x7f32040fc280 msgr2=0x7f32040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 -- 172.21.15.64:0/796229460 shutdown_connections 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.751+0000 7f320ba53640 1 -- 172.21.15.64:0/796229460 wait complete. 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f320ba53640 1 Processor -- start 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f320ba53640 1 -- start start 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f320ba53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3204102660 0x7f3204197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f320ba53640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 0x7f3204198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f320ba53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32041078c0 0x7f320419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f320ba53640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f320410d990 con 0x7f32041078c0 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f320ba53640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f320410d810 con 0x7f3204102660 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f320ba53640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f320410db10 con 0x7f3204104f90 2024-09-19T09:01:18.754 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f3208fee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 0x7f3204198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f3208fee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 0x7f3204198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36480/0 (socket says 172.21.15.64:36480) 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f3208fee640 1 -- 172.21.15.64:0/2953305554 learned_addr learned my addr 172.21.15.64:0/2953305554 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f3209ff0640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32041078c0 0x7f320419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f32097ef640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3204102660 0x7f3204197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.752+0000 7f3208fee640 1 -- 172.21.15.64:0/2953305554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3204102660 msgr2=0x7f3204197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f3208fee640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3204102660 0x7f3204197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f3208fee640 1 -- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32041078c0 msgr2=0x7f320419f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f3208fee640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32041078c0 0x7f320419f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f3208fee640 1 -- 172.21.15.64:0/2953305554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320419fc20 con 0x7f3204104f90 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f32097ef640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3204102660 0x7f3204197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:18.755 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f3209ff0640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32041078c0 0x7f320419f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:18.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f3208fee640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 0x7f3204198530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3200009230 tx=0x7f32000042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f31f67fc640 1 -- 172.21.15.64:0/2953305554 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320003f030 con 0x7f3204104f90 2024-09-19T09:01:18.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f31f67fc640 1 -- 172.21.15.64:0/2953305554 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3200003d00 con 0x7f3204104f90 2024-09-19T09:01:18.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320419feb0 con 0x7f3204104f90 2024-09-19T09:01:18.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f31f67fc640 1 -- 172.21.15.64:0/2953305554 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200035070 con 0x7f3204104f90 2024-09-19T09:01:18.756 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.753+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32041a0300 con 0x7f3204104f90 2024-09-19T09:01:18.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.754+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32040fdd70 con 0x7f3204104f90 2024-09-19T09:01:18.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.755+0000 7f31f67fc640 1 -- 172.21.15.64:0/2953305554 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3200042030 con 0x7f3204104f90 2024-09-19T09:01:18.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.756+0000 7f31f67fc640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31f00a3270 0x7f31f00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:18.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.756+0000 7f31f67fc640 1 -- 172.21.15.64:0/2953305554 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f32000efdb0 con 0x7f3204104f90 2024-09-19T09:01:18.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.756+0000 7f32097ef640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31f00a3270 0x7f31f00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:18.757 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.757+0000 7f32097ef640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31f00a3270 0x7f31f00a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009c20 tx=0x7f31f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:18.759 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.759+0000 7f31f67fc640 1 -- 172.21.15.64:0/2953305554 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32000bcf70 con 0x7f3204104f90 2024-09-19T09:01:18.945 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.945+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l", "target": ["mon-mgr", ""]}) -- 0x7f32040627f0 con 0x7f31f00a3270 2024-09-19T09:01:18.952 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.952+0000 7f31f67fc640 1 -- 172.21.15.64:0/2953305554 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f32040627f0 con 0x7f31f00a3270 2024-09-19T09:01:18.952 INFO:teuthology.orchestra.run.smithi064.stdout:Scheduled mds.all update... 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.954+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31f00a3270 msgr2=0x7f31f00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31f00a3270 0x7f31f00a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009c20 tx=0x7f31f8005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 msgr2=0x7f3204198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 0x7f3204198530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3200009230 tx=0x7f32000042f0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 shutdown_connections 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32041078c0 0x7f320419f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31f00a3270 0x7f31f00a5730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3204104f90 0x7f3204198530 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 --2- 172.21.15.64:0/2953305554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3204102660 0x7f3204197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 >> 172.21.15.64:0/2953305554 conn(0x7f32040fc280 msgr2=0x7f3204102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 shutdown_connections 2024-09-19T09:01:18.955 INFO:teuthology.orchestra.run.smithi064.stderr:2024-09-19T09:01:18.955+0000 7f320ba53640 1 -- 172.21.15.64:0/2953305554 wait complete. 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:19.768 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:19 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:19.794 DEBUG:teuthology.orchestra.run.smithi001:mds.a> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T09:01:19.797 DEBUG:teuthology.orchestra.run.smithi001:mds.d> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T09:01:19.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:19.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:19.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:19.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:19.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:19.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:19.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:19.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:19.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:19 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:19.841 DEBUG:teuthology.orchestra.run.smithi001:mds.g> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T09:01:19.885 DEBUG:teuthology.orchestra.run.smithi001:mds.j> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T09:01:19.928 DEBUG:teuthology.orchestra.run.smithi022:mds.b> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T09:01:19.930 DEBUG:teuthology.orchestra.run.smithi022:mds.e> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T09:01:19.955 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:19.955 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:19.955 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:19.955 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:19.955 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:19.955 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:19.956 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:19.956 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:19.956 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:19 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:19.957 DEBUG:teuthology.orchestra.run.smithi022:mds.h> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T09:01:19.999 DEBUG:teuthology.orchestra.run.smithi022:mds.k> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T09:01:20.043 DEBUG:teuthology.orchestra.run.smithi064:mds.c> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T09:01:20.045 DEBUG:teuthology.orchestra.run.smithi064:mds.f> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T09:01:20.088 DEBUG:teuthology.orchestra.run.smithi064:mds.i> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T09:01:20.131 DEBUG:teuthology.orchestra.run.smithi064:mds.l> sudo journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T09:01:20.175 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T09:01:20.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:20.433 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:20.748 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:20 smithi064 ceph-mon[35179]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:20.748 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:20 smithi064 ceph-mon[35179]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l;count:12 2024-09-19T09:01:20.749 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:20 smithi064 ceph-mon[35179]: Deploying daemon mds.l on smithi064 2024-09-19T09:01:20.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:20 smithi001 ceph-mon[30939]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:20.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:20 smithi001 ceph-mon[30939]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l;count:12 2024-09-19T09:01:20.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:20 smithi001 ceph-mon[30939]: Deploying daemon mds.l on smithi064 2024-09-19T09:01:20.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 -- 172.21.15.1:0/3337517879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410c2f0 msgr2=0x7f18c410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:20.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/3337517879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410c2f0 0x7f18c410e790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009ca0 tx=0x7f18bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 -- 172.21.15.1:0/3337517879 shutdown_connections 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/3337517879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c410c2f0 0x7f18c410e790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/3337517879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18c41037a0 0x7f18c410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/3337517879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18c4102df0 0x7f18c41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 -- 172.21.15.1:0/3337517879 >> 172.21.15.1:0/3337517879 conn(0x7f18c40fc7d0 msgr2=0x7f18c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 -- 172.21.15.1:0/3337517879 shutdown_connections 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.881+0000 7f18cb0ba640 1 -- 172.21.15.1:0/3337517879 wait complete. 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18cb0ba640 1 Processor -- start 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18cb0ba640 1 -- start start 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18cb0ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c4102df0 0x7f18c41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18cb0ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18c41037a0 0x7f18c4198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18cb0ba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18c410c2f0 0x7f18c419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:20.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18cb0ba640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4112250 con 0x7f18c4102df0 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18cb0ba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41120d0 con 0x7f18c41037a0 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18cb0ba640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41123d0 con 0x7f18c410c2f0 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c8e56640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c4102df0 0x7f18c41986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c8e56640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c4102df0 0x7f18c41986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47516/0 (socket says 172.21.15.1:47516) 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c8e56640 1 -- 172.21.15.1:0/2108443205 learned_addr learned my addr 172.21.15.1:0/2108443205 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c9657640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18c410c2f0 0x7f18c419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c3fff640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18c41037a0 0x7f18c4198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c8e56640 1 -- 172.21.15.1:0/2108443205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18c410c2f0 msgr2=0x7f18c419cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c8e56640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18c410c2f0 0x7f18c419cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c8e56640 1 -- 172.21.15.1:0/2108443205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18c41037a0 msgr2=0x7f18c4198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c8e56640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18c41037a0 0x7f18c4198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c8e56640 1 -- 172.21.15.1:0/2108443205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c419d680 con 0x7f18c4102df0 2024-09-19T09:01:20.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.882+0000 7f18c3fff640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18c41037a0 0x7f18c4198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.883+0000 7f18c8e56640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c4102df0 0x7f18c41986d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f18b400e9f0 tx=0x7f18b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.883+0000 7f18c1ffb640 1 -- 172.21.15.1:0/2108443205 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b400cd80 con 0x7f18c4102df0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.883+0000 7f18c1ffb640 1 -- 172.21.15.1:0/2108443205 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f18b4005520 con 0x7f18c4102df0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.883+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c419d970 con 0x7f18c4102df0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.883+0000 7f18c1ffb640 1 -- 172.21.15.1:0/2108443205 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4010690 con 0x7f18c4102df0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.883+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c41a5250 con 0x7f18c4102df0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.884+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c41031d0 con 0x7f18c4102df0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.885+0000 7f18c1ffb640 1 -- 172.21.15.1:0/2108443205 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f18b40046c0 con 0x7f18c4102df0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.886+0000 7f18c1ffb640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18ac0a32c0 0x7f18ac0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.886+0000 7f18c3fff640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18ac0a32c0 0x7f18ac0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.886+0000 7f18c1ffb640 1 -- 172.21.15.1:0/2108443205 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f18b40cf8d0 con 0x7f18c4102df0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.887+0000 7f18c3fff640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18ac0a32c0 0x7f18ac0a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f18c410d5a0 tx=0x7f18b8005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:20.890+0000 7f18c1ffb640 1 -- 172.21.15.1:0/2108443205 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f18b409ca90 con 0x7f18c4102df0 2024-09-19T09:01:20.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:20 smithi022 ceph-mon[35107]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:01:20.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:20 smithi022 ceph-mon[35107]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l;count:12 2024-09-19T09:01:20.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:20 smithi022 ceph-mon[35107]: Deploying daemon mds.l on smithi064 2024-09-19T09:01:21.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.101+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18c4199a30 con 0x7f18c4102df0 2024-09-19T09:01:21.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.101+0000 7f18c1ffb640 1 -- 172.21.15.1:0/2108443205 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f18b409c390 con 0x7f18c4102df0 2024-09-19T09:01:21.102 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:21.102 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"btime":"2024-09-19T08:54:23:245014+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T09:01:21.103 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-09-19T09:01:21.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18ac0a32c0 msgr2=0x7f18ac0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18ac0a32c0 0x7f18ac0a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f18c410d5a0 tx=0x7f18b8005cb0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c4102df0 msgr2=0x7f18c41986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c4102df0 0x7f18c41986d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f18b400e9f0 tx=0x7f18b400edf0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 shutdown_connections 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18ac0a32c0 0x7f18ac0a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18c410c2f0 0x7f18c419cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18c41037a0 0x7f18c4198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 --2- 172.21.15.1:0/2108443205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18c4102df0 0x7f18c41986d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.103+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 >> 172.21.15.1:0/2108443205 conn(0x7f18c40fc7d0 msgr2=0x7f18c40fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.104+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 shutdown_connections 2024-09-19T09:01:21.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:21.104+0000 7f18cb0ba640 1 -- 172.21.15.1:0/2108443205 wait complete. 2024-09-19T09:01:21.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:21 smithi064 ceph-mon[35179]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:21.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:21 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2108443205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:21.606 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:01:21 smithi064 podman[65002]: 2024-09-19 09:01:21.518248103 +0000 UTC m=+0.115361973 container create 913a9f622878eee818079139c6722498ba6a93deb1e2251e82c9cefe9e620aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:01:21.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:21 smithi001 ceph-mon[30939]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:21.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:21 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2108443205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:21.860 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:21 smithi022 ceph-mon[35107]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:21.860 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:21 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2108443205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:22.109 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:01:21 smithi064 podman[65002]: 2024-09-19 09:01:21.737516413 +0000 UTC m=+0.334630285 container init 913a9f622878eee818079139c6722498ba6a93deb1e2251e82c9cefe9e620aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:01:22.109 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:01:21 smithi064 podman[65002]: 2024-09-19 09:01:21.740306428 +0000 UTC m=+0.337420305 container start 913a9f622878eee818079139c6722498ba6a93deb1e2251e82c9cefe9e620aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:01:22.109 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:01:21 smithi064 ceph-mds[65021]: -- 172.21.15.64:0/2676495998 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b50eab860 con 0x559b50e89000 2024-09-19T09:01:22.109 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:01:21 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l[65017]: starting mds.l at 2024-09-19T09:01:22.109 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:01:21 smithi064 bash[65002]: 913a9f622878eee818079139c6722498ba6a93deb1e2251e82c9cefe9e620aaa 2024-09-19T09:01:22.109 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:01:21 smithi064 systemd[1]: Started Ceph mds.l for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:22.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.64:6832/1311787098,v1:172.21.15.64:6833/1311787098] up:boot 2024-09-19T09:01:22.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: fsmap 1 up:standby 2024-09-19T09:01:22.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:01:22.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:22.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:22.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:22.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:22.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:22.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:22 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:23.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.64:6832/1311787098,v1:172.21.15.64:6833/1311787098] up:boot 2024-09-19T09:01:23.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: fsmap 1 up:standby 2024-09-19T09:01:23.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:01:23.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:23.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:23.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:23.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:23.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:23.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:22 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.64:6832/1311787098,v1:172.21.15.64:6833/1311787098] up:boot 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: fsmap 1 up:standby 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:23.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:22 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:23.919 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:23.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:23 smithi022 ceph-mon[35107]: Deploying daemon mds.k on smithi022 2024-09-19T09:01:23.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:23 smithi022 ceph-mon[35107]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:23.959 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:23 smithi022 systemd[1]: Starting Ceph mds.k for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:24.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:23 smithi001 ceph-mon[30939]: Deploying daemon mds.k on smithi022 2024-09-19T09:01:24.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:23 smithi001 ceph-mon[30939]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:24.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:23 smithi064 ceph-mon[35179]: Deploying daemon mds.k on smithi022 2024-09-19T09:01:24.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:23 smithi064 ceph-mon[35179]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:24.189 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:24.294 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:24 smithi022 podman[64507]: 2024-09-19 09:01:23.924763871 +0000 UTC m=+0.016192641 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:24.294 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:24 smithi022 podman[64507]: 2024-09-19 09:01:24.066953219 +0000 UTC m=+0.158381988 container create 1678cd433e7b96f27ba41422740e6c0c2863c617f164c7711d50be87e18edca1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:01:24.294 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:24 smithi022 podman[64507]: 2024-09-19 09:01:24.294234753 +0000 UTC m=+0.385663522 container init 1678cd433e7b96f27ba41422740e6c0c2863c617f164c7711d50be87e18edca1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T09:01:24.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 -- 172.21.15.1:0/2938783867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618100e20 msgr2=0x7fc618101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2938783867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618100e20 0x7fc618101200 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc608009900 tx=0x7fc60802a480 comp rx=0 tx=0).stop 2024-09-19T09:01:24.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 -- 172.21.15.1:0/2938783867 shutdown_connections 2024-09-19T09:01:24.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2938783867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc618102ef0 0x7fc61810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2938783867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc618102570 0x7fc6181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2938783867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618100e20 0x7fc618101200 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 -- 172.21.15.1:0/2938783867 >> 172.21.15.1:0/2938783867 conn(0x7fc6180fc7d0 msgr2=0x7fc6180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 -- 172.21.15.1:0/2938783867 shutdown_connections 2024-09-19T09:01:24.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.656+0000 7fc61e41e640 1 -- 172.21.15.1:0/2938783867 wait complete. 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.657+0000 7fc61e41e640 1 Processor -- start 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.657+0000 7fc61e41e640 1 -- start start 2024-09-19T09:01:24.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.657+0000 7fc61e41e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc618100e20 0x7fc6181a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.657+0000 7fc61e41e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc618102570 0x7fc6181a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.657+0000 7fc61e41e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618102ef0 0x7fc61819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.657+0000 7fc61e41e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6181110e0 con 0x7fc618102ef0 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.657+0000 7fc61e41e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc618110f60 con 0x7fc618100e20 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.657+0000 7fc61e41e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc618111260 con 0x7fc618102570 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618102ef0 0x7fc61819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618102ef0 0x7fc61819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50246/0 (socket says 172.21.15.1:50246) 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 -- 172.21.15.1:0/2999741366 learned_addr learned my addr 172.21.15.1:0/2999741366 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc6177fe640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc618102570 0x7fc6181a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc617fff640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc618100e20 0x7fc6181a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 -- 172.21.15.1:0/2999741366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc618102570 msgr2=0x7fc6181a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc618102570 0x7fc6181a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 -- 172.21.15.1:0/2999741366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc618100e20 msgr2=0x7fc6181a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc618100e20 0x7fc6181a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 -- 172.21.15.1:0/2999741366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61819aec0 con 0x7fc618102ef0 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc617fff640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc618100e20 0x7fc6181a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc61c9bb640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618102ef0 0x7fc61819a650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc61000cad0 tx=0x7fc61000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc6157fa640 1 -- 172.21.15.1:0/2999741366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61000ad60 con 0x7fc618102ef0 2024-09-19T09:01:24.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.658+0000 7fc6157fa640 1 -- 172.21.15.1:0/2999741366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc610004b20 con 0x7fc618102ef0 2024-09-19T09:01:24.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.659+0000 7fc6157fa640 1 -- 172.21.15.1:0/2999741366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61000f6f0 con 0x7fc618102ef0 2024-09-19T09:01:24.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.659+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61819b1b0 con 0x7fc618102ef0 2024-09-19T09:01:24.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.659+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6181a7500 con 0x7fc618102ef0 2024-09-19T09:01:24.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.660+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6181021b0 con 0x7fc618102ef0 2024-09-19T09:01:24.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.662+0000 7fc6157fa640 1 -- 172.21.15.1:0/2999741366 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc61000f8d0 con 0x7fc618102ef0 2024-09-19T09:01:24.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.663+0000 7fc6157fa640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc6000a32c0 0x7fc6000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.663+0000 7fc6157fa640 1 -- 172.21.15.1:0/2999741366 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc6100cf810 con 0x7fc618102ef0 2024-09-19T09:01:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.663+0000 7fc617fff640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc6000a32c0 0x7fc6000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:24.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.663+0000 7fc617fff640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc6000a32c0 0x7fc6000a5780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc608009230 tx=0x7fc6080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:24.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.666+0000 7fc6157fa640 1 -- 172.21.15.1:0/2999741366 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc610014030 con 0x7fc618102ef0 2024-09-19T09:01:24.708 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:24 smithi022 podman[64507]: 2024-09-19 09:01:24.297536945 +0000 UTC m=+0.388965718 container start 1678cd433e7b96f27ba41422740e6c0c2863c617f164c7711d50be87e18edca1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:01:24.708 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:24 smithi022 ceph-mds[64526]: -- 172.21.15.22:0/4159795114 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a84f123c20 con 0x55a84f101400 2024-09-19T09:01:24.708 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:24 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k[64522]: starting mds.k at 2024-09-19T09:01:24.709 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:24 smithi022 bash[64507]: 1678cd433e7b96f27ba41422740e6c0c2863c617f164c7711d50be87e18edca1 2024-09-19T09:01:24.709 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:01:24 smithi022 systemd[1]: Started Ceph mds.k for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:24.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.884+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc61819bbb0 con 0x7fc618102ef0 2024-09-19T09:01:24.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.884+0000 7fc6157fa640 1 -- 172.21.15.1:0/2999741366 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2257 (secure 0 0 0) 0x7fc61819bbb0 con 0x7fc618102ef0 2024-09-19T09:01:24.886 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:24.886 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":3,"btime":"2024-09-19T09:01:24:772565+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:01:24.886 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 3 2024-09-19T09:01:24.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc6000a32c0 msgr2=0x7fc6000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc6000a32c0 0x7fc6000a5780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc608009230 tx=0x7fc6080058d0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618102ef0 msgr2=0x7fc61819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618102ef0 0x7fc61819a650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc61000cad0 tx=0x7fc61000ced0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 shutdown_connections 2024-09-19T09:01:24.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc618102ef0 0x7fc61819a650 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc6000a32c0 0x7fc6000a5780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc618102570 0x7fc6181a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 --2- 172.21.15.1:0/2999741366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc618100e20 0x7fc6181a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 >> 172.21.15.1:0/2999741366 conn(0x7fc6180fc7d0 msgr2=0x7fc61806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 shutdown_connections 2024-09-19T09:01:24.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:24.887+0000 7fc61e41e640 1 -- 172.21.15.1:0/2999741366 wait complete. 2024-09-19T09:01:25.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: Deploying daemon mds.j on smithi001 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6832/670081711,v1:172.21.15.22:6833/670081711] up:boot 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: fsmap 2 up:standby 2024-09-19T09:01:25.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:01:25.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:25 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2999741366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:25.706 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: Deploying daemon mds.j on smithi001 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6832/670081711,v1:172.21.15.22:6833/670081711] up:boot 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: fsmap 2 up:standby 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:01:25.707 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:25 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2999741366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: Deploying daemon mds.j on smithi001 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6832/670081711,v1:172.21.15.22:6833/670081711] up:boot 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: fsmap 2 up:standby 2024-09-19T09:01:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:01:25.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:25 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2999741366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:27.290 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 systemd[1]: Starting Ceph mds.j for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:27.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:27 smithi001 ceph-mon[30939]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:27.547 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 podman[71039]: 2024-09-19 09:01:27.193540679 +0000 UTC m=+0.016445580 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:27.547 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 podman[71039]: 2024-09-19 09:01:27.328321533 +0000 UTC m=+0.151226418 container create d466a458bcb380604fd958ac1363df39f9732bb03750632267e9941ab52d4d85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:01:27.547 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 podman[71039]: 2024-09-19 09:01:27.547843193 +0000 UTC m=+0.370748078 container init d466a458bcb380604fd958ac1363df39f9732bb03750632267e9941ab52d4d85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T09:01:27.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:27 smithi022 ceph-mon[35107]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:27.798 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 podman[71039]: 2024-09-19 09:01:27.550995445 +0000 UTC m=+0.373900339 container start d466a458bcb380604fd958ac1363df39f9732bb03750632267e9941ab52d4d85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:01:27.798 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 ceph-mds[71057]: -- 172.21.15.1:0/1486097839 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d16279860 con 0x561d16257000 2024-09-19T09:01:27.798 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j[71053]: starting mds.j at 2024-09-19T09:01:27.798 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 bash[71039]: d466a458bcb380604fd958ac1363df39f9732bb03750632267e9941ab52d4d85 2024-09-19T09:01:27.798 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:01:27 smithi001 systemd[1]: Started Ceph mds.j for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:27.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:27 smithi064 ceph-mon[35179]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:28.168 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:28.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: Deploying daemon mds.d on smithi001 2024-09-19T09:01:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.1:6834/250950179,v1:172.21.15.1:6835/250950179] up:boot 2024-09-19T09:01:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: fsmap 3 up:standby 2024-09-19T09:01:28.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:28 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:01:28.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: Deploying daemon mds.d on smithi001 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.1:6834/250950179,v1:172.21.15.1:6835/250950179] up:boot 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: fsmap 3 up:standby 2024-09-19T09:01:28.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:28 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:01:29.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:29.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:29.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:29.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:29.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:29.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:29.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: Deploying daemon mds.d on smithi001 2024-09-19T09:01:29.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.1:6834/250950179,v1:172.21.15.1:6835/250950179] up:boot 2024-09-19T09:01:29.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: fsmap 3 up:standby 2024-09-19T09:01:29.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:28 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:01:29.274 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 -- 172.21.15.1:0/2607185864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081036e0 msgr2=0x7f3408107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 --2- 172.21.15.1:0/2607185864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081036e0 0x7f3408107b90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009930 tx=0x7f33f002a420 comp rx=0 tx=0).stop 2024-09-19T09:01:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 -- 172.21.15.1:0/2607185864 shutdown_connections 2024-09-19T09:01:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 --2- 172.21.15.1:0/2607185864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34081082a0 0x7f340810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 --2- 172.21.15.1:0/2607185864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081036e0 0x7f3408107b90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 --2- 172.21.15.1:0/2607185864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3408102d30 0x7f3408103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 -- 172.21.15.1:0/2607185864 >> 172.21.15.1:0/2607185864 conn(0x7f34080fc7d0 msgr2=0x7f34080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 -- 172.21.15.1:0/2607185864 shutdown_connections 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.763+0000 7f340d79c640 1 -- 172.21.15.1:0/2607185864 wait complete. 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f340d79c640 1 Processor -- start 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f340d79c640 1 -- start start 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f340d79c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3408102d30 0x7f34081a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f340d79c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34081036e0 0x7f34081a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f340d79c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081082a0 0x7f340819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f340d79c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3408112180 con 0x7f34081082a0 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f340d79c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3408112000 con 0x7f3408102d30 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f340d79c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3408112300 con 0x7f34081036e0 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f34077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081082a0 0x7f340819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f34077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081082a0 0x7f340819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50286/0 (socket says 172.21.15.1:50286) 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f34077fe640 1 -- 172.21.15.1:0/2601851621 learned_addr learned my addr 172.21.15.1:0/2601851621 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f3406ffd640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3408102d30 0x7f34081a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f33fffff640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34081036e0 0x7f34081a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f34077fe640 1 -- 172.21.15.1:0/2601851621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34081036e0 msgr2=0x7f34081a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f34077fe640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34081036e0 0x7f34081a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f34077fe640 1 -- 172.21.15.1:0/2601851621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3408102d30 msgr2=0x7f34081a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f34077fe640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3408102d30 0x7f34081a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f34077fe640 1 -- 172.21.15.1:0/2601851621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340819aee0 con 0x7f34081082a0 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.764+0000 7f3406ffd640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3408102d30 0x7f34081a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.765+0000 7f34077fe640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081082a0 0x7f340819a670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3400009fd0 tx=0x7f340000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:29.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.765+0000 7f3404ff9640 1 -- 172.21.15.1:0/2601851621 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400017070 con 0x7f34081082a0 2024-09-19T09:01:29.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.765+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340819b1d0 con 0x7f34081082a0 2024-09-19T09:01:29.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.765+0000 7f3404ff9640 1 -- 172.21.15.1:0/2601851621 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3400004020 con 0x7f34081082a0 2024-09-19T09:01:29.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.765+0000 7f3404ff9640 1 -- 172.21.15.1:0/2601851621 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000106c0 con 0x7f34081082a0 2024-09-19T09:01:29.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.765+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34081a7350 con 0x7f34081082a0 2024-09-19T09:01:29.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.766+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340806a850 con 0x7f34081082a0 2024-09-19T09:01:29.769 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:29 smithi001 ceph-mon[30939]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:29.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.768+0000 7f3404ff9640 1 -- 172.21.15.1:0/2601851621 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f34000041d0 con 0x7f34081082a0 2024-09-19T09:01:29.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.768+0000 7f3404ff9640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33f40a3240 0x7f33f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:29.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.768+0000 7f3404ff9640 1 -- 172.21.15.1:0/2601851621 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f34000cf570 con 0x7f34081082a0 2024-09-19T09:01:29.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.768+0000 7f3406ffd640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33f40a3240 0x7f33f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:29.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.769+0000 7f3406ffd640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33f40a3240 0x7f33f40a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33f800abe0 tx=0x7f33f800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:29.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:29.771+0000 7f3404ff9640 1 -- 172.21.15.1:0/2601851621 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f340009c730 con 0x7f34081082a0 2024-09-19T09:01:30.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.009+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f340810c2c0 con 0x7f34081082a0 2024-09-19T09:01:30.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.009+0000 7f3404ff9640 1 -- 172.21.15.1:0/2601851621 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3076 (secure 0 0 0) 0x7f340009c030 con 0x7f34081082a0 2024-09-19T09:01:30.011 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:30.011 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":4,"btime":"2024-09-19T09:01:28:429392+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:01:30.011 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 4 2024-09-19T09:01:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33f40a3240 msgr2=0x7f33f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33f40a3240 0x7f33f40a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33f800abe0 tx=0x7f33f800a5c0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081082a0 msgr2=0x7f340819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081082a0 0x7f340819a670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3400009fd0 tx=0x7f340000b260 comp rx=0 tx=0).stop 2024-09-19T09:01:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 shutdown_connections 2024-09-19T09:01:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34081082a0 0x7f340819a670 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33f40a3240 0x7f33f40a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34081036e0 0x7f34081a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 --2- 172.21.15.1:0/2601851621 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3408102d30 0x7f34081a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:30.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 >> 172.21.15.1:0/2601851621 conn(0x7f34080fc7d0 msgr2=0x7f3408101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:30.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 shutdown_connections 2024-09-19T09:01:30.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:30.012+0000 7f340d79c640 1 -- 172.21.15.1:0/2601851621 wait complete. 2024-09-19T09:01:30.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:29 smithi064 ceph-mon[35179]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:30.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:29 smithi022 ceph-mon[35107]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:30.792 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:30 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2601851621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:31.048 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:01:31 smithi001 systemd[1]: Started Ceph mds.d for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:31.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:30 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2601851621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:31.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:30 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2601851621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:31.744 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:31 smithi022 ceph-mon[35107]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:31.744 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:31.744 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:31.744 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:31.744 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:31.745 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:31.745 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:31 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:31 smithi001 ceph-mon[30939]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:32.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:32.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:31 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:31 smithi064 ceph-mon[35179]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:31 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:32.821 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:32.898 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:32 smithi022 ceph-mon[35107]: Deploying daemon mds.e on smithi022 2024-09-19T09:01:32.898 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:32 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.1:6836/2260283181,v1:172.21.15.1:6837/2260283181] up:boot 2024-09-19T09:01:32.898 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:32 smithi022 ceph-mon[35107]: fsmap 4 up:standby 2024-09-19T09:01:32.898 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:32 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:01:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:32 smithi001 ceph-mon[30939]: Deploying daemon mds.e on smithi022 2024-09-19T09:01:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:32 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.1:6836/2260283181,v1:172.21.15.1:6837/2260283181] up:boot 2024-09-19T09:01:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:32 smithi001 ceph-mon[30939]: fsmap 4 up:standby 2024-09-19T09:01:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:32 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:01:33.095 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:33.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:32 smithi064 ceph-mon[35179]: Deploying daemon mds.e on smithi022 2024-09-19T09:01:33.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:32 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.1:6836/2260283181,v1:172.21.15.1:6837/2260283181] up:boot 2024-09-19T09:01:33.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:32 smithi064 ceph-mon[35179]: fsmap 4 up:standby 2024-09-19T09:01:33.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:32 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:01:33.208 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 systemd[1]: Starting Ceph mds.e for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:33.542 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 podman[64824]: 2024-09-19 09:01:33.185468194 +0000 UTC m=+0.015954098 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:33.542 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 podman[64824]: 2024-09-19 09:01:33.295424525 +0000 UTC m=+0.125910428 container create e57a036e09acb3c5dd3a2db343ee2df3aacf4bf9edfa760106df7a6012d72193 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:01:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 -- 172.21.15.1:0/1719173477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb78103660 msgr2=0x7fdb7810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 --2- 172.21.15.1:0/1719173477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb78103660 0x7fdb7810bb50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009900 tx=0x7fdb6002a480 comp rx=0 tx=0).stop 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 -- 172.21.15.1:0/1719173477 shutdown_connections 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 --2- 172.21.15.1:0/1719173477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb7810c170 0x7fdb7810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 --2- 172.21.15.1:0/1719173477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb78103660 0x7fdb7810bb50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 --2- 172.21.15.1:0/1719173477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102d40 0x7fdb78103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 -- 172.21.15.1:0/1719173477 >> 172.21.15.1:0/1719173477 conn(0x7fdb780fc7a0 msgr2=0x7fdb780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 -- 172.21.15.1:0/1719173477 shutdown_connections 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.570+0000 7fdb7d272640 1 -- 172.21.15.1:0/1719173477 wait complete. 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb7d272640 1 Processor -- start 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb7d272640 1 -- start start 2024-09-19T09:01:33.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb7d272640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102d40 0x7fdb78198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb7d272640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb78103660 0x7fdb78198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb7d272640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb7810c170 0x7fdb7819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb7d272640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb78112090 con 0x7fdb7810c170 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb7d272640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdb78111f10 con 0x7fdb78103660 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb7d272640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb78112210 con 0x7fdb78102d40 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb777fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb7810c170 0x7fdb7819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb78103660 0x7fdb78198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb777fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb7810c170 0x7fdb7819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52864/0 (socket says 172.21.15.1:52864) 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.571+0000 7fdb777fe640 1 -- 172.21.15.1:0/3572684178 learned_addr learned my addr 172.21.15.1:0/3572684178 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb76ffd640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102d40 0x7fdb78198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:33.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb777fe640 1 -- 172.21.15.1:0/3572684178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102d40 msgr2=0x7fdb78198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb777fe640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102d40 0x7fdb78198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb777fe640 1 -- 172.21.15.1:0/3572684178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb78103660 msgr2=0x7fdb78198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb777fe640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb78103660 0x7fdb78198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb777fe640 1 -- 172.21.15.1:0/3572684178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7819d4d0 con 0x7fdb7810c170 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb76ffd640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102d40 0x7fdb78198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb6ffff640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb78103660 0x7fdb78198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb777fe640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb7810c170 0x7fdb7819cdf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000eb10 tx=0x7fdb7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb74ff9640 1 -- 172.21.15.1:0/3572684178 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70004b20 con 0x7fdb7810c170 2024-09-19T09:01:33.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7819d7c0 con 0x7fdb7810c170 2024-09-19T09:01:33.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb74ff9640 1 -- 172.21.15.1:0/3572684178 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb70004cc0 con 0x7fdb7810c170 2024-09-19T09:01:33.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb74ff9640 1 -- 172.21.15.1:0/3572684178 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb700107f0 con 0x7fdb7810c170 2024-09-19T09:01:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.572+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb781a50a0 con 0x7fdb7810c170 2024-09-19T09:01:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.573+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb78103120 con 0x7fdb7810c170 2024-09-19T09:01:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.574+0000 7fdb74ff9640 1 -- 172.21.15.1:0/3572684178 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fdb70010990 con 0x7fdb7810c170 2024-09-19T09:01:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.575+0000 7fdb74ff9640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb640a3240 0x7fdb640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.575+0000 7fdb76ffd640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb640a3240 0x7fdb640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.575+0000 7fdb74ff9640 1 -- 172.21.15.1:0/3572684178 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdb700cfcc0 con 0x7fdb7810c170 2024-09-19T09:01:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.576+0000 7fdb76ffd640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb640a3240 0x7fdb640a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdb68005d00 tx=0x7fdb68009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:33.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.578+0000 7fdb74ff9640 1 -- 172.21.15.1:0/3572684178 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb70054210 con 0x7fdb7810c170 2024-09-19T09:01:33.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.793+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb78199880 con 0x7fdb7810c170 2024-09-19T09:01:33.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.794+0000 7fdb74ff9640 1 -- 172.21.15.1:0/3572684178 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4720 (secure 0 0 0) 0x7fdb78199880 con 0x7fdb7810c170 2024-09-19T09:01:33.794 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:33.794 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-19T09:01:33:739318+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T09:01:33.794 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-19T09:01:33.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb640a3240 msgr2=0x7fdb640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb640a3240 0x7fdb640a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdb68005d00 tx=0x7fdb68009550 comp rx=0 tx=0).stop 2024-09-19T09:01:33.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb7810c170 msgr2=0x7fdb7819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:33.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb7810c170 0x7fdb7819cdf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000eb10 tx=0x7fdb7000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 shutdown_connections 2024-09-19T09:01:33.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb7810c170 0x7fdb7819cdf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb78103660 0x7fdb78198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb640a3240 0x7fdb640a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 --2- 172.21.15.1:0/3572684178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb78102d40 0x7fdb78198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:33.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 >> 172.21.15.1:0/3572684178 conn(0x7fdb780fc7a0 msgr2=0x7fdb780fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:33.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 shutdown_connections 2024-09-19T09:01:33.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:33.796+0000 7fdb7d272640 1 -- 172.21.15.1:0/3572684178 wait complete. 2024-09-19T09:01:33.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:33 smithi022 ceph-mon[35107]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:33.959 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 podman[64824]: 2024-09-19 09:01:33.664953637 +0000 UTC m=+0.495439546 container init e57a036e09acb3c5dd3a2db343ee2df3aacf4bf9edfa760106df7a6012d72193 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:01:33.959 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 podman[64824]: 2024-09-19 09:01:33.667842203 +0000 UTC m=+0.498328107 container start e57a036e09acb3c5dd3a2db343ee2df3aacf4bf9edfa760106df7a6012d72193 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T09:01:33.959 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 ceph-mds[64843]: -- 172.21.15.22:0/4248381106 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55566d795c20 con 0x55566d773000 2024-09-19T09:01:33.959 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e[64839]: starting mds.e at 2024-09-19T09:01:33.959 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 bash[64824]: e57a036e09acb3c5dd3a2db343ee2df3aacf4bf9edfa760106df7a6012d72193 2024-09-19T09:01:33.959 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:01:33 smithi022 systemd[1]: Started Ceph mds.e for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:33 smithi001 ceph-mon[30939]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:34.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:33 smithi064 ceph-mon[35179]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6834/728335709,v1:172.21.15.22:6835/728335709] up:boot 2024-09-19T09:01:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: fsmap 5 up:standby 2024-09-19T09:01:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:01:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3572684178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:34.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:34.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:34.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:34.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:34.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:34 smithi001 ceph-mon[30939]: Deploying daemon mds.f on smithi064 2024-09-19T09:01:34.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6834/728335709,v1:172.21.15.22:6835/728335709] up:boot 2024-09-19T09:01:34.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: fsmap 5 up:standby 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3572684178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:34 smithi064 ceph-mon[35179]: Deploying daemon mds.f on smithi064 2024-09-19T09:01:35.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6834/728335709,v1:172.21.15.22:6835/728335709] up:boot 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: fsmap 5 up:standby 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3572684178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:35.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:34 smithi022 ceph-mon[35107]: Deploying daemon mds.f on smithi064 2024-09-19T09:01:35.831 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:35 smithi064 systemd[1]: Starting Ceph mds.f for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:36.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:35 smithi064 ceph-mon[35179]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:36.106 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:35 smithi064 podman[65302]: 2024-09-19 09:01:35.938004241 +0000 UTC m=+0.111943545 container create b1c4be031aae36902077c5bece291294e40671690af81a75fb183d05f6844cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T09:01:36.106 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:35 smithi064 podman[65302]: 2024-09-19 09:01:35.842345619 +0000 UTC m=+0.016284894 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:36.192 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:35 smithi022 ceph-mon[35107]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:36.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:35 smithi001 ceph-mon[30939]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:36.555 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:36.606 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:36 smithi064 podman[65302]: 2024-09-19 09:01:36.157048068 +0000 UTC m=+0.330987329 container init b1c4be031aae36902077c5bece291294e40671690af81a75fb183d05f6844cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:01:36.606 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:36 smithi064 podman[65302]: 2024-09-19 09:01:36.159727935 +0000 UTC m=+0.333667197 container start b1c4be031aae36902077c5bece291294e40671690af81a75fb183d05f6844cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T09:01:36.606 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:36 smithi064 ceph-mds[65321]: -- 172.21.15.64:0/2720807936 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56540fbd5860 con 0x56540fbb3400 2024-09-19T09:01:36.606 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:36 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f[65317]: starting mds.f at 2024-09-19T09:01:36.606 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:36 smithi064 bash[65302]: b1c4be031aae36902077c5bece291294e40671690af81a75fb183d05f6844cd4 2024-09-19T09:01:36.606 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:01:36 smithi064 systemd[1]: Started Ceph mds.f for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:36.826 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.269+0000 7ff0835bf640 1 -- 172.21.15.1:0/4207402031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c104e80 msgr2=0x7ff07c105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.269+0000 7ff0835bf640 1 --2- 172.21.15.1:0/4207402031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c104e80 0x7ff07c105330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff074009ca0 tx=0x7ff07402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.269+0000 7ff0835bf640 1 -- 172.21.15.1:0/4207402031 shutdown_connections 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.269+0000 7ff0835bf640 1 --2- 172.21.15.1:0/4207402031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c104e80 0x7ff07c105330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.269+0000 7ff0835bf640 1 --2- 172.21.15.1:0/4207402031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff07c06a370 0x7ff07c1009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.269+0000 7ff0835bf640 1 --2- 172.21.15.1:0/4207402031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff07c069f00 0x7ff07c100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.269+0000 7ff0835bf640 1 -- 172.21.15.1:0/4207402031 >> 172.21.15.1:0/4207402031 conn(0x7ff07c077210 msgr2=0x7ff07c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.269+0000 7ff0835bf640 1 -- 172.21.15.1:0/4207402031 shutdown_connections 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.270+0000 7ff0835bf640 1 -- 172.21.15.1:0/4207402031 wait complete. 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.270+0000 7ff0835bf640 1 Processor -- start 2024-09-19T09:01:37.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.270+0000 7ff0835bf640 1 -- start start 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.270+0000 7ff0835bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c069f00 0x7ff07c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.270+0000 7ff0835bf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff07c06a370 0x7ff07c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0835bf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff07c104e80 0x7ff07c1a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0835bf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c110ff0 con 0x7ff07c069f00 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0835bf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c110e70 con 0x7ff07c06a370 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0835bf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c111170 con 0x7ff07c104e80 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c069f00 0x7ff07c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c069f00 0x7ff07c199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52888/0 (socket says 172.21.15.1:52888) 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 -- 172.21.15.1:0/318057416 learned_addr learned my addr 172.21.15.1:0/318057416 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff081b5c640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff07c104e80 0x7ff07c1a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff080b5a640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff07c06a370 0x7ff07c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 -- 172.21.15.1:0/318057416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff07c104e80 msgr2=0x7ff07c1a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff07c104e80 0x7ff07c1a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 -- 172.21.15.1:0/318057416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff07c06a370 msgr2=0x7ff07c1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff07c06a370 0x7ff07c1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 -- 172.21.15.1:0/318057416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07c1a4940 con 0x7ff07c069f00 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff080b5a640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff07c06a370 0x7ff07c1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff081b5c640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff07c104e80 0x7ff07c1a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff08135b640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c069f00 0x7ff07c199380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b4a0 tx=0x7ff07800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0727fc640 1 -- 172.21.15.1:0/318057416 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078014070 con 0x7ff07c069f00 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07c197170 con 0x7ff07c069f00 2024-09-19T09:01:37.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0727fc640 1 -- 172.21.15.1:0/318057416 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff078010b10 con 0x7ff07c069f00 2024-09-19T09:01:37.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07c197660 con 0x7ff07c069f00 2024-09-19T09:01:37.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.271+0000 7ff0727fc640 1 -- 172.21.15.1:0/318057416 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078017d60 con 0x7ff07c069f00 2024-09-19T09:01:37.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.272+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07c105330 con 0x7ff07c069f00 2024-09-19T09:01:37.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.274+0000 7ff0727fc640 1 -- 172.21.15.1:0/318057416 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff078017070 con 0x7ff07c069f00 2024-09-19T09:01:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.274+0000 7ff0727fc640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff0680a32c0 0x7ff0680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.274+0000 7ff080b5a640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff0680a32c0 0x7ff0680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.274+0000 7ff0727fc640 1 -- 172.21.15.1:0/318057416 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff0780cec50 con 0x7ff07c069f00 2024-09-19T09:01:37.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.275+0000 7ff080b5a640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff0680a32c0 0x7ff0680a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0058c0 tx=0x7ff06c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.278+0000 7ff0727fc640 1 -- 172.21.15.1:0/318057416 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff07809be10 con 0x7ff07c069f00 2024-09-19T09:01:37.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.489+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff07c1076f0 con 0x7ff07c069f00 2024-09-19T09:01:37.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.490+0000 7ff0727fc640 1 -- 172.21.15.1:0/318057416 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5545 (secure 0 0 0) 0x7ff07c1076f0 con 0x7ff07c069f00 2024-09-19T09:01:37.490 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:37.490 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"btime":"2024-09-19T09:01:36:831202+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T09:01:37.490 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff0680a32c0 msgr2=0x7ff0680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff0680a32c0 0x7ff0680a5780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0058c0 tx=0x7ff06c005850 comp rx=0 tx=0).stop 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c069f00 msgr2=0x7ff07c199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c069f00 0x7ff07c199380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b4a0 tx=0x7ff07800b960 comp rx=0 tx=0).stop 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 shutdown_connections 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff0680a32c0 0x7ff0680a5780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff07c104e80 0x7ff07c1a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff07c06a370 0x7ff07c1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 --2- 172.21.15.1:0/318057416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff07c069f00 0x7ff07c199380 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 >> 172.21.15.1:0/318057416 conn(0x7ff07c077210 msgr2=0x7ff07c102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 shutdown_connections 2024-09-19T09:01:37.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:37.492+0000 7ff0835bf640 1 -- 172.21.15.1:0/318057416 wait complete. 2024-09-19T09:01:37.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:37.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:37.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:37.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:37.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: Deploying daemon mds.c on smithi064 2024-09-19T09:01:37.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.64:6834/1194065600,v1:172.21.15.64:6835/1194065600] up:boot 2024-09-19T09:01:37.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: fsmap 6 up:standby 2024-09-19T09:01:37.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:37 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: Deploying daemon mds.c on smithi064 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.64:6834/1194065600,v1:172.21.15.64:6835/1194065600] up:boot 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: fsmap 6 up:standby 2024-09-19T09:01:37.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:37 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:01:37.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:37.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: Deploying daemon mds.c on smithi064 2024-09-19T09:01:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.64:6834/1194065600,v1:172.21.15.64:6835/1194065600] up:boot 2024-09-19T09:01:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: fsmap 6 up:standby 2024-09-19T09:01:37.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:37 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:01:38.294 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 systemd[1]: Starting Ceph mds.c for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:38.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:38 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/318057416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:38.567 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:38 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/318057416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:38.567 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 podman[65603]: 2024-09-19 09:01:38.199450289 +0000 UTC m=+0.015958017 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:38.567 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 podman[65603]: 2024-09-19 09:01:38.323752345 +0000 UTC m=+0.140260115 container create 740a25227230edab9d9287d1aa2a20e4673f664531986c73bc079b38b925749d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T09:01:38.567 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 podman[65603]: 2024-09-19 09:01:38.567770617 +0000 UTC m=+0.384278348 container init 740a25227230edab9d9287d1aa2a20e4673f664531986c73bc079b38b925749d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:01:38.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:38 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/318057416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:38.855 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 podman[65603]: 2024-09-19 09:01:38.570789015 +0000 UTC m=+0.387296744 container start 740a25227230edab9d9287d1aa2a20e4673f664531986c73bc079b38b925749d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:01:38.856 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 ceph-mds[65623]: -- 172.21.15.64:0/468634135 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561ff74bb860 con 0x561ff7498800 2024-09-19T09:01:38.856 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c[65619]: starting mds.c at 2024-09-19T09:01:38.856 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 bash[65603]: 740a25227230edab9d9287d1aa2a20e4673f664531986c73bc079b38b925749d 2024-09-19T09:01:38.856 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:01:38 smithi064 systemd[1]: Started Ceph mds.c for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: Deploying daemon mds.h on smithi022 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.64:6836/1600726820,v1:172.21.15.64:6837/1600726820] up:boot 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: fsmap 7 up:standby 2024-09-19T09:01:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:39 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:01:40.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:40.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:40.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:40.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:40.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:40.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:40.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:40.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: Deploying daemon mds.h on smithi022 2024-09-19T09:01:40.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.64:6836/1600726820,v1:172.21.15.64:6837/1600726820] up:boot 2024-09-19T09:01:40.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: fsmap 7 up:standby 2024-09-19T09:01:40.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:39 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: Deploying daemon mds.h on smithi022 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.64:6836/1600726820,v1:172.21.15.64:6837/1600726820] up:boot 2024-09-19T09:01:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: fsmap 7 up:standby 2024-09-19T09:01:40.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:39 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:01:40.213 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:40.483 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/1448003590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18106050 msgr2=0x7fdc1810dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/1448003590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18106050 0x7fdc1810dbd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009ca0 tx=0x7fdc1002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/1448003590 shutdown_connections 2024-09-19T09:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/1448003590 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18106050 0x7fdc1810dbd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/1448003590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc18101df0 0x7fdc18105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/1448003590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc18101440 0x7fdc18101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/1448003590 >> 172.21.15.1:0/1448003590 conn(0x7fdc18077210 msgr2=0x7fdc180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/1448003590 shutdown_connections 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/1448003590 wait complete. 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.884+0000 7fdc1d9f8640 1 Processor -- start 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc1d9f8640 1 -- start start 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc1d9f8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc18101440 0x7fdc181986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc1d9f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18101df0 0x7fdc18198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc1d9f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc18106050 0x7fdc1819cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc1d9f8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc181111d0 con 0x7fdc18101df0 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc1d9f8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdc18111050 con 0x7fdc18106050 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc1d9f8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdc18111350 con 0x7fdc18101440 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc167fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18101df0 0x7fdc18198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc167fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18101df0 0x7fdc18198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52898/0 (socket says 172.21.15.1:52898) 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc167fc640 1 -- 172.21.15.1:0/892697743 learned_addr learned my addr 172.21.15.1:0/892697743 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc177fe640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc18106050 0x7fdc1819cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.885+0000 7fdc16ffd640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc18101440 0x7fdc181986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc167fc640 1 -- 172.21.15.1:0/892697743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc18101440 msgr2=0x7fdc181986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc167fc640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc18101440 0x7fdc181986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc167fc640 1 -- 172.21.15.1:0/892697743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc18106050 msgr2=0x7fdc1819cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc167fc640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc18106050 0x7fdc1819cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc167fc640 1 -- 172.21.15.1:0/892697743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1819d690 con 0x7fdc18101df0 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc167fc640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18101df0 0x7fdc18198c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00e9f0 tx=0x7fdc0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc1c9f6640 1 -- 172.21.15.1:0/892697743 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c00cd80 con 0x7fdc18101df0 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc1c9f6640 1 -- 172.21.15.1:0/892697743 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc0c010930 con 0x7fdc18101df0 2024-09-19T09:01:40.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1819d980 con 0x7fdc18101df0 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc1c9f6640 1 -- 172.21.15.1:0/892697743 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c018b00 con 0x7fdc18101df0 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.886+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc181a5260 con 0x7fdc18101df0 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.887+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc18101820 con 0x7fdc18101df0 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.888+0000 7fdc1c9f6640 1 -- 172.21.15.1:0/892697743 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fdc0c018ca0 con 0x7fdc18101df0 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.889+0000 7fdc1c9f6640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdc000a3240 0x7fdc000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.889+0000 7fdc16ffd640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdc000a3240 0x7fdc000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.889+0000 7fdc1c9f6640 1 -- 172.21.15.1:0/892697743 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdc0c0cf840 con 0x7fdc18101df0 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.889+0000 7fdc16ffd640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdc000a3240 0x7fdc000a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc08005fd0 tx=0x7fdc0800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:40.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:40.894+0000 7fdc1c9f6640 1 -- 172.21.15.1:0/892697743 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc0c09c310 con 0x7fdc18101df0 2024-09-19T09:01:41.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.105+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc1810a240 con 0x7fdc18101df0 2024-09-19T09:01:41.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.105+0000 7fdc1c9f6640 1 -- 172.21.15.1:0/892697743 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6370 (secure 0 0 0) 0x7fdc0c0a0610 con 0x7fdc18101df0 2024-09-19T09:01:41.106 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:41.106 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-19T09:01:39:294726+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T09:01:41.106 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.107+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdc000a3240 msgr2=0x7fdc000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.107+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdc000a3240 0x7fdc000a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc08005fd0 tx=0x7fdc0800b390 comp rx=0 tx=0).stop 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.107+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18101df0 msgr2=0x7fdc18198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.107+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18101df0 0x7fdc18198c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00e9f0 tx=0x7fdc0c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.108+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 shutdown_connections 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.108+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc18106050 0x7fdc1819cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.108+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc18101df0 0x7fdc18198c20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.108+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdc000a3240 0x7fdc000a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.108+0000 7fdc1d9f8640 1 --2- 172.21.15.1:0/892697743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc18101440 0x7fdc181986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.108+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 >> 172.21.15.1:0/892697743 conn(0x7fdc18077210 msgr2=0x7fdc18100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:41.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.108+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 shutdown_connections 2024-09-19T09:01:41.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:41.108+0000 7fdc1d9f8640 1 -- 172.21.15.1:0/892697743 wait complete. 2024-09-19T09:01:41.195 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:40 smithi022 systemd[1]: Starting Ceph mds.h for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:41.459 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:41 smithi022 podman[65124]: 2024-09-19 09:01:41.098750267 +0000 UTC m=+0.016184603 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:41.459 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:41 smithi022 podman[65124]: 2024-09-19 09:01:41.199557255 +0000 UTC m=+0.116991617 container create 58faa7fcb97e92c79b14be2855c2096ca31f810acc93d0bd1d5a7b398f6a0c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T09:01:41.459 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:41 smithi022 podman[65124]: 2024-09-19 09:01:41.393528542 +0000 UTC m=+0.310962863 container init 58faa7fcb97e92c79b14be2855c2096ca31f810acc93d0bd1d5a7b398f6a0c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T09:01:41.459 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:41 smithi022 podman[65124]: 2024-09-19 09:01:41.396133848 +0000 UTC m=+0.313568179 container start 58faa7fcb97e92c79b14be2855c2096ca31f810acc93d0bd1d5a7b398f6a0c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:01:41.459 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mds[65143]: -- 172.21.15.22:0/1819986149 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559cd9323860 con 0x559cd9301400 2024-09-19T09:01:41.459 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h[65139]: starting mds.h at 2024-09-19T09:01:41.958 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:41 smithi022 bash[65124]: 58faa7fcb97e92c79b14be2855c2096ca31f810acc93d0bd1d5a7b398f6a0c8e 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:01:41 smithi022 systemd[1]: Started Ceph mds.h for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mon[35107]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/892697743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:41.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:41 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:41.993 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:41 smithi064 ceph-mon[35179]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:41.994 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:41 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/892697743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:41.994 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:41.994 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:41.994 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:41.994 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:41.994 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:41.994 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:41 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:41 smithi001 ceph-mon[30939]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:41 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/892697743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:41 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:42.991 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:42 smithi064 ceph-mon[35179]: Deploying daemon mds.i on smithi064 2024-09-19T09:01:42.991 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:42 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] up:boot 2024-09-19T09:01:42.991 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:42 smithi064 ceph-mon[35179]: fsmap 8 up:standby 2024-09-19T09:01:42.991 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:42 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:01:43.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:42 smithi001 ceph-mon[30939]: Deploying daemon mds.i on smithi064 2024-09-19T09:01:43.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:42 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] up:boot 2024-09-19T09:01:43.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:42 smithi001 ceph-mon[30939]: fsmap 8 up:standby 2024-09-19T09:01:43.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:42 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:01:43.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:42 smithi022 ceph-mon[35107]: Deploying daemon mds.i on smithi064 2024-09-19T09:01:43.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:42 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] up:boot 2024-09-19T09:01:43.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:42 smithi022 ceph-mon[35107]: fsmap 8 up:standby 2024-09-19T09:01:43.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:42 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:01:43.606 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:43 smithi064 systemd[1]: Starting Ceph mds.i for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:43.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:43.952 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:43.972 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:43 smithi064 ceph-mon[35179]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:43.972 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:43 smithi064 podman[65904]: 2024-09-19 09:01:43.603566215 +0000 UTC m=+0.015555389 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:43.972 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:43 smithi064 podman[65904]: 2024-09-19 09:01:43.710468119 +0000 UTC m=+0.122457270 container create a9713fa7becab5bff28f73af253b27bb95a3f323056e35340234891802e63e9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:01:43.972 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:43 smithi064 podman[65904]: 2024-09-19 09:01:43.946183152 +0000 UTC m=+0.358172309 container init a9713fa7becab5bff28f73af253b27bb95a3f323056e35340234891802e63e9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:01:43.972 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:43 smithi064 podman[65904]: 2024-09-19 09:01:43.948965338 +0000 UTC m=+0.360954492 container start a9713fa7becab5bff28f73af253b27bb95a3f323056e35340234891802e63e9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:01:44.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:43 smithi001 ceph-mon[30939]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:44.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:43 smithi022 ceph-mon[35107]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:44.355 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:43 smithi064 ceph-mds[65923]: -- 172.21.15.64:0/1811954514 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56390e477860 con 0x56390e454800 2024-09-19T09:01:44.355 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i[65919]: starting mds.i at 2024-09-19T09:01:44.356 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:44 smithi064 bash[65904]: a9713fa7becab5bff28f73af253b27bb95a3f323056e35340234891802e63e9d 2024-09-19T09:01:44.356 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:01:44 smithi064 systemd[1]: Started Ceph mds.i for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 -- 172.21.15.1:0/2723107003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 msgr2=0x7f026c100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 --2- 172.21.15.1:0/2723107003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 0x7f026c100d50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0254009930 tx=0x7f025402a420 comp rx=0 tx=0).stop 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 -- 172.21.15.1:0/2723107003 shutdown_connections 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 --2- 172.21.15.1:0/2723107003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c101290 0x7f026c10d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 --2- 172.21.15.1:0/2723107003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 0x7f026c100d50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 --2- 172.21.15.1:0/2723107003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f026c1068f0 0x7f026c106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 -- 172.21.15.1:0/2723107003 >> 172.21.15.1:0/2723107003 conn(0x7f026c0fc630 msgr2=0x7f026c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 -- 172.21.15.1:0/2723107003 shutdown_connections 2024-09-19T09:01:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.476+0000 7f0271804640 1 -- 172.21.15.1:0/2723107003 wait complete. 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f0271804640 1 Processor -- start 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f0271804640 1 -- start start 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f0271804640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 0x7f026c1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f0271804640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c101290 0x7f026c197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f0271804640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f026c1068f0 0x7f026c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f0271804640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f026c110e10 con 0x7f026c1008f0 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f0271804640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f026c110c90 con 0x7f026c101290 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f0271804640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f026c110f90 con 0x7f026c1068f0 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.477+0000 7f026affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 0x7f026c1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 0x7f026c1972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39286/0 (socket says 172.21.15.1:39286) 2024-09-19T09:01:44.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026affd640 1 -- 172.21.15.1:0/3950799506 learned_addr learned my addr 172.21.15.1:0/3950799506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026affd640 1 -- 172.21.15.1:0/3950799506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f026c1068f0 msgr2=0x7f026c19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026b7fe640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f026c1068f0 0x7f026c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f0263fff640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c101290 0x7f026c197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026affd640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f026c1068f0 0x7f026c19bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026affd640 1 -- 172.21.15.1:0/3950799506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c101290 msgr2=0x7f026c197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026affd640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c101290 0x7f026c197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026affd640 1 -- 172.21.15.1:0/3950799506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c19c280 con 0x7f026c1008f0 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f026affd640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 0x7f026c1972d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f025c00e9f0 tx=0x7f025c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f0270802640 1 -- 172.21.15.1:0/3950799506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c00cd80 con 0x7f026c1008f0 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f0270802640 1 -- 172.21.15.1:0/3950799506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f025c005520 con 0x7f026c1008f0 2024-09-19T09:01:44.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c19c570 con 0x7f026c1008f0 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f0270802640 1 -- 172.21.15.1:0/3950799506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c010690 con 0x7f026c1008f0 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.478+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c1a3e50 con 0x7f026c1008f0 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.479+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026c100d50 con 0x7f026c1008f0 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.480+0000 7f0270802640 1 -- 172.21.15.1:0/3950799506 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f025c0046c0 con 0x7f026c1008f0 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.481+0000 7f0270802640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f02580a3240 0x7f02580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.481+0000 7f0263fff640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f02580a3240 0x7f02580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.481+0000 7f0270802640 1 -- 172.21.15.1:0/3950799506 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f025c0cfba0 con 0x7f026c1008f0 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.482+0000 7f0263fff640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f02580a3240 0x7f02580a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0254006010 tx=0x7f0254000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.484+0000 7f0270802640 1 -- 172.21.15.1:0/3950799506 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f025c054210 con 0x7f026c1008f0 2024-09-19T09:01:44.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.727+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f026c108ee0 con 0x7f026c1008f0 2024-09-19T09:01:44.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.727+0000 7f0270802640 1 -- 172.21.15.1:0/3950799506 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7192 (secure 0 0 0) 0x7f025c09cd60 con 0x7f026c1008f0 2024-09-19T09:01:44.728 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:44.728 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":9,"btime":"2024-09-19T09:01:41:718981+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:01:44.728 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 9 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.729+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f02580a3240 msgr2=0x7f02580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.729+0000 7f0271804640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f02580a3240 0x7f02580a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0254006010 tx=0x7f0254000bc0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 msgr2=0x7f026c1972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 0x7f026c1972d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f025c00e9f0 tx=0x7f025c00edf0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 shutdown_connections 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f02580a3240 0x7f02580a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f026c1068f0 0x7f026c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f026c101290 0x7f026c197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 --2- 172.21.15.1:0/3950799506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f026c1008f0 0x7f026c1972d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 >> 172.21.15.1:0/3950799506 conn(0x7f026c0fc630 msgr2=0x7f026c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 shutdown_connections 2024-09-19T09:01:44.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:44.730+0000 7f0271804640 1 -- 172.21.15.1:0/3950799506 wait complete. 2024-09-19T09:01:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: Deploying daemon mds.g on smithi001 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3950799506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] up:boot 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: fsmap 9 up:standby 2024-09-19T09:01:45.357 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:45 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:01:45.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: Deploying daemon mds.g on smithi001 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3950799506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] up:boot 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: fsmap 9 up:standby 2024-09-19T09:01:45.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:45 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:01:45.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:45.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: Deploying daemon mds.g on smithi001 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3950799506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] up:boot 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: fsmap 9 up:standby 2024-09-19T09:01:45.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:45 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:01:46.947 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:46 smithi001 systemd[1]: Starting Ceph mds.g for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:47.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:47 smithi001 ceph-mon[30939]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:47.208 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:46 smithi001 podman[72228]: 2024-09-19 09:01:46.947835365 +0000 UTC m=+0.093342314 container create 3e67f9be480ec45af4df68133fd20c0a09241ea57196a0b511e8b637bc759bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:01:47.208 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:46 smithi001 podman[72228]: 2024-09-19 09:01:46.870580122 +0000 UTC m=+0.016087095 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:47.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:47 smithi064 ceph-mon[35179]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:47.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:47 smithi022 ceph-mon[35107]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:47.548 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:47 smithi001 podman[72228]: 2024-09-19 09:01:47.208959254 +0000 UTC m=+0.354466220 container init 3e67f9be480ec45af4df68133fd20c0a09241ea57196a0b511e8b637bc759bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:01:47.548 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:47 smithi001 podman[72228]: 2024-09-19 09:01:47.21215412 +0000 UTC m=+0.357661074 container start 3e67f9be480ec45af4df68133fd20c0a09241ea57196a0b511e8b637bc759bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:01:47.549 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:47 smithi001 ceph-mds[72248]: -- 172.21.15.1:0/1811852504 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a52b4d7860 con 0x55a52b4b5000 2024-09-19T09:01:47.549 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:47 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g[72244]: starting mds.g at 2024-09-19T09:01:47.549 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:47 smithi001 bash[72228]: 3e67f9be480ec45af4df68133fd20c0a09241ea57196a0b511e8b637bc759bc1 2024-09-19T09:01:47.549 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:01:47 smithi001 systemd[1]: Started Ceph mds.g for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:47.921 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:48.500 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.500 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.500 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.500 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:48.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:48.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:48.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: Deploying daemon mds.a on smithi001 2024-09-19T09:01:48.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.1:6838/1644028612,v1:172.21.15.1:6839/1644028612] up:boot 2024-09-19T09:01:48.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: fsmap 10 up:standby 2024-09-19T09:01:48.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:48 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:01:48.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:48.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:48.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:48.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: Deploying daemon mds.a on smithi001 2024-09-19T09:01:48.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.1:6838/1644028612,v1:172.21.15.1:6839/1644028612] up:boot 2024-09-19T09:01:48.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: fsmap 10 up:standby 2024-09-19T09:01:48.710 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:48 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:01:48.847 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: Deploying daemon mds.a on smithi001 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.1:6838/1644028612,v1:172.21.15.1:6839/1644028612] up:boot 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: fsmap 10 up:standby 2024-09-19T09:01:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:48 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:01:49.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 -- 172.21.15.1:0/4200077506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c102790 msgr2=0x7fe24c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 --2- 172.21.15.1:0/4200077506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c102790 0x7fe24c1067e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe240009900 tx=0x7fe24002a410 comp rx=0 tx=0).stop 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 -- 172.21.15.1:0/4200077506 shutdown_connections 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 --2- 172.21.15.1:0/4200077506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24c106f10 0x7fe24c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 --2- 172.21.15.1:0/4200077506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c102790 0x7fe24c1067e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 --2- 172.21.15.1:0/4200077506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe24c101de0 0x7fe24c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 -- 172.21.15.1:0/4200077506 >> 172.21.15.1:0/4200077506 conn(0x7fe24c0fd880 msgr2=0x7fe24c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 -- 172.21.15.1:0/4200077506 shutdown_connections 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.289+0000 7fe251a5c640 1 -- 172.21.15.1:0/4200077506 wait complete. 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe251a5c640 1 Processor -- start 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe251a5c640 1 -- start start 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe251a5c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c101de0 0x7fe24c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe251a5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe24c102790 0x7fe24c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe251a5c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24c106f10 0x7fe24c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe251a5c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c112090 con 0x7fe24c101de0 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe251a5c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c111f10 con 0x7fe24c102790 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe251a5c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c112210 con 0x7fe24c106f10 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe24affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c101de0 0x7fe24c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe24affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c101de0 0x7fe24c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39322/0 (socket says 172.21.15.1:39322) 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.290+0000 7fe24affd640 1 -- 172.21.15.1:0/2576405289 learned_addr learned my addr 172.21.15.1:0/2576405289 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24a7fc640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe24c102790 0x7fe24c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24b7fe640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24c106f10 0x7fe24c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24affd640 1 -- 172.21.15.1:0/2576405289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24c106f10 msgr2=0x7fe24c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24affd640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24c106f10 0x7fe24c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24affd640 1 -- 172.21.15.1:0/2576405289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe24c102790 msgr2=0x7fe24c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24affd640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe24c102790 0x7fe24c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24affd640 1 -- 172.21.15.1:0/2576405289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c19d4c0 con 0x7fe24c101de0 2024-09-19T09:01:49.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24a7fc640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe24c102790 0x7fe24c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:49.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24b7fe640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24c106f10 0x7fe24c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:49.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe24affd640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c101de0 0x7fe24c198510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00ebc0 tx=0x7fe23c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:49.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe250a5a640 1 -- 172.21.15.1:0/2576405289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c010630 con 0x7fe24c101de0 2024-09-19T09:01:49.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24c19d7b0 con 0x7fe24c101de0 2024-09-19T09:01:49.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe250a5a640 1 -- 172.21.15.1:0/2576405289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe23c010cd0 con 0x7fe24c101de0 2024-09-19T09:01:49.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe250a5a640 1 -- 172.21.15.1:0/2576405289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c018cf0 con 0x7fe24c101de0 2024-09-19T09:01:49.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.291+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24c1a5090 con 0x7fe24c101de0 2024-09-19T09:01:49.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.292+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24c1021c0 con 0x7fe24c101de0 2024-09-19T09:01:49.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.294+0000 7fe250a5a640 1 -- 172.21.15.1:0/2576405289 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe23c0107d0 con 0x7fe24c101de0 2024-09-19T09:01:49.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.294+0000 7fe250a5a640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2340a3240 0x7fe2340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.295+0000 7fe24a7fc640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2340a3240 0x7fe2340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.295+0000 7fe250a5a640 1 -- 172.21.15.1:0/2576405289 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe23c0d00f0 con 0x7fe24c101de0 2024-09-19T09:01:49.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.295+0000 7fe24a7fc640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2340a3240 0x7fe2340a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0fdca0 tx=0x7fe240005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:49.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.298+0000 7fe250a5a640 1 -- 172.21.15.1:0/2576405289 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe23c09d2b0 con 0x7fe24c101de0 2024-09-19T09:01:49.378 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:49 smithi001 systemd[1]: Starting Ceph mds.a for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:49.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.525+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe24c199870 con 0x7fe24c101de0 2024-09-19T09:01:49.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.526+0000 7fe250a5a640 1 -- 172.21.15.1:0/2576405289 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8842 (secure 0 0 0) 0x7fe23c09cbb0 con 0x7fe24c101de0 2024-09-19T09:01:49.527 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:49.527 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":11,"btime":"2024-09-19T09:01:48:103580+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:01:49.527 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 11 2024-09-19T09:01:49.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2340a3240 msgr2=0x7fe2340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2340a3240 0x7fe2340a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0fdca0 tx=0x7fe240005a20 comp rx=0 tx=0).stop 2024-09-19T09:01:49.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c101de0 msgr2=0x7fe24c198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c101de0 0x7fe24c198510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00ebc0 tx=0x7fe23c00c6a0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 shutdown_connections 2024-09-19T09:01:49.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2340a3240 0x7fe2340a5700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe24c106f10 0x7fe24c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe24c102790 0x7fe24c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 --2- 172.21.15.1:0/2576405289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe24c101de0 0x7fe24c198510 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 >> 172.21.15.1:0/2576405289 conn(0x7fe24c0fd880 msgr2=0x7fe24c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:49.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 shutdown_connections 2024-09-19T09:01:49.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:49.528+0000 7fe251a5c640 1 -- 172.21.15.1:0/2576405289 wait complete. 2024-09-19T09:01:49.668 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:49 smithi001 ceph-mon[30939]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:49.668 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:49 smithi001 podman[72629]: 2024-09-19 09:01:49.442112027 +0000 UTC m=+0.017402603 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:49.668 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:49 smithi001 podman[72629]: 2024-09-19 09:01:49.565027164 +0000 UTC m=+0.140317731 container create a08cf576aab4baafa882319dc2391d44237c09a9820e293fd4ef6056a203ea6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:01:49.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:49 smithi022 ceph-mon[35107]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:49.757 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:49 smithi064 ceph-mon[35179]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:50.298 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:49 smithi001 podman[72629]: 2024-09-19 09:01:49.960535812 +0000 UTC m=+0.535826380 container init a08cf576aab4baafa882319dc2391d44237c09a9820e293fd4ef6056a203ea6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T09:01:50.299 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:49 smithi001 podman[72629]: 2024-09-19 09:01:49.963646192 +0000 UTC m=+0.538936759 container start a08cf576aab4baafa882319dc2391d44237c09a9820e293fd4ef6056a203ea6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T09:01:50.299 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:49 smithi001 ceph-mds[72661]: -- 172.21.15.1:0/1151428373 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562af401d860 con 0x562af3ffa800 2024-09-19T09:01:50.299 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:49 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a[72657]: starting mds.a at 2024-09-19T09:01:50.299 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:50 smithi001 bash[72629]: a08cf576aab4baafa882319dc2391d44237c09a9820e293fd4ef6056a203ea6e 2024-09-19T09:01:50.299 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:01:50 smithi001 systemd[1]: Started Ceph mds.a for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:50.668 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:50 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2576405289' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:50.668 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:50 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.668 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:50 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.668 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:50 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.669 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:50 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:50.669 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:50 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:50.669 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:50 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:50.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:50 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2576405289' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:50.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:50 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:50 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:50 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:50 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:50.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:50 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:50.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:50 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:50.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:50 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2576405289' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:50.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:50 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:50 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:50 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:50.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:50 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:01:50.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:50 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:01:50.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:50 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:51.641 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:51 smithi022 ceph-mon[35107]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:51.641 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:51 smithi022 ceph-mon[35107]: Deploying daemon mds.b on smithi022 2024-09-19T09:01:51.642 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:51 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.1:6840/2023571074,v1:172.21.15.1:6841/2023571074] up:boot 2024-09-19T09:01:51.642 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:51 smithi022 ceph-mon[35107]: fsmap 11 up:standby 2024-09-19T09:01:51.642 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:51 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:01:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:51 smithi001 ceph-mon[30939]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:51 smithi001 ceph-mon[30939]: Deploying daemon mds.b on smithi022 2024-09-19T09:01:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:51 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.1:6840/2023571074,v1:172.21.15.1:6841/2023571074] up:boot 2024-09-19T09:01:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:51 smithi001 ceph-mon[30939]: fsmap 11 up:standby 2024-09-19T09:01:51.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:51 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:01:51.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:51 smithi064 ceph-mon[35179]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:51.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:51 smithi064 ceph-mon[35179]: Deploying daemon mds.b on smithi022 2024-09-19T09:01:51.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:51 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.1:6840/2023571074,v1:172.21.15.1:6841/2023571074] up:boot 2024-09-19T09:01:51.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:51 smithi064 ceph-mon[35179]: fsmap 11 up:standby 2024-09-19T09:01:51.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:51 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:01:52.209 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 systemd[1]: Starting Ceph mds.b for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:01:52.508 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:52.552 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 podman[65426]: 2024-09-19 09:01:52.200625092 +0000 UTC m=+0.016626655 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:52.552 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 podman[65426]: 2024-09-19 09:01:52.320155933 +0000 UTC m=+0.136157495 container create 55ef0bebea888133b7ae444e1f4bae15b32cec62ddc59af57b6f5a06bba7344a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:01:52.788 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:52.961 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 podman[65426]: 2024-09-19 09:01:52.556118047 +0000 UTC m=+0.372119610 container init 55ef0bebea888133b7ae444e1f4bae15b32cec62ddc59af57b6f5a06bba7344a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T09:01:52.961 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 podman[65426]: 2024-09-19 09:01:52.559208451 +0000 UTC m=+0.375210014 container start 55ef0bebea888133b7ae444e1f4bae15b32cec62ddc59af57b6f5a06bba7344a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:01:52.961 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 ceph-mds[65453]: -- 172.21.15.22:0/1480585334 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557370af7860 con 0x557370ad4800 2024-09-19T09:01:52.962 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: starting mds.b at 2024-09-19T09:01:52.962 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 bash[65426]: 55ef0bebea888133b7ae444e1f4bae15b32cec62ddc59af57b6f5a06bba7344a 2024-09-19T09:01:52.962 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:01:52 smithi022 systemd[1]: Started Ceph mds.b for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:01:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.266+0000 7f1dac7e9640 1 -- 172.21.15.1:0/380614083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 msgr2=0x7f1da410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.266+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/380614083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 0x7f1da410e600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009ca0 tx=0x7f1d9c02a950 comp rx=0 tx=0).stop 2024-09-19T09:01:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.266+0000 7f1dac7e9640 1 -- 172.21.15.1:0/380614083 shutdown_connections 2024-09-19T09:01:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.266+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/380614083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 0x7f1da410e600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.266+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/380614083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da41036c0 0x7f1da410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.266+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/380614083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da4102da0 0x7f1da4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.266+0000 7f1dac7e9640 1 -- 172.21.15.1:0/380614083 >> 172.21.15.1:0/380614083 conn(0x7f1da40fc7a0 msgr2=0x7f1da40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.266+0000 7f1dac7e9640 1 -- 172.21.15.1:0/380614083 shutdown_connections 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 -- 172.21.15.1:0/380614083 wait complete. 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 Processor -- start 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 -- start start 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4102da0 0x7f1da4100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da41036c0 0x7f1da4100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 0x7f1da4101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41120e0 con 0x7f1da410c180 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4111f60 con 0x7f1da41036c0 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.267+0000 7f1dac7e9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1da4112260 con 0x7f1da4102da0 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 0x7f1da4101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 0x7f1da4101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38532/0 (socket says 172.21.15.1:38532) 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 -- 172.21.15.1:0/657068752 learned_addr learned my addr 172.21.15.1:0/657068752 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1da9d84640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da41036c0 0x7f1da4100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daa585640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4102da0 0x7f1da4100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 -- 172.21.15.1:0/657068752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4102da0 msgr2=0x7f1da4100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4102da0 0x7f1da4100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 -- 172.21.15.1:0/657068752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da41036c0 msgr2=0x7f1da4100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da41036c0 0x7f1da4100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 -- 172.21.15.1:0/657068752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da41a69a0 con 0x7f1da410c180 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1daad86640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 0x7f1da4101480 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c005cc0 tx=0x7f1d9c02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1d9b7fe640 1 -- 172.21.15.1:0/657068752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c034040 con 0x7f1da410c180 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1d9b7fe640 1 -- 172.21.15.1:0/657068752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d9c030940 con 0x7f1da410c180 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da41a6c30 con 0x7f1da410c180 2024-09-19T09:01:53.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1d9b7fe640 1 -- 172.21.15.1:0/657068752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c045480 con 0x7f1da410c180 2024-09-19T09:01:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.268+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da41a7110 con 0x7f1da410c180 2024-09-19T09:01:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.269+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da4103180 con 0x7f1da410c180 2024-09-19T09:01:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.270+0000 7f1d9b7fe640 1 -- 172.21.15.1:0/657068752 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1d9c037020 con 0x7f1da410c180 2024-09-19T09:01:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.271+0000 7f1d9b7fe640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1d900a3240 0x7f1d900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.271+0000 7f1daa585640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1d900a3240 0x7f1d900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.271+0000 7f1d9b7fe640 1 -- 172.21.15.1:0/657068752 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f1d9c0f06f0 con 0x7f1da410c180 2024-09-19T09:01:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.272+0000 7f1daa585640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1d900a3240 0x7f1d900a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009b60 tx=0x7f1da0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.275+0000 7f1d9b7fe640 1 -- 172.21.15.1:0/657068752 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d9c081210 con 0x7f1da410c180 2024-09-19T09:01:53.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.499+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1da41a7340 con 0x7f1da410c180 2024-09-19T09:01:53.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.500+0000 7f1d9b7fe640 1 -- 172.21.15.1:0/657068752 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10491 (secure 0 0 0) 0x7f1d9c0383b0 con 0x7f1da410c180 2024-09-19T09:01:53.500 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:53.500 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"btime":"2024-09-19T09:01:53:385328+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T09:01:53.501 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1d900a3240 msgr2=0x7f1d900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1d900a3240 0x7f1d900a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009b60 tx=0x7f1da0005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 msgr2=0x7f1da4101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 0x7f1da4101480 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c005cc0 tx=0x7f1d9c02f790 comp rx=0 tx=0).stop 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 shutdown_connections 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da410c180 0x7f1da4101480 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da41036c0 0x7f1da4100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1d900a3240 0x7f1d900a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 --2- 172.21.15.1:0/657068752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4102da0 0x7f1da4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 >> 172.21.15.1:0/657068752 conn(0x7f1da40fc7a0 msgr2=0x7f1da40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:53.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 shutdown_connections 2024-09-19T09:01:53.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:53.502+0000 7f1dac7e9640 1 -- 172.21.15.1:0/657068752 wait complete. 2024-09-19T09:01:53.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:53.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:53.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] up:boot 2024-09-19T09:01:53.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: fsmap 12 up:standby 2024-09-19T09:01:53.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:01:53.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:53 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/657068752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] up:boot 2024-09-19T09:01:53.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: fsmap 12 up:standby 2024-09-19T09:01:53.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:01:53.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:53 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/657068752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:53.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] up:boot 2024-09-19T09:01:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: fsmap 12 up:standby 2024-09-19T09:01:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:01:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:53 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/657068752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:54.871 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T09:01:55.161 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:55.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:55 smithi001 ceph-mon[30939]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:55.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:55 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:55 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:55 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:55 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.537 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:55 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:55 smithi064 ceph-mon[35179]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:55.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:55 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:55 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:55 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:55 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:55 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.620+0000 7f8749c5e640 1 -- 172.21.15.1:0/3054414410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744101de0 msgr2=0x7f87441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.620+0000 7f8749c5e640 1 --2- 172.21.15.1:0/3054414410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744101de0 0x7f87441021c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8734009900 tx=0x7f873402a410 comp rx=0 tx=0).stop 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.620+0000 7f8749c5e640 1 -- 172.21.15.1:0/3054414410 shutdown_connections 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.620+0000 7f8749c5e640 1 --2- 172.21.15.1:0/3054414410 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8744106f10 0x7f874410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.620+0000 7f8749c5e640 1 --2- 172.21.15.1:0/3054414410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8744102790 0x7f87441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.620+0000 7f8749c5e640 1 --2- 172.21.15.1:0/3054414410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744101de0 0x7f87441021c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.620+0000 7f8749c5e640 1 -- 172.21.15.1:0/3054414410 >> 172.21.15.1:0/3054414410 conn(0x7f87440fd880 msgr2=0x7f87440ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.620+0000 7f8749c5e640 1 -- 172.21.15.1:0/3054414410 shutdown_connections 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.621+0000 7f8749c5e640 1 -- 172.21.15.1:0/3054414410 wait complete. 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.621+0000 7f8749c5e640 1 Processor -- start 2024-09-19T09:01:55.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.621+0000 7f8749c5e640 1 -- start start 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8749c5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8744101de0 0x7f87441984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8749c5e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8744102790 0x7f8744198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8749c5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744106f10 0x7f874419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8749c5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8744112090 con 0x7f8744106f10 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8749c5e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8744111f10 con 0x7f8744101de0 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8749c5e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8744112210 con 0x7f8744102790 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744106f10 0x7f874419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744106f10 0x7f874419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38554/0 (socket says 172.21.15.1:38554) 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f87437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8744101de0 0x7f87441984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 -- 172.21.15.1:0/730916995 learned_addr learned my addr 172.21.15.1:0/730916995 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:55.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8742ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8744102790 0x7f8744198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 -- 172.21.15.1:0/730916995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8744102790 msgr2=0x7f8744198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8744102790 0x7f8744198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 -- 172.21.15.1:0/730916995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8744101de0 msgr2=0x7f87441984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8744101de0 0x7f87441984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 -- 172.21.15.1:0/730916995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874419d490 con 0x7f8744106f10 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8743fff640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744106f10 0x7f874419cdb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f873c00eb10 tx=0x7f873c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.622+0000 7f8740ff9640 1 -- 172.21.15.1:0/730916995 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c004b20 con 0x7f8744106f10 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.623+0000 7f8740ff9640 1 -- 172.21.15.1:0/730916995 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f873c004cc0 con 0x7f8744106f10 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.623+0000 7f8740ff9640 1 -- 172.21.15.1:0/730916995 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c0107f0 con 0x7f8744106f10 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.623+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874419d780 con 0x7f8744106f10 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.623+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441a5060 con 0x7f8744106f10 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.624+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87441021c0 con 0x7f8744106f10 2024-09-19T09:01:55.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.626+0000 7f8740ff9640 1 -- 172.21.15.1:0/730916995 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f873c005000 con 0x7f8744106f10 2024-09-19T09:01:55.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.626+0000 7f8740ff9640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f872c0a3240 0x7f872c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:55.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.627+0000 7f8740ff9640 1 -- 172.21.15.1:0/730916995 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f873c0cfb30 con 0x7f8744106f10 2024-09-19T09:01:55.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.627+0000 7f87437fe640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f872c0a3240 0x7f872c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:55.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.627+0000 7f87437fe640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f872c0a3240 0x7f872c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8734009230 tx=0x7f87340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:55.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.630+0000 7f8740ff9640 1 -- 172.21.15.1:0/730916995 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f873c054210 con 0x7f8744106f10 2024-09-19T09:01:55.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:55 smithi022 ceph-mon[35107]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:55.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:55 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:55 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:55 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:55 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:55 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:55.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.811+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8744199840 con 0x7f8744106f10 2024-09-19T09:01:55.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.812+0000 7f8740ff9640 1 -- 172.21.15.1:0/730916995 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f8744199840 con 0x7f8744106f10 2024-09-19T09:01:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:01:55.812 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-19T09:01:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:01:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-19T09:01:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-19T09:01:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:01:55.813 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f872c0a3240 msgr2=0x7f872c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f872c0a3240 0x7f872c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8734009230 tx=0x7f87340058d0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744106f10 msgr2=0x7f874419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:55.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744106f10 0x7f874419cdb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f873c00eb10 tx=0x7f873c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 shutdown_connections 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8744106f10 0x7f874419cdb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f872c0a3240 0x7f872c0a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8744102790 0x7f8744198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 --2- 172.21.15.1:0/730916995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8744101de0 0x7f87441984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:55.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 >> 172.21.15.1:0/730916995 conn(0x7f87440fd880 msgr2=0x7f87440feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:55.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 shutdown_connections 2024-09-19T09:01:55.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:55.814+0000 7f8749c5e640 1 -- 172.21.15.1:0/730916995 wait complete. 2024-09-19T09:01:56.410 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:01:56.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:01:56.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:56.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:56.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:56 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:56.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:56 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/730916995' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:01:56.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:56.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:56.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:56 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:56.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:56 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/730916995' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:01:56.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:56.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:56.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:56.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:56 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:56.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:56 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/730916995' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:01:57.417 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:57.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:57 smithi022 ceph-mon[35107]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:57.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:57 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:57 smithi001 ceph-mon[30939]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:57.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:57 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:57 smithi064 ceph-mon[35179]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:57 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:57.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.867+0000 7fee48442640 1 -- 172.21.15.1:0/620082264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40103660 msgr2=0x7fee4010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.867+0000 7fee48442640 1 --2- 172.21.15.1:0/620082264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40103660 0x7fee4010bb50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fee30009900 tx=0x7fee3002a480 comp rx=0 tx=0).stop 2024-09-19T09:01:57.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 -- 172.21.15.1:0/620082264 shutdown_connections 2024-09-19T09:01:57.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 --2- 172.21.15.1:0/620082264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee4010c170 0x7fee4010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 --2- 172.21.15.1:0/620082264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40103660 0x7fee4010bb50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 --2- 172.21.15.1:0/620082264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee40102d40 0x7fee40103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 -- 172.21.15.1:0/620082264 >> 172.21.15.1:0/620082264 conn(0x7fee400fc7a0 msgr2=0x7fee400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 -- 172.21.15.1:0/620082264 shutdown_connections 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 -- 172.21.15.1:0/620082264 wait complete. 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 Processor -- start 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 -- start start 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40102d40 0x7fee40198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee40103660 0x7fee40198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee4010c170 0x7fee4019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fee40112090 con 0x7fee40102d40 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee40111f10 con 0x7fee4010c170 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.868+0000 7fee48442640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fee40112210 con 0x7fee40103660 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40102d40 0x7fee40198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40102d40 0x7fee40198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38568/0 (socket says 172.21.15.1:38568) 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 -- 172.21.15.1:0/641391407 learned_addr learned my addr 172.21.15.1:0/641391407 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee459dd640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee40103660 0x7fee40198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee469df640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee4010c170 0x7fee4019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 -- 172.21.15.1:0/641391407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee40103660 msgr2=0x7fee40198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee40103660 0x7fee40198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 -- 172.21.15.1:0/641391407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee4010c170 msgr2=0x7fee4019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee4010c170 0x7fee4019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:57.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 -- 172.21.15.1:0/641391407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4019d4e0 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee461de640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40102d40 0x7fee40198530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00d950 tx=0x7fee3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee377fe640 1 -- 172.21.15.1:0/641391407 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c017070 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee377fe640 1 -- 172.21.15.1:0/641391407 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee3c009c30 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4019d7d0 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee377fe640 1 -- 172.21.15.1:0/641391407 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c00f740 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.869+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee401a50b0 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.870+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee40103120 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.871+0000 7fee377fe640 1 -- 172.21.15.1:0/641391407 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fee3c010a80 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.872+0000 7fee377fe640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fee2c0a3240 0x7fee2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.872+0000 7fee459dd640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fee2c0a3240 0x7fee2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.872+0000 7fee377fe640 1 -- 172.21.15.1:0/641391407 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fee3c0cf0c0 con 0x7fee40102d40 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.872+0000 7fee459dd640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fee2c0a3240 0x7fee2c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee30009230 tx=0x7fee300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:57.876+0000 7fee377fe640 1 -- 172.21.15.1:0/641391407 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee3c009de0 con 0x7fee40102d40 2024-09-19T09:01:58.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.070+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fee401071e0 con 0x7fee40102d40 2024-09-19T09:01:58.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.557+0000 7fee377fe640 1 -- 172.21.15.1:0/641391407 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fee3c09c280 con 0x7fee40102d40 2024-09-19T09:01:58.557 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-19T09:01:58.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fee2c0a3240 msgr2=0x7fee2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fee2c0a3240 0x7fee2c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee30009230 tx=0x7fee300058d0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40102d40 msgr2=0x7fee40198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:58.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40102d40 0x7fee40198530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee3c00d950 tx=0x7fee3c00de10 comp rx=0 tx=0).stop 2024-09-19T09:01:58.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 shutdown_connections 2024-09-19T09:01:58.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee4010c170 0x7fee4019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fee2c0a3240 0x7fee2c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fee40103660 0x7fee40198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 --2- 172.21.15.1:0/641391407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee40102d40 0x7fee40198530 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:58.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 >> 172.21.15.1:0/641391407 conn(0x7fee400fc7a0 msgr2=0x7fee400fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:58.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 shutdown_connections 2024-09-19T09:01:58.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:58.559+0000 7fee48442640 1 -- 172.21.15.1:0/641391407 wait complete. 2024-09-19T09:01:58.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:58 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/641391407' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:01:58.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:58.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:58.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:58.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:58.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:58.916 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:58 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/641391407' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:01:58.917 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:58.917 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:58.917 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:58.917 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:58.917 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:58.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:58 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/641391407' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:01:58.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:58.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:58.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:58.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:58.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:01:59.223 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:01:59.483 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:59.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:59 smithi064 ceph-mon[35179]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:59.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:59 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/641391407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:01:59.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:59 smithi064 ceph-mon[35179]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:01:59.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:01:59 smithi064 ceph-mon[35179]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:01:59.880 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:59 smithi001 ceph-mon[30939]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:59.880 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:59 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/641391407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:01:59.880 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:59 smithi001 ceph-mon[30939]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:01:59.880 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:01:59 smithi001 ceph-mon[30939]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:01:59.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:59 smithi022 ceph-mon[35107]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:01:59.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:59 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/641391407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:01:59.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:59 smithi022 ceph-mon[35107]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:01:59.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:01:59 smithi022 ceph-mon[35107]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:01:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 -- 172.21.15.1:0/3520769703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 msgr2=0x7fc384107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 --2- 172.21.15.1:0/3520769703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 0x7fc384107b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc378009930 tx=0x7fc37802a420 comp rx=0 tx=0).stop 2024-09-19T09:01:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 -- 172.21.15.1:0/3520769703 shutdown_connections 2024-09-19T09:01:59.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 --2- 172.21.15.1:0/3520769703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3841082a0 0x7fc38410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 --2- 172.21.15.1:0/3520769703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 0x7fc384107b90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 --2- 172.21.15.1:0/3520769703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc384102d30 0x7fc384103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 -- 172.21.15.1:0/3520769703 >> 172.21.15.1:0/3520769703 conn(0x7fc3840fc7d0 msgr2=0x7fc3840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:59.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 -- 172.21.15.1:0/3520769703 shutdown_connections 2024-09-19T09:01:59.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 -- 172.21.15.1:0/3520769703 wait complete. 2024-09-19T09:01:59.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 Processor -- start 2024-09-19T09:01:59.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.968+0000 7fc38bc38640 1 -- start start 2024-09-19T09:01:59.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc38bc38640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc384102d30 0x7fc3841986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:59.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc38bc38640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 0x7fc384198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc38bc38640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3841082a0 0x7fc38419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc38bc38640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3841121c0 con 0x7fc3841036e0 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc38bc38640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc384112040 con 0x7fc3841082a0 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc38bc38640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc384112340 con 0x7fc384102d30 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 0x7fc384198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 0x7fc384198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38588/0 (socket says 172.21.15.1:38588) 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 -- 172.21.15.1:0/593123204 learned_addr learned my addr 172.21.15.1:0/593123204 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3899d4640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc384102d30 0x7fc3841986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc38a1d5640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3841082a0 0x7fc38419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 -- 172.21.15.1:0/593123204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc384102d30 msgr2=0x7fc3841986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc384102d30 0x7fc3841986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 -- 172.21.15.1:0/593123204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3841082a0 msgr2=0x7fc38419cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:59.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3841082a0 0x7fc38419cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 -- 172.21.15.1:0/593123204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38419d670 con 0x7fc3841036e0 2024-09-19T09:01:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.969+0000 7fc3891d3640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 0x7fc384198c00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc378005940 tx=0x7fc378004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.970+0000 7fc382ffd640 1 -- 172.21.15.1:0/593123204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37803f030 con 0x7fc3841036e0 2024-09-19T09:01:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.970+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38419d900 con 0x7fc3841036e0 2024-09-19T09:01:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.970+0000 7fc382ffd640 1 -- 172.21.15.1:0/593123204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc378004440 con 0x7fc3841036e0 2024-09-19T09:01:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.970+0000 7fc382ffd640 1 -- 172.21.15.1:0/593123204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378035070 con 0x7fc3841036e0 2024-09-19T09:01:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.970+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3841a5240 con 0x7fc3841036e0 2024-09-19T09:01:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.971+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38406a850 con 0x7fc3841036e0 2024-09-19T09:01:59.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.972+0000 7fc382ffd640 1 -- 172.21.15.1:0/593123204 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc378042030 con 0x7fc3841036e0 2024-09-19T09:01:59.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.973+0000 7fc382ffd640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc36c0a3240 0x7fc36c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:59.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.973+0000 7fc3899d4640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc36c0a3240 0x7fc36c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:59.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.973+0000 7fc382ffd640 1 -- 172.21.15.1:0/593123204 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7fc3780f0170 con 0x7fc3841036e0 2024-09-19T09:01:59.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.973+0000 7fc3899d4640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc36c0a3240 0x7fc36c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc374005fd0 tx=0x7fc374009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:59.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:01:59.976+0000 7fc382ffd640 1 -- 172.21.15.1:0/593123204 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3780bd1c0 con 0x7fc3841036e0 2024-09-19T09:02:00.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.157+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc38410a2b0 con 0x7fc3841036e0 2024-09-19T09:02:00.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.590+0000 7fc382ffd640 1 -- 172.21.15.1:0/593123204 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7fc3780bcac0 con 0x7fc3841036e0 2024-09-19T09:02:00.590 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.594+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc36c0a3240 msgr2=0x7fc36c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.594+0000 7fc38bc38640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc36c0a3240 0x7fc36c0a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc374005fd0 tx=0x7fc374009500 comp rx=0 tx=0).stop 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.594+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 msgr2=0x7fc384198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.594+0000 7fc38bc38640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 0x7fc384198c00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc378005940 tx=0x7fc378004040 comp rx=0 tx=0).stop 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.595+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 shutdown_connections 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.595+0000 7fc38bc38640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3841082a0 0x7fc38419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.595+0000 7fc38bc38640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3841036e0 0x7fc384198c00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.595+0000 7fc38bc38640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc36c0a3240 0x7fc36c0a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.595+0000 7fc38bc38640 1 --2- 172.21.15.1:0/593123204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc384102d30 0x7fc3841986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.595+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 >> 172.21.15.1:0/593123204 conn(0x7fc3840fc7d0 msgr2=0x7fc384105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.595+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 shutdown_connections 2024-09-19T09:02:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:00.595+0000 7fc38bc38640 1 -- 172.21.15.1:0/593123204 wait complete. 2024-09-19T09:02:00.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:00 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/593123204' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:02:00.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:00 smithi064 ceph-mon[35179]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:02:00.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:00 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/593123204' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:02:00.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:00 smithi064 ceph-mon[35179]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:02:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:00 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/593123204' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:02:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:00 smithi022 ceph-mon[35107]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:02:00.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:00 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/593123204' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:02:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:00 smithi022 ceph-mon[35107]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:02:00.966 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:00 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/593123204' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:02:00.966 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:00 smithi001 ceph-mon[30939]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:02:00.966 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:00 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/593123204' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:02:00.966 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:00 smithi001 ceph-mon[30939]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:02:01.340 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:02:01.629 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:01.899 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:01 smithi001 ceph-mon[30939]: pgmap v270: 33 pgs: 18 creating+peering, 14 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:02:01.899 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:01 smithi001 ceph-mon[30939]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:02:01.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:01 smithi022 ceph-mon[35107]: pgmap v270: 33 pgs: 18 creating+peering, 14 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:02:01.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:01 smithi022 ceph-mon[35107]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:02:02.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:01 smithi064 ceph-mon[35179]: pgmap v270: 33 pgs: 18 creating+peering, 14 unknown, 1 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:02:02.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:01 smithi064 ceph-mon[35179]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:02:02.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 -- 172.21.15.1:0/1633117593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f194010c170 msgr2=0x7f194010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 --2- 172.21.15.1:0/1633117593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f194010c170 0x7f194010e610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1938009ca0 tx=0x7f193802a950 comp rx=0 tx=0).stop 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 -- 172.21.15.1:0/1633117593 shutdown_connections 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 --2- 172.21.15.1:0/1633117593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f194010c170 0x7f194010e610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 --2- 172.21.15.1:0/1633117593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1940103660 0x7f194010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 --2- 172.21.15.1:0/1633117593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1940102d40 0x7f1940103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 -- 172.21.15.1:0/1633117593 >> 172.21.15.1:0/1633117593 conn(0x7f19400fc7a0 msgr2=0x7f19400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 -- 172.21.15.1:0/1633117593 shutdown_connections 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.114+0000 7f1944968640 1 -- 172.21.15.1:0/1633117593 wait complete. 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f1944968640 1 Processor -- start 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f1944968640 1 -- start start 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f1944968640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1940102d40 0x7f1940198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f1944968640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1940103660 0x7f1940198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f1944968640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194010c170 0x7f194019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f1944968640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1940112170 con 0x7f1940102d40 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f1944968640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1940111ff0 con 0x7f1940103660 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f1944968640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f19401122f0 con 0x7f194010c170 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f193e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1940102d40 0x7f1940198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f193e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1940102d40 0x7f1940198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38614/0 (socket says 172.21.15.1:38614) 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f193e59c640 1 -- 172.21.15.1:0/1089869880 learned_addr learned my addr 172.21.15.1:0/1089869880 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.115+0000 7f193dd9b640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1940103660 0x7f1940198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f193ed9d640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194010c170 0x7f194019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f193e59c640 1 -- 172.21.15.1:0/1089869880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194010c170 msgr2=0x7f194019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f193e59c640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194010c170 0x7f194019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f193e59c640 1 -- 172.21.15.1:0/1089869880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1940103660 msgr2=0x7f1940198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f193e59c640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1940103660 0x7f1940198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f193e59c640 1 -- 172.21.15.1:0/1089869880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194019d540 con 0x7f1940102d40 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f193e59c640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1940102d40 0x7f1940198590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f193000b4a0 tx=0x7f193000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f192f7fe640 1 -- 172.21.15.1:0/1089869880 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930014070 con 0x7f1940102d40 2024-09-19T09:02:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f192f7fe640 1 -- 172.21.15.1:0/1089869880 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1930010b10 con 0x7f1940102d40 2024-09-19T09:02:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194019d830 con 0x7f1940102d40 2024-09-19T09:02:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f192f7fe640 1 -- 172.21.15.1:0/1089869880 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930017d60 con 0x7f1940102d40 2024-09-19T09:02:02.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.116+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19401a5110 con 0x7f1940102d40 2024-09-19T09:02:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.117+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1940103120 con 0x7f1940102d40 2024-09-19T09:02:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.118+0000 7f192f7fe640 1 -- 172.21.15.1:0/1089869880 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1930017070 con 0x7f1940102d40 2024-09-19T09:02:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.119+0000 7f192f7fe640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f19280a32c0 0x7f19280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.119+0000 7f193dd9b640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f19280a32c0 0x7f19280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.119+0000 7f192f7fe640 1 -- 172.21.15.1:0/1089869880 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7f19300ceec0 con 0x7f1940102d40 2024-09-19T09:02:02.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.120+0000 7f193dd9b640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f19280a32c0 0x7f19280a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f19400fecc0 tx=0x7f1934009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:02.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.123+0000 7f192f7fe640 1 -- 172.21.15.1:0/1089869880 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f193009bd90 con 0x7f1940102d40 2024-09-19T09:02:02.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.333+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f19401998f0 con 0x7f1940102d40 2024-09-19T09:02:02.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.653+0000 7f192f7fe640 1 -- 172.21.15.1:0/1089869880 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f19401998f0 con 0x7f1940102d40 2024-09-19T09:02:02.653 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:02:02.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f19280a32c0 msgr2=0x7f19280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f19280a32c0 0x7f19280a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f19400fecc0 tx=0x7f1934009060 comp rx=0 tx=0).stop 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1940102d40 msgr2=0x7f1940198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1940102d40 0x7f1940198590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f193000b4a0 tx=0x7f193000b960 comp rx=0 tx=0).stop 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 shutdown_connections 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f19280a32c0 0x7f19280a5780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194010c170 0x7f194019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1940103660 0x7f1940198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 --2- 172.21.15.1:0/1089869880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1940102d40 0x7f1940198590 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.655+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 >> 172.21.15.1:0/1089869880 conn(0x7f19400fc7a0 msgr2=0x7f19400fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.656+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 shutdown_connections 2024-09-19T09:02:02.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:02.656+0000 7f1944968640 1 -- 172.21.15.1:0/1089869880 wait complete. 2024-09-19T09:02:02.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:02 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1089869880' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:02:02.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:02 smithi022 ceph-mon[35107]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:02:03.040 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:02 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1089869880' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:02:03.040 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:02 smithi001 ceph-mon[30939]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:02:03.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:02 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1089869880' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:02:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:02 smithi064 ceph-mon[35179]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:02:03.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:02:03.615 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:03.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:03 smithi022 ceph-mon[35107]: pgmap v273: 97 pgs: 1 creating+activating, 18 creating+peering, 73 unknown, 5 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:02:03.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:03 smithi022 ceph-mon[35107]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:02:03.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:03 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1089869880' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:02:03.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:03 smithi022 ceph-mon[35107]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:02:03.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:03 smithi022 ceph-mon[35107]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:02:03.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:03 smithi001 ceph-mon[30939]: pgmap v273: 97 pgs: 1 creating+activating, 18 creating+peering, 73 unknown, 5 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:02:03.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:03 smithi001 ceph-mon[30939]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:02:03.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:03 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1089869880' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:02:03.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:03 smithi001 ceph-mon[30939]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:02:03.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:03 smithi001 ceph-mon[30939]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 -- 172.21.15.1:0/4152061013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010103660 msgr2=0x7f001010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 --2- 172.21.15.1:0/4152061013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010103660 0x7f001010bb50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0004009900 tx=0x7f000402a480 comp rx=0 tx=0).stop 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 -- 172.21.15.1:0/4152061013 shutdown_connections 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 --2- 172.21.15.1:0/4152061013 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f001010c170 0x7f001010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 --2- 172.21.15.1:0/4152061013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010103660 0x7f001010bb50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 --2- 172.21.15.1:0/4152061013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0010102d40 0x7f0010103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 -- 172.21.15.1:0/4152061013 >> 172.21.15.1:0/4152061013 conn(0x7f00100fc7a0 msgr2=0x7f00100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 -- 172.21.15.1:0/4152061013 shutdown_connections 2024-09-19T09:02:04.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 -- 172.21.15.1:0/4152061013 wait complete. 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 Processor -- start 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.051+0000 7f0015340640 1 -- start start 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f0015340640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010102d40 0x7f00101009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f0015340640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0010103660 0x7f0010100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f0015340640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f001010c170 0x7f0010101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f0015340640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0010112090 con 0x7f0010102d40 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f0015340640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0010111f10 con 0x7f001010c170 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f0015340640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0010112210 con 0x7f0010103660 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010102d40 0x7f00101009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010102d40 0x7f00101009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55856/0 (socket says 172.21.15.1:55856) 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 -- 172.21.15.1:0/2126202955 learned_addr learned my addr 172.21.15.1:0/2126202955 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000e7fc640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0010103660 0x7f0010100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000f7fe640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f001010c170 0x7f0010101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 -- 172.21.15.1:0/2126202955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0010103660 msgr2=0x7f0010100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0010103660 0x7f0010100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 -- 172.21.15.1:0/2126202955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f001010c170 msgr2=0x7f0010101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f001010c170 0x7f0010101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 -- 172.21.15.1:0/2126202955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00101a6a50 con 0x7f0010102d40 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f000effd640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010102d40 0x7f00101009a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f000000d950 tx=0x7f000000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7efff7fff640 1 -- 172.21.15.1:0/2126202955 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000017030 con 0x7f0010102d40 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7efff7fff640 1 -- 172.21.15.1:0/2126202955 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0000004020 con 0x7f0010102d40 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.052+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00101a6d40 con 0x7f0010102d40 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.053+0000 7efff7fff640 1 -- 172.21.15.1:0/2126202955 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000004a00 con 0x7f0010102d40 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.053+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00101a71f0 con 0x7f0010102d40 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.053+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0010103120 con 0x7f0010102d40 2024-09-19T09:02:04.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.055+0000 7efff7fff640 1 -- 172.21.15.1:0/2126202955 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f00000041d0 con 0x7f0010102d40 2024-09-19T09:02:04.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.055+0000 7efff7fff640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efff80a3240 0x7efff80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:04.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.055+0000 7f000e7fc640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efff80a3240 0x7efff80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:04.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.056+0000 7efff7fff640 1 -- 172.21.15.1:0/2126202955 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f00000cf110 con 0x7f0010102d40 2024-09-19T09:02:04.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.056+0000 7f000e7fc640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efff80a3240 0x7efff80a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0004009230 tx=0x7f00040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:04.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.060+0000 7efff7fff640 1 -- 172.21.15.1:0/2126202955 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f000009bf80 con 0x7f0010102d40 2024-09-19T09:02:04.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:03 smithi064 ceph-mon[35179]: pgmap v273: 97 pgs: 1 creating+activating, 18 creating+peering, 73 unknown, 5 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:02:04.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:03 smithi064 ceph-mon[35179]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:02:04.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:03 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1089869880' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:02:04.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:03 smithi064 ceph-mon[35179]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:02:04.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:03 smithi064 ceph-mon[35179]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:02:04.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.237+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0010106c50 con 0x7f0010102d40 2024-09-19T09:02:04.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.238+0000 7efff7fff640 1 -- 172.21.15.1:0/2126202955 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22138 (secure 0 0 0) 0x7f000009b880 con 0x7f0010102d40 2024-09-19T09:02:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:04.238 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":78,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:02.334225+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:02:04.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efff80a3240 msgr2=0x7efff80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efff80a3240 0x7efff80a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0004009230 tx=0x7f00040058d0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010102d40 msgr2=0x7f00101009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010102d40 0x7f00101009a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f000000d950 tx=0x7f000000de10 comp rx=0 tx=0).stop 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 shutdown_connections 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f001010c170 0x7f0010101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efff80a3240 0x7efff80a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0010103660 0x7f0010100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 --2- 172.21.15.1:0/2126202955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0010102d40 0x7f00101009a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.240+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 >> 172.21.15.1:0/2126202955 conn(0x7f00100fc7a0 msgr2=0x7f00100fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.241+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 shutdown_connections 2024-09-19T09:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:04.241+0000 7f0015340640 1 -- 172.21.15.1:0/2126202955 wait complete. 2024-09-19T09:02:04.889 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:04 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] up:active 2024-09-19T09:02:04.890 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:04 smithi001 ceph-mon[30939]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:04.890 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:04 smithi001 ceph-mon[30939]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:04.890 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:04 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2126202955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:04.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:02:04.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:04 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] up:active 2024-09-19T09:02:04.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:04 smithi022 ceph-mon[35107]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:04.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:04 smithi022 ceph-mon[35107]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:04.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:04 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2126202955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:05.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:04 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] up:active 2024-09-19T09:02:05.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:04 smithi064 ceph-mon[35179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:05.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:04 smithi064 ceph-mon[35179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:05.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:04 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2126202955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:05.181 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:05.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 -- 172.21.15.1:0/89767858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 msgr2=0x7f59f810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 --2- 172.21.15.1:0/89767858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 0x7f59f810ea90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009ca0 tx=0x7f59f002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 -- 172.21.15.1:0/89767858 shutdown_connections 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 --2- 172.21.15.1:0/89767858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 0x7f59f810ea90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 --2- 172.21.15.1:0/89767858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59f8102790 0x7f59f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 --2- 172.21.15.1:0/89767858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59f8101de0 0x7f59f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 -- 172.21.15.1:0/89767858 >> 172.21.15.1:0/89767858 conn(0x7f59f80fd8c0 msgr2=0x7f59f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 -- 172.21.15.1:0/89767858 shutdown_connections 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.683+0000 7f59ff505640 1 -- 172.21.15.1:0/89767858 wait complete. 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59ff505640 1 Processor -- start 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59ff505640 1 -- start start 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59ff505640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59f8101de0 0x7f59f81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59ff505640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59f8102790 0x7f59f8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59ff505640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 0x7f59f819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59ff505640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8112090 con 0x7f59f8106f10 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59ff505640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8111f10 con 0x7f59f8102790 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59ff505640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8112210 con 0x7f59f8101de0 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fdaa2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 0x7f59f819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fdaa2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 0x7f59f819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55868/0 (socket says 172.21.15.1:55868) 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fdaa2640 1 -- 172.21.15.1:0/1694566054 learned_addr learned my addr 172.21.15.1:0/1694566054 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fd2a1640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59f8101de0 0x7f59f81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fcaa0640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59f8102790 0x7f59f8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fdaa2640 1 -- 172.21.15.1:0/1694566054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59f8101de0 msgr2=0x7f59f81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fdaa2640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59f8101de0 0x7f59f81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fdaa2640 1 -- 172.21.15.1:0/1694566054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59f8102790 msgr2=0x7f59f8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fdaa2640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59f8102790 0x7f59f8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.684+0000 7f59fdaa2640 1 -- 172.21.15.1:0/1694566054 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f819d3a0 con 0x7f59f8106f10 2024-09-19T09:02:05.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.685+0000 7f59fdaa2640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 0x7f59f819ccc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f59f0006010 tx=0x7f59f00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.685+0000 7f59ee7fc640 1 -- 172.21.15.1:0/1694566054 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f002fa20 con 0x7f59f8106f10 2024-09-19T09:02:05.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.685+0000 7f59ee7fc640 1 -- 172.21.15.1:0/1694566054 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f59f002fbc0 con 0x7f59f8106f10 2024-09-19T09:02:05.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.685+0000 7f59ee7fc640 1 -- 172.21.15.1:0/1694566054 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f00467f0 con 0x7f59f8106f10 2024-09-19T09:02:05.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.685+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f819d630 con 0x7f59f8106f10 2024-09-19T09:02:05.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.685+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f81a4f70 con 0x7f59f8106f10 2024-09-19T09:02:05.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.686+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f81021c0 con 0x7f59f8106f10 2024-09-19T09:02:05.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.688+0000 7f59ee7fc640 1 -- 172.21.15.1:0/1694566054 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f59f0046990 con 0x7f59f8106f10 2024-09-19T09:02:05.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.688+0000 7f59ee7fc640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f59e40a3240 0x7f59e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:05.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.688+0000 7f59fd2a1640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f59e40a3240 0x7f59e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:05.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.688+0000 7f59ee7fc640 1 -- 172.21.15.1:0/1694566054 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f59f00f0c60 con 0x7f59f8106f10 2024-09-19T09:02:05.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.689+0000 7f59fd2a1640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f59e40a3240 0x7f59e40a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f59f4005d00 tx=0x7f59f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:05.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.693+0000 7f59ee7fc640 1 -- 172.21.15.1:0/1694566054 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f59f00bdb60 con 0x7f59f8106f10 2024-09-19T09:02:05.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.869+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59f81a51d0 con 0x7f59f8106f10 2024-09-19T09:02:05.869 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:05 smithi001 ceph-mon[30939]: pgmap v275: 97 pgs: 1 creating+activating, 12 creating+peering, 17 unknown, 67 active+clean; 577 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 233 B/s wr, 5 op/s 2024-09-19T09:02:05.870 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:05 smithi001 ceph-mon[30939]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:02:05.870 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:05 smithi001 ceph-mon[30939]: Cluster is now healthy 2024-09-19T09:02:05.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.871+0000 7f59ee7fc640 1 -- 172.21.15.1:0/1694566054 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22138 (secure 0 0 0) 0x7f59f00bd460 con 0x7f59f8106f10 2024-09-19T09:02:05.871 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:05.871 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":78,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:02.334225+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:02:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f59e40a3240 msgr2=0x7f59e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f59e40a3240 0x7f59e40a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f59f4005d00 tx=0x7f59f400b410 comp rx=0 tx=0).stop 2024-09-19T09:02:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 msgr2=0x7f59f819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 0x7f59f819ccc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f59f0006010 tx=0x7f59f00319f0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 shutdown_connections 2024-09-19T09:02:05.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59f8106f10 0x7f59f819ccc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59f8102790 0x7f59f8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f59e40a3240 0x7f59e40a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 --2- 172.21.15.1:0/1694566054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f59f8101de0 0x7f59f81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 >> 172.21.15.1:0/1694566054 conn(0x7f59f80fd8c0 msgr2=0x7f59f80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 shutdown_connections 2024-09-19T09:02:05.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:05.873+0000 7f59ff505640 1 -- 172.21.15.1:0/1694566054 wait complete. 2024-09-19T09:02:05.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:05 smithi022 ceph-mon[35107]: pgmap v275: 97 pgs: 1 creating+activating, 12 creating+peering, 17 unknown, 67 active+clean; 577 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 233 B/s wr, 5 op/s 2024-09-19T09:02:05.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:05 smithi022 ceph-mon[35107]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:02:05.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:05 smithi022 ceph-mon[35107]: Cluster is now healthy 2024-09-19T09:02:06.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:05 smithi064 ceph-mon[35179]: pgmap v275: 97 pgs: 1 creating+activating, 12 creating+peering, 17 unknown, 67 active+clean; 577 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 233 B/s wr, 5 op/s 2024-09-19T09:02:06.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:05 smithi064 ceph-mon[35179]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:02:06.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:05 smithi064 ceph-mon[35179]: Cluster is now healthy 2024-09-19T09:02:06.546 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:02:06.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:06 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1694566054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:06.807 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:06.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:06 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1694566054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:07.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:06 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1694566054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.259+0000 7f2a73d74640 1 -- 172.21.15.1:0/3933124419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c100e20 msgr2=0x7f2a6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.259+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3933124419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c100e20 0x7f2a6c101200 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009900 tx=0x7f2a6802a480 comp rx=0 tx=0).stop 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 -- 172.21.15.1:0/3933124419 shutdown_connections 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3933124419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a6c102ef0 0x7f2a6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3933124419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a6c102570 0x7f2a6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3933124419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c100e20 0x7f2a6c101200 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 -- 172.21.15.1:0/3933124419 >> 172.21.15.1:0/3933124419 conn(0x7f2a6c0fc7d0 msgr2=0x7f2a6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 -- 172.21.15.1:0/3933124419 shutdown_connections 2024-09-19T09:02:07.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 -- 172.21.15.1:0/3933124419 wait complete. 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 Processor -- start 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.260+0000 7f2a73d74640 1 -- start start 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a73d74640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a6c100e20 0x7f2a6c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a73d74640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a6c102570 0x7f2a6c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a73d74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c102ef0 0x7f2a6c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a73d74640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1110e0 con 0x7f2a6c102ef0 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a73d74640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c110f60 con 0x7f2a6c102570 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a73d74640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c111260 con 0x7f2a6c100e20 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c102ef0 0x7f2a6c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c102ef0 0x7f2a6c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55882/0 (socket says 172.21.15.1:55882) 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 -- 172.21.15.1:0/3543845826 learned_addr learned my addr 172.21.15.1:0/3543845826 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:07.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a71b10640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a6c100e20 0x7f2a6c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a7130f640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a6c102570 0x7f2a6c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 -- 172.21.15.1:0/3543845826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a6c100e20 msgr2=0x7f2a6c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a6c100e20 0x7f2a6c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 -- 172.21.15.1:0/3543845826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a6c102570 msgr2=0x7f2a6c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a6c102570 0x7f2a6c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 -- 172.21.15.1:0/3543845826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c1a6b60 con 0x7f2a6c102ef0 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a7130f640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a6c102570 0x7f2a6c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a72311640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c102ef0 0x7f2a6c0fd700 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400eaa0 tx=0x7f2a6400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a62ffd640 1 -- 172.21.15.1:0/3543845826 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400cdb0 con 0x7f2a6c102ef0 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a62ffd640 1 -- 172.21.15.1:0/3543845826 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a64004b20 con 0x7f2a6c102ef0 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c1a6e50 con 0x7f2a6c102ef0 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a62ffd640 1 -- 172.21.15.1:0/3543845826 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64011760 con 0x7f2a6c102ef0 2024-09-19T09:02:07.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.261+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c1a7310 con 0x7f2a6c102ef0 2024-09-19T09:02:07.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.262+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6c101200 con 0x7f2a6c102ef0 2024-09-19T09:02:07.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.264+0000 7f2a62ffd640 1 -- 172.21.15.1:0/3543845826 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2a64004cd0 con 0x7f2a6c102ef0 2024-09-19T09:02:07.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.264+0000 7f2a62ffd640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2a580a3240 0x7f2a580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:07.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.264+0000 7f2a71b10640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2a580a3240 0x7f2a580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:07.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.264+0000 7f2a62ffd640 1 -- 172.21.15.1:0/3543845826 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f2a640cfa10 con 0x7f2a6c102ef0 2024-09-19T09:02:07.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.265+0000 7f2a71b10640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2a580a3240 0x7f2a580a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009230 tx=0x7f2a680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:07.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.268+0000 7f2a62ffd640 1 -- 172.21.15.1:0/3543845826 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a64016030 con 0x7f2a6c102ef0 2024-09-19T09:02:07.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.487+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2a6c10a0a0 con 0x7f2a6c102ef0 2024-09-19T09:02:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.662+0000 7f2a62ffd640 1 -- 172.21.15.1:0/3543845826 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f2a6409c880 con 0x7f2a6c102ef0 2024-09-19T09:02:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2a580a3240 msgr2=0x7f2a580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2a580a3240 0x7f2a580a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009230 tx=0x7f2a680058d0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c102ef0 msgr2=0x7f2a6c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c102ef0 0x7f2a6c0fd700 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400eaa0 tx=0x7f2a6400ef60 comp rx=0 tx=0).stop 2024-09-19T09:02:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 shutdown_connections 2024-09-19T09:02:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a6c102ef0 0x7f2a6c0fd700 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a6c102570 0x7f2a6c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2a580a3240 0x7f2a580a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 --2- 172.21.15.1:0/3543845826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a6c100e20 0x7f2a6c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 >> 172.21.15.1:0/3543845826 conn(0x7f2a6c0fc7d0 msgr2=0x7f2a6c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 shutdown_connections 2024-09-19T09:02:07.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:07.665+0000 7f2a73d74640 1 -- 172.21.15.1:0/3543845826 wait complete. 2024-09-19T09:02:07.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:07 smithi001 ceph-mon[30939]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-19T09:02:07.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:07 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3543845826' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:02:07.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:07 smithi022 ceph-mon[35107]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-19T09:02:07.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:07 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3543845826' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:02:08.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:07 smithi064 ceph-mon[35179]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-19T09:02:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:07 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3543845826' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:02:08.395 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T09:02:08.396 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T09:02:08.657 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:08.671 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:02:08 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: 2024-09-19T09:02:08.392+0000 7f62266b7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:02:08.931 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:08 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3543845826' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:02:08.931 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:08 smithi001 ceph-mon[30939]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:08.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:08 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3543845826' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:02:08.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:08 smithi022 ceph-mon[35107]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 -- 172.21.15.1:0/3180379666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c103660 msgr2=0x7f4f2c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/3180379666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c103660 0x7f4f2c10bb50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009900 tx=0x7f4f1402a480 comp rx=0 tx=0).stop 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 -- 172.21.15.1:0/3180379666 shutdown_connections 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/3180379666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f2c10c170 0x7f4f2c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/3180379666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c103660 0x7f4f2c10bb50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/3180379666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f2c102d40 0x7f4f2c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 -- 172.21.15.1:0/3180379666 >> 172.21.15.1:0/3180379666 conn(0x7f4f2c0fc7a0 msgr2=0x7f4f2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 -- 172.21.15.1:0/3180379666 shutdown_connections 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.101+0000 7f4f31b5e640 1 -- 172.21.15.1:0/3180379666 wait complete. 2024-09-19T09:02:09.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f31b5e640 1 Processor -- start 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f31b5e640 1 -- start start 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f31b5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c102d40 0x7f4f2c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f31b5e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f2c103660 0x7f4f2c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f31b5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f2c10c170 0x7f4f2c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f31b5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c112090 con 0x7f4f2c102d40 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f31b5e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c111f10 con 0x7f4f2c10c170 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f31b5e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c112210 con 0x7f4f2c103660 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f2b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c102d40 0x7f4f2c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f2b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c102d40 0x7f4f2c1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55896/0 (socket says 172.21.15.1:55896) 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.102+0000 7f4f2b7fe640 1 -- 172.21.15.1:0/446764382 learned_addr learned my addr 172.21.15.1:0/446764382 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f23fff640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f2c103660 0x7f4f2c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f2bfff640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f2c10c170 0x7f4f2c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:09.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f2b7fe640 1 -- 172.21.15.1:0/446764382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f2c103660 msgr2=0x7f4f2c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f2b7fe640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f2c103660 0x7f4f2c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f2b7fe640 1 -- 172.21.15.1:0/446764382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f2c10c170 msgr2=0x7f4f2c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f2b7fe640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f2c10c170 0x7f4f2c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f2b7fe640 1 -- 172.21.15.1:0/446764382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c19d560 con 0x7f4f2c102d40 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f2bfff640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f2c10c170 0x7f4f2c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f2b7fe640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c102d40 0x7f4f2c1985b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00e9f0 tx=0x7f4f1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f297fa640 1 -- 172.21.15.1:0/446764382 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c00cd80 con 0x7f4f2c102d40 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c19d850 con 0x7f4f2c102d40 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f297fa640 1 -- 172.21.15.1:0/446764382 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f1c005520 con 0x7f4f2c102d40 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f297fa640 1 -- 172.21.15.1:0/446764382 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c010690 con 0x7f4f2c102d40 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.103+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c1a5130 con 0x7f4f2c102d40 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.104+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2c103120 con 0x7f4f2c102d40 2024-09-19T09:02:09.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.105+0000 7f4f297fa640 1 -- 172.21.15.1:0/446764382 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4f1c0046c0 con 0x7f4f2c102d40 2024-09-19T09:02:09.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.106+0000 7f4f297fa640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4f180a3240 0x7f4f180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:09.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.106+0000 7f4f23fff640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4f180a3240 0x7f4f180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:09.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.106+0000 7f4f297fa640 1 -- 172.21.15.1:0/446764382 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f4f1c0cfd20 con 0x7f4f2c102d40 2024-09-19T09:02:09.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.107+0000 7f4f23fff640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4f180a3240 0x7f4f180a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c10d4d0 tx=0x7f4f14005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:09.110 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:08 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3543845826' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:02:09.110 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:08 smithi064 ceph-mon[35179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:02:09.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.111+0000 7f4f297fa640 1 -- 172.21.15.1:0/446764382 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f1c09cb90 con 0x7f4f2c102d40 2024-09-19T09:02:09.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.324+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f4f2c1071e0 con 0x7f4f2c102d40 2024-09-19T09:02:09.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.484+0000 7f4f297fa640 1 -- 172.21.15.1:0/446764382 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f4f1c09c490 con 0x7f4f2c102d40 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.486+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4f180a3240 msgr2=0x7f4f180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.486+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4f180a3240 0x7f4f180a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c10d4d0 tx=0x7f4f14005a20 comp rx=0 tx=0).stop 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.486+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c102d40 msgr2=0x7f4f2c1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.486+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c102d40 0x7f4f2c1985b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00e9f0 tx=0x7f4f1c00edf0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.487+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 shutdown_connections 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.487+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f2c10c170 0x7f4f2c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.487+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4f180a3240 0x7f4f180a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.487+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f2c103660 0x7f4f2c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.487+0000 7f4f31b5e640 1 --2- 172.21.15.1:0/446764382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f2c102d40 0x7f4f2c1985b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.487+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 >> 172.21.15.1:0/446764382 conn(0x7f4f2c0fc7a0 msgr2=0x7f4f2c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:09.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.487+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 shutdown_connections 2024-09-19T09:02:09.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:09.487+0000 7f4f31b5e640 1 -- 172.21.15.1:0/446764382 wait complete. 2024-09-19T09:02:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:09 smithi022 ceph-mon[35107]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T09:02:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:09 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/446764382' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T09:02:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:09 smithi022 ceph-mon[35107]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:02:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:09 smithi022 ceph-mon[35107]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:02:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:09 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/446764382' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T09:02:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:09 smithi022 ceph-mon[35107]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:02:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:09 smithi022 ceph-mon[35107]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:02:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:09 smithi001 ceph-mon[30939]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T09:02:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:09 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/446764382' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T09:02:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:09 smithi001 ceph-mon[30939]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:02:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:09 smithi001 ceph-mon[30939]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:02:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:09 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/446764382' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T09:02:10.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:09 smithi001 ceph-mon[30939]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:02:10.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:09 smithi001 ceph-mon[30939]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:02:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:09 smithi064 ceph-mon[35179]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-19T09:02:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:09 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/446764382' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T09:02:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:09 smithi064 ceph-mon[35179]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:02:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:09 smithi064 ceph-mon[35179]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:02:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:09 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/446764382' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T09:02:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:09 smithi064 ceph-mon[35179]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:02:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:09 smithi064 ceph-mon[35179]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:02:10.183 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T09:02:10.439 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:10.815 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T09:02:10.815 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T09:02:10.815 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] up:active 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: Cluster is now healthy 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:02:10.816 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:02:10.817 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:10 smithi001 ceph-mon[30939]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:02:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 -- 172.21.15.1:0/2708943060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 msgr2=0x7fc39c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 --2- 172.21.15.1:0/2708943060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 0x7fc39c10da40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc394009ca0 tx=0x7fc39402a950 comp rx=0 tx=0).stop 2024-09-19T09:02:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 -- 172.21.15.1:0/2708943060 shutdown_connections 2024-09-19T09:02:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 --2- 172.21.15.1:0/2708943060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 0x7fc39c10da40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 --2- 172.21.15.1:0/2708943060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc39c102570 0x7fc39c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 --2- 172.21.15.1:0/2708943060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc39c100e20 0x7fc39c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 -- 172.21.15.1:0/2708943060 >> 172.21.15.1:0/2708943060 conn(0x7fc39c0fc7d0 msgr2=0x7fc39c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:10.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 -- 172.21.15.1:0/2708943060 shutdown_connections 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.900+0000 7fc3a229d640 1 -- 172.21.15.1:0/2708943060 wait complete. 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a229d640 1 Processor -- start 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a229d640 1 -- start start 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a229d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc39c100e20 0x7fc39c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a229d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc39c102570 0x7fc39c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a229d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 0x7fc39c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a229d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c1110a0 con 0x7fc39c102ef0 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a229d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c110f20 con 0x7fc39c102570 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a229d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c111220 con 0x7fc39c100e20 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a083a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 0x7fc39c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a083a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 0x7fc39c19bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55910/0 (socket says 172.21.15.1:55910) 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc3a083a640 1 -- 172.21.15.1:0/995276676 learned_addr learned my addr 172.21.15.1:0/995276676 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:10.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc39bfff640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc39c100e20 0x7fc39c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.901+0000 7fc39b7fe640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc39c102570 0x7fc39c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3a083a640 1 -- 172.21.15.1:0/995276676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc39c100e20 msgr2=0x7fc39c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3a083a640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc39c100e20 0x7fc39c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3a083a640 1 -- 172.21.15.1:0/995276676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc39c102570 msgr2=0x7fc39c1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3a083a640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc39c102570 0x7fc39c1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3a083a640 1 -- 172.21.15.1:0/995276676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c19c410 con 0x7fc39c102ef0 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc39b7fe640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc39c102570 0x7fc39c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3a083a640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 0x7fc39c19bd30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc394005cc0 tx=0x7fc39402f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3997fa640 1 -- 172.21.15.1:0/995276676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394034040 con 0x7fc39c102ef0 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3997fa640 1 -- 172.21.15.1:0/995276676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc394030940 con 0x7fc39c102ef0 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39c19c6a0 con 0x7fc39c102ef0 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3997fa640 1 -- 172.21.15.1:0/995276676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3940456e0 con 0x7fc39c102ef0 2024-09-19T09:02:10.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.902+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39c1a3fe0 con 0x7fc39c102ef0 2024-09-19T09:02:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.903+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc39c101200 con 0x7fc39c102ef0 2024-09-19T09:02:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.904+0000 7fc3997fa640 1 -- 172.21.15.1:0/995276676 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc394037020 con 0x7fc39c102ef0 2024-09-19T09:02:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.905+0000 7fc3997fa640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3840a32c0 0x7fc3840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.905+0000 7fc39bfff640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3840a32c0 0x7fc3840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.905+0000 7fc3997fa640 1 -- 172.21.15.1:0/995276676 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fc3940f0930 con 0x7fc39c102ef0 2024-09-19T09:02:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.905+0000 7fc39bfff640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3840a32c0 0x7fc3840a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:10.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:10.909+0000 7fc3997fa640 1 -- 172.21.15.1:0/995276676 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3940bd630 con 0x7fc39c102ef0 2024-09-19T09:02:10.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T09:02:10.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T09:02:10.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:02:10.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] up:active 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: Cluster is now healthy 2024-09-19T09:02:10.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:02:10.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:02:10.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:10 smithi022 ceph-mon[35107]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:02:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T09:02:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T09:02:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:02:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]: dispatch 2024-09-19T09:02:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-19T09:02:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-09-19T09:02:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T09:02:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]: dispatch 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] up:active 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: Cluster is now healthy 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T09:02:11.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:10 smithi064 ceph-mon[35179]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T09:02:11.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.122+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fc39c1a41b0 con 0x7fc39c102ef0 2024-09-19T09:02:11.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.492+0000 7fc3997fa640 1 -- 172.21.15.1:0/995276676 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fc3940bcf30 con 0x7fc39c102ef0 2024-09-19T09:02:11.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3840a32c0 msgr2=0x7fc3840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:11.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3840a32c0 0x7fc3840a5780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c00b390 comp rx=0 tx=0).stop 2024-09-19T09:02:11.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 msgr2=0x7fc39c19bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:11.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 0x7fc39c19bd30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc394005cc0 tx=0x7fc39402f790 comp rx=0 tx=0).stop 2024-09-19T09:02:11.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 shutdown_connections 2024-09-19T09:02:11.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc39c102ef0 0x7fc39c19bd30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc39c102570 0x7fc39c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3840a32c0 0x7fc3840a5780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 --2- 172.21.15.1:0/995276676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc39c100e20 0x7fc39c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:11.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 >> 172.21.15.1:0/995276676 conn(0x7fc39c0fc7d0 msgr2=0x7fc39c1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:11.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 shutdown_connections 2024-09-19T09:02:11.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:11.495+0000 7fc3a229d640 1 -- 172.21.15.1:0/995276676 wait complete. 2024-09-19T09:02:11.797 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:02:11.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/995276676' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:02:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/995276676' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:02:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] up:active 2024-09-19T09:02:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:02:11.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:11 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-19T09:02:11.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-19T09:02:11.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:02:11.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/995276676' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:02:11.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/995276676' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:02:11.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] up:active 2024-09-19T09:02:11.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:02:11.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:11 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:02:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:02:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T09:02:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T09:02:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:02:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7]}]': finished 2024-09-19T09:02:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-19T09:02:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-09-19T09:02:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 6]}]': finished 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/995276676' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/995276676' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] up:active 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T09:02:12.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:11 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:02:12.182 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T09:02:12.443 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:12.817 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:12 smithi001 ceph-mon[30939]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:02:12.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 -- 172.21.15.1:0/2742035761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18102790 msgr2=0x7f3a181067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/2742035761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18102790 0x7f3a181067e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009900 tx=0x7f3a0c02a410 comp rx=0 tx=0).stop 2024-09-19T09:02:12.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 -- 172.21.15.1:0/2742035761 shutdown_connections 2024-09-19T09:02:12.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/2742035761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a18106f10 0x7f3a1810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/2742035761 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18102790 0x7f3a181067e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/2742035761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a18101de0 0x7f3a181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 -- 172.21.15.1:0/2742035761 >> 172.21.15.1:0/2742035761 conn(0x7f3a180fd8c0 msgr2=0x7f3a180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 -- 172.21.15.1:0/2742035761 shutdown_connections 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.934+0000 7f3a1d66a640 1 -- 172.21.15.1:0/2742035761 wait complete. 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a1d66a640 1 Processor -- start 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a1d66a640 1 -- start start 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a1d66a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a18101de0 0x7f3a180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a1d66a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a18102790 0x7f3a18074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a1d66a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18106f10 0x7f3a18074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a1d66a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3a18112090 con 0x7f3a18106f10 2024-09-19T09:02:12.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a1d66a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a18111f10 con 0x7f3a18102790 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a1d66a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3a18112210 con 0x7f3a18101de0 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18106f10 0x7f3a18074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18106f10 0x7f3a18074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57668/0 (socket says 172.21.15.1:57668) 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a177fe640 1 -- 172.21.15.1:0/3470044847 learned_addr learned my addr 172.21.15.1:0/3470044847 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a167fc640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a18102790 0x7f3a18074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.935+0000 7f3a16ffd640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a18101de0 0x7f3a180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f3a177fe640 1 -- 172.21.15.1:0/3470044847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a18101de0 msgr2=0x7f3a180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f3a177fe640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a18101de0 0x7f3a180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f3a177fe640 1 -- 172.21.15.1:0/3470044847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a18102790 msgr2=0x7f3a18074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f3a177fe640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a18102790 0x7f3a18074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f3a177fe640 1 -- 172.21.15.1:0/3470044847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a181a69f0 con 0x7f3a18106f10 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f3a177fe640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18106f10 0x7f3a18074f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000cad0 tx=0x7f3a1000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f39fffff640 1 -- 172.21.15.1:0/3470044847 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000ae20 con 0x7f3a18106f10 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a181a6ce0 con 0x7f3a18106f10 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f39fffff640 1 -- 172.21.15.1:0/3470044847 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a10004b20 con 0x7f3a18106f10 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f39fffff640 1 -- 172.21.15.1:0/3470044847 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000f780 con 0x7f3a18106f10 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.936+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a181a7270 con 0x7f3a18106f10 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.937+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a181021c0 con 0x7f3a18106f10 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.938+0000 7f39fffff640 1 -- 172.21.15.1:0/3470044847 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3a10004cd0 con 0x7f3a18106f10 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.939+0000 7f39fffff640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a000a3240 0x7f3a000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.939+0000 7f3a16ffd640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a000a3240 0x7f3a000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.939+0000 7f39fffff640 1 -- 172.21.15.1:0/3470044847 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3a100cf970 con 0x7f3a18106f10 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.939+0000 7f3a16ffd640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a000a3240 0x7f3a000a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3a08005fd0 tx=0x7f3a08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:12.943+0000 7f39fffff640 1 -- 172.21.15.1:0/3470044847 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a10014030 con 0x7f3a18106f10 2024-09-19T09:02:12.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:12 smithi022 ceph-mon[35107]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:02:13.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:12 smithi064 ceph-mon[35179]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:02:13.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.156+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3a1810a0f0 con 0x7f3a18106f10 2024-09-19T09:02:13.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.695+0000 7f39fffff640 1 -- 172.21.15.1:0/3470044847 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f3a1009c670 con 0x7f3a18106f10 2024-09-19T09:02:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a000a3240 msgr2=0x7f3a000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a000a3240 0x7f3a000a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3a08005fd0 tx=0x7f3a08005850 comp rx=0 tx=0).stop 2024-09-19T09:02:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18106f10 msgr2=0x7f3a18074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18106f10 0x7f3a18074f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000cad0 tx=0x7f3a1000cf90 comp rx=0 tx=0).stop 2024-09-19T09:02:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 shutdown_connections 2024-09-19T09:02:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a18106f10 0x7f3a18074f70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a18102790 0x7f3a18074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3a000a3240 0x7f3a000a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 --2- 172.21.15.1:0/3470044847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a18101de0 0x7f3a180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 >> 172.21.15.1:0/3470044847 conn(0x7f3a180fd8c0 msgr2=0x7f3a180febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 shutdown_connections 2024-09-19T09:02:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:13.698+0000 7f3a1d66a640 1 -- 172.21.15.1:0/3470044847 wait complete. 2024-09-19T09:02:13.700 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:02:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: 2024-09-19T09:02:13.393+0000 7f62266b7640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T09:02:13.700 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:02:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: 2024-09-19T09:02:13.393+0000 7f62266b7640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T09:02:13.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:13 smithi022 ceph-mon[35107]: pgmap v281: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-19T09:02:13.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:13 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3470044847' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:02:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:13 smithi001 ceph-mon[30939]: pgmap v281: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-19T09:02:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:13 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3470044847' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:02:14.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:13 smithi064 ceph-mon[35179]: pgmap v281: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-19T09:02:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:13 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3470044847' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:02:14.436 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T09:02:14.436 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T09:02:14.701 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:14.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:14 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3470044847' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:02:14.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:14 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:02:14.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:14 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3470044847' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:02:14.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:14 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:02:15.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:14 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3470044847' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:02:15.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:14 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 -- 172.21.15.1:0/3119750211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 msgr2=0x7f5c4c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 --2- 172.21.15.1:0/3119750211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 0x7f5c4c1029b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009900 tx=0x7f5c3c02a480 comp rx=0 tx=0).stop 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 -- 172.21.15.1:0/3119750211 shutdown_connections 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 --2- 172.21.15.1:0/3119750211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c4c102ef0 0x7f5c4c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 --2- 172.21.15.1:0/3119750211 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 0x7f5c4c1029b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 --2- 172.21.15.1:0/3119750211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c4c100e20 0x7f5c4c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 -- 172.21.15.1:0/3119750211 >> 172.21.15.1:0/3119750211 conn(0x7f5c4c0fc7d0 msgr2=0x7f5c4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 -- 172.21.15.1:0/3119750211 shutdown_connections 2024-09-19T09:02:15.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.258+0000 7f5c532c0640 1 -- 172.21.15.1:0/3119750211 wait complete. 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c532c0640 1 Processor -- start 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c532c0640 1 -- start start 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c532c0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c4c100e20 0x7f5c4c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c532c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 0x7f5c4c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c532c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c4c102ef0 0x7f5c4c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c532c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1110a0 con 0x7f5c4c102570 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c532c0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c110f20 con 0x7f5c4c102ef0 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c532c0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c111220 con 0x7f5c4c100e20 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 0x7f5c4c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 0x7f5c4c197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57690/0 (socket says 172.21.15.1:57690) 2024-09-19T09:02:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 -- 172.21.15.1:0/4160309706 learned_addr learned my addr 172.21.15.1:0/4160309706 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5185d640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c4c102ef0 0x7f5c4c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5105c640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c4c100e20 0x7f5c4c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 -- 172.21.15.1:0/4160309706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c4c100e20 msgr2=0x7f5c4c197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c4c100e20 0x7f5c4c197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 -- 172.21.15.1:0/4160309706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c4c102ef0 msgr2=0x7f5c4c19bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c4c102ef0 0x7f5c4c19bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 -- 172.21.15.1:0/4160309706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c19c4d0 con 0x7f5c4c102570 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5185d640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c4c102ef0 0x7f5c4c19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.259+0000 7f5c5085b640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 0x7f5c4c197a60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c006010 tx=0x7f5c3c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.260+0000 7f5c427fc640 1 -- 172.21.15.1:0/4160309706 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c03f030 con 0x7f5c4c102570 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.260+0000 7f5c427fc640 1 -- 172.21.15.1:0/4160309706 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c3c005500 con 0x7f5c4c102570 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.260+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c19c760 con 0x7f5c4c102570 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.260+0000 7f5c427fc640 1 -- 172.21.15.1:0/4160309706 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c035070 con 0x7f5c4c102570 2024-09-19T09:02:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.260+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c1a40a0 con 0x7f5c4c102570 2024-09-19T09:02:15.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.261+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4c1021b0 con 0x7f5c4c102570 2024-09-19T09:02:15.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.262+0000 7f5c427fc640 1 -- 172.21.15.1:0/4160309706 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5c3c042030 con 0x7f5c4c102570 2024-09-19T09:02:15.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.263+0000 7f5c427fc640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5c380a3240 0x7f5c380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:15.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.263+0000 7f5c5105c640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5c380a3240 0x7f5c380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:15.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.263+0000 7f5c427fc640 1 -- 172.21.15.1:0/4160309706 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5c3c0f0400 con 0x7f5c4c102570 2024-09-19T09:02:15.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.263+0000 7f5c5105c640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5c380a3240 0x7f5c380a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5c48005fd0 tx=0x7f5c48005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:15.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.266+0000 7f5c427fc640 1 -- 172.21.15.1:0/4160309706 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c3c0bd100 con 0x7f5c4c102570 2024-09-19T09:02:15.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.465+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5c4c106f70 con 0x7f5c380a3240 2024-09-19T09:02:15.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.491+0000 7f5c427fc640 1 -- 172.21.15.1:0/4160309706 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5c4c106f70 con 0x7f5c380a3240 2024-09-19T09:02:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5c380a3240 msgr2=0x7f5c380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5c380a3240 0x7f5c380a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5c48005fd0 tx=0x7f5c48005850 comp rx=0 tx=0).stop 2024-09-19T09:02:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 msgr2=0x7f5c4c197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 0x7f5c4c197a60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c006010 tx=0x7f5c3c004c00 comp rx=0 tx=0).stop 2024-09-19T09:02:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 shutdown_connections 2024-09-19T09:02:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5c4c102ef0 0x7f5c4c19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c4c102570 0x7f5c4c197a60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5c380a3240 0x7f5c380a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 --2- 172.21.15.1:0/4160309706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c4c100e20 0x7f5c4c197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 >> 172.21.15.1:0/4160309706 conn(0x7f5c4c0fc7d0 msgr2=0x7f5c4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 shutdown_connections 2024-09-19T09:02:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:15.493+0000 7f5c532c0640 1 -- 172.21.15.1:0/4160309706 wait complete. 2024-09-19T09:02:15.502 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:02:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:02:15.470+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:02:15.502 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:02:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:02:15.470+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:02:15.502 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:02:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:02:15.470+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:02:15.503 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:02:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:02:15.470+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:02:15.503 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:02:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:02:15.470+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:02:15.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:15 smithi001 ceph-mon[30939]: pgmap v282: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:15.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:15 smithi022 ceph-mon[35107]: pgmap v282: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:16.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:15 smithi064 ceph-mon[35179]: pgmap v282: 97 pgs: 97 active+clean; 580 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:16.114 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T09:02:16.371 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:16.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:16 smithi001 ceph-mon[30939]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 -- 172.21.15.1:0/3163228335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4101de0 msgr2=0x7f40b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/3163228335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4101de0 0x7f40b41021c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009ca0 tx=0x7f40b002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 -- 172.21.15.1:0/3163228335 shutdown_connections 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/3163228335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40b4106f10 0x7f40b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/3163228335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40b4102790 0x7f40b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/3163228335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4101de0 0x7f40b41021c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 -- 172.21.15.1:0/3163228335 >> 172.21.15.1:0/3163228335 conn(0x7f40b40fd8c0 msgr2=0x7f40b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 -- 172.21.15.1:0/3163228335 shutdown_connections 2024-09-19T09:02:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.834+0000 7f40bb2c6640 1 -- 172.21.15.1:0/3163228335 wait complete. 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40bb2c6640 1 Processor -- start 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40bb2c6640 1 -- start start 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40bb2c6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40b4101de0 0x7f40b4198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40bb2c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4102790 0x7f40b4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40bb2c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40b4106f10 0x7f40b419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40bb2c6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4112150 con 0x7f40b4102790 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40bb2c6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4111fd0 con 0x7f40b4106f10 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40bb2c6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f40b41122d0 con 0x7f40b4101de0 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40b8861640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4102790 0x7f40b4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40b8861640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4102790 0x7f40b4198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57722/0 (socket says 172.21.15.1:57722) 2024-09-19T09:02:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40b8861640 1 -- 172.21.15.1:0/2479158953 learned_addr learned my addr 172.21.15.1:0/2479158953 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40b9062640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40b4101de0 0x7f40b4198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.835+0000 7f40b9863640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40b4106f10 0x7f40b419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40b8861640 1 -- 172.21.15.1:0/2479158953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40b4101de0 msgr2=0x7f40b4198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40b8861640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40b4101de0 0x7f40b4198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40b8861640 1 -- 172.21.15.1:0/2479158953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40b4106f10 msgr2=0x7f40b419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40b8861640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40b4106f10 0x7f40b419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40b8861640 1 -- 172.21.15.1:0/2479158953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b419d620 con 0x7f40b4102790 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40b8861640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4102790 0x7f40b4198bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f40a800b4a0 tx=0x7f40a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40a67fc640 1 -- 172.21.15.1:0/2479158953 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8014070 con 0x7f40b4102790 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40a67fc640 1 -- 172.21.15.1:0/2479158953 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40a8010b10 con 0x7f40b4102790 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b419d910 con 0x7f40b4102790 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40a67fc640 1 -- 172.21.15.1:0/2479158953 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8017d60 con 0x7f40b4102790 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.836+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b41a51f0 con 0x7f40b4102790 2024-09-19T09:02:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.837+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b4102240 con 0x7f40b4102790 2024-09-19T09:02:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.838+0000 7f40a67fc640 1 -- 172.21.15.1:0/2479158953 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f40a8017070 con 0x7f40b4102790 2024-09-19T09:02:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.839+0000 7f40a67fc640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f40a00a3350 0x7f40a00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.839+0000 7f40b9062640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f40a00a3350 0x7f40a00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.839+0000 7f40a67fc640 1 -- 172.21.15.1:0/2479158953 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f40a80cec00 con 0x7f40b4102790 2024-09-19T09:02:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.840+0000 7f40b9062640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f40a00a3350 0x7f40a00a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40b0005fe0 tx=0x7f40b0005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:16.844+0000 7f40a67fc640 1 -- 172.21.15.1:0/2479158953 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40a809b260 con 0x7f40b4102790 2024-09-19T09:02:17.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.046+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f40b4062630 con 0x7f40a00a3350 2024-09-19T09:02:17.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.072+0000 7f40a67fc640 1 -- 172.21.15.1:0/2479158953 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f40b4062630 con 0x7f40a00a3350 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.074+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f40a00a3350 msgr2=0x7f40a00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.074+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f40a00a3350 0x7f40a00a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40b0005fe0 tx=0x7f40b0005ef0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.074+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4102790 msgr2=0x7f40b4198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.074+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4102790 0x7f40b4198bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f40a800b4a0 tx=0x7f40a800b960 comp rx=0 tx=0).stop 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.074+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 shutdown_connections 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.074+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40b4106f10 0x7f40b419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.075+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40b4102790 0x7f40b4198bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.075+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f40a00a3350 0x7f40a00a5810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.075+0000 7f40bb2c6640 1 --2- 172.21.15.1:0/2479158953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40b4101de0 0x7f40b4198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.075+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 >> 172.21.15.1:0/2479158953 conn(0x7f40b40fd8c0 msgr2=0x7f40b40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:17.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.075+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 shutdown_connections 2024-09-19T09:02:17.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:17.075+0000 7f40bb2c6640 1 -- 172.21.15.1:0/2479158953 wait complete. 2024-09-19T09:02:17.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:16 smithi064 ceph-mon[35179]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:17.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:16 smithi022 ceph-mon[35107]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:17.763 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:17 smithi001 ceph-mon[30939]: pgmap v283: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:17.764 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:17 smithi001 ceph-mon[30939]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:02:17.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T09:02:18.023 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:18.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:17 smithi064 ceph-mon[35179]: pgmap v283: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:17 smithi064 ceph-mon[35179]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:02:18.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:17 smithi022 ceph-mon[35107]: pgmap v283: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:18.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:17 smithi022 ceph-mon[35107]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:02:18.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 -- 172.21.15.1:0/314655141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec1036e0 msgr2=0x7faaec107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 --2- 172.21.15.1:0/314655141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec1036e0 0x7faaec107b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faad4009930 tx=0x7faad402a420 comp rx=0 tx=0).stop 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 -- 172.21.15.1:0/314655141 shutdown_connections 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 --2- 172.21.15.1:0/314655141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaec1082a0 0x7faaec10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 --2- 172.21.15.1:0/314655141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec1036e0 0x7faaec107b90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 --2- 172.21.15.1:0/314655141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec102d30 0x7faaec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 -- 172.21.15.1:0/314655141 >> 172.21.15.1:0/314655141 conn(0x7faaec0fc7d0 msgr2=0x7faaec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 -- 172.21.15.1:0/314655141 shutdown_connections 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.475+0000 7faaf160c640 1 -- 172.21.15.1:0/314655141 wait complete. 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.476+0000 7faaf160c640 1 Processor -- start 2024-09-19T09:02:18.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.476+0000 7faaf160c640 1 -- start start 2024-09-19T09:02:18.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.476+0000 7faaf160c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102d30 0x7faaec1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.476+0000 7faaf160c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec1036e0 0x7faaec198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.476+0000 7faaf160c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaec1082a0 0x7faaec19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.476+0000 7faaf160c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faaec1121c0 con 0x7faaec102d30 2024-09-19T09:02:18.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.476+0000 7faaf160c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faaec112040 con 0x7faaec1082a0 2024-09-19T09:02:18.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.476+0000 7faaf160c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faaec112340 con 0x7faaec1036e0 2024-09-19T09:02:18.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102d30 0x7faaec1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102d30 0x7faaec1986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57742/0 (socket says 172.21.15.1:57742) 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 -- 172.21.15.1:0/1373477687 learned_addr learned my addr 172.21.15.1:0/1373477687 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faae27fc640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec1036e0 0x7faaec198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeb7fe640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaec1082a0 0x7faaec19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 -- 172.21.15.1:0/1373477687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec1036e0 msgr2=0x7faaec198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec1036e0 0x7faaec198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 -- 172.21.15.1:0/1373477687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaec1082a0 msgr2=0x7faaec19cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaec1082a0 0x7faaec19cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 -- 172.21.15.1:0/1373477687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec19d690 con 0x7faaec102d30 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faae27fc640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec1036e0 0x7faaec198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaeaffd640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102d30 0x7faaec1986e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faadc00d770 tx=0x7faadc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faae8ff9640 1 -- 172.21.15.1:0/1373477687 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc017070 con 0x7faaec102d30 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faae8ff9640 1 -- 172.21.15.1:0/1373477687 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faadc005520 con 0x7faaec102d30 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec19d980 con 0x7faaec102d30 2024-09-19T09:02:18.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faae8ff9640 1 -- 172.21.15.1:0/1373477687 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc010460 con 0x7faaec102d30 2024-09-19T09:02:18.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.477+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec1a5260 con 0x7faaec102d30 2024-09-19T09:02:18.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.478+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec06a850 con 0x7faaec102d30 2024-09-19T09:02:18.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.479+0000 7faae8ff9640 1 -- 172.21.15.1:0/1373477687 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7faadc004ea0 con 0x7faaec102d30 2024-09-19T09:02:18.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.480+0000 7faae8ff9640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faad80a3350 0x7faad80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:18.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.480+0000 7faae27fc640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faad80a3350 0x7faad80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:18.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.480+0000 7faae8ff9640 1 -- 172.21.15.1:0/1373477687 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7faadc0cf5e0 con 0x7faaec102d30 2024-09-19T09:02:18.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.481+0000 7faae27fc640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faad80a3350 0x7faad80a5810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faad4009900 tx=0x7faad4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:18.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.484+0000 7faae8ff9640 1 -- 172.21.15.1:0/1373477687 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faadc09c180 con 0x7faaec102d30 2024-09-19T09:02:18.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.687+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7faaec062630 con 0x7faad80a3350 2024-09-19T09:02:18.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.693+0000 7faae8ff9640 1 -- 172.21.15.1:0/1373477687 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7faaec062630 con 0x7faad80a3350 2024-09-19T09:02:18.693 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_0/123c55d8-4686-4261-867c-d5295c0f6f86 2024-09-19T09:02:18.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faad80a3350 msgr2=0x7faad80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faad80a3350 0x7faad80a5810 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faad4009900 tx=0x7faad4005a20 comp rx=0 tx=0).stop 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102d30 msgr2=0x7faaec1986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102d30 0x7faaec1986e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faadc00d770 tx=0x7faadc00dc30 comp rx=0 tx=0).stop 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 shutdown_connections 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaec1082a0 0x7faaec19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7faad80a3350 0x7faad80a5810 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faaec1036e0 0x7faaec198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 --2- 172.21.15.1:0/1373477687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102d30 0x7faaec1986e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 >> 172.21.15.1:0/1373477687 conn(0x7faaec0fc7d0 msgr2=0x7faaec105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 shutdown_connections 2024-09-19T09:02:18.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:18.695+0000 7faaf160c640 1 -- 172.21.15.1:0/1373477687 wait complete. 2024-09-19T09:02:18.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:18 smithi001 ceph-mon[30939]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:19.007 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:18 smithi064 ceph-mon[35179]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:19.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:18 smithi022 ceph-mon[35107]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:19.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T09:02:19.603 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:19.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:19 smithi001 ceph-mon[30939]: pgmap v284: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:19.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:19 smithi001 ceph-mon[30939]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:20.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 -- 172.21.15.1:0/2015513167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854100a80 msgr2=0x7f7854100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 --2- 172.21.15.1:0/2015513167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854100a80 0x7f7854100ee0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f783c009930 tx=0x7f783c02a420 comp rx=0 tx=0).stop 2024-09-19T09:02:20.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 -- 172.21.15.1:0/2015513167 shutdown_connections 2024-09-19T09:02:20.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 --2- 172.21.15.1:0/2015513167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7854101420 0x7f785410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 --2- 172.21.15.1:0/2015513167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854100a80 0x7f7854100ee0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 --2- 172.21.15.1:0/2015513167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7854106a80 0x7f7854106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 -- 172.21.15.1:0/2015513167 >> 172.21.15.1:0/2015513167 conn(0x7f78540fc7a0 msgr2=0x7f78540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 -- 172.21.15.1:0/2015513167 shutdown_connections 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.065+0000 7f785a2d1640 1 -- 172.21.15.1:0/2015513167 wait complete. 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f785a2d1640 1 Processor -- start 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f785a2d1640 1 -- start start 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f785a2d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7854100a80 0x7f78541079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f785a2d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854101420 0x7f7854107f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f785a2d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7854106a80 0x7f7854108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f785a2d1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7854110fa0 con 0x7f7854101420 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f785a2d1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7854110e20 con 0x7f7854100a80 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f785a2d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7854111120 con 0x7f7854106a80 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f784bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854101420 0x7f7854107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:20.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f784bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854101420 0x7f7854107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57764/0 (socket says 172.21.15.1:57764) 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.066+0000 7f784bfff640 1 -- 172.21.15.1:0/1396142600 learned_addr learned my addr 172.21.15.1:0/1396142600 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f785886e640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7854106a80 0x7f7854108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f7853fff640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7854100a80 0x7f78541079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f784bfff640 1 -- 172.21.15.1:0/1396142600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7854106a80 msgr2=0x7f7854108470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f784bfff640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7854106a80 0x7f7854108470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f784bfff640 1 -- 172.21.15.1:0/1396142600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7854100a80 msgr2=0x7f78541079f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f784bfff640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7854100a80 0x7f78541079f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f784bfff640 1 -- 172.21.15.1:0/1396142600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78541a6990 con 0x7f7854101420 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f785886e640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7854106a80 0x7f7854108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f784bfff640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854101420 0x7f7854107f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f783c009230 tx=0x7f783c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f7851ffb640 1 -- 172.21.15.1:0/1396142600 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c03f030 con 0x7f7854101420 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f7851ffb640 1 -- 172.21.15.1:0/1396142600 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f783c003af0 con 0x7f7854101420 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f7851ffb640 1 -- 172.21.15.1:0/1396142600 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c035070 con 0x7f7854101420 2024-09-19T09:02:20.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78541a6c20 con 0x7f7854101420 2024-09-19T09:02:20.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.067+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78541a7100 con 0x7f7854101420 2024-09-19T09:02:20.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.068+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7854106e60 con 0x7f7854101420 2024-09-19T09:02:20.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.069+0000 7f7851ffb640 1 -- 172.21.15.1:0/1396142600 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f783c042030 con 0x7f7854101420 2024-09-19T09:02:20.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.070+0000 7f7851ffb640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f78400a32d0 0x7f78400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:20.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.070+0000 7f7853fff640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f78400a32d0 0x7f78400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:20.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.070+0000 7f7851ffb640 1 -- 172.21.15.1:0/1396142600 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f783c0f0340 con 0x7f7854101420 2024-09-19T09:02:20.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.071+0000 7f7853fff640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f78400a32d0 0x7f78400a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7844005fd0 tx=0x7f7844005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:20.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.074+0000 7f7851ffb640 1 -- 172.21.15.1:0/1396142600 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f783c0bcfa0 con 0x7f7854101420 2024-09-19T09:02:20.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:19 smithi064 ceph-mon[35179]: pgmap v284: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:20.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:19 smithi064 ceph-mon[35179]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:20.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:19 smithi022 ceph-mon[35107]: pgmap v284: 97 pgs: 97 active+clean; 582 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:20.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:19 smithi022 ceph-mon[35107]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:20.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.277+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7854104ca0 con 0x7f78400a32d0 2024-09-19T09:02:20.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.300+0000 7f7851ffb640 1 -- 172.21.15.1:0/1396142600 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7854104ca0 con 0x7f78400a32d0 2024-09-19T09:02:20.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f78400a32d0 msgr2=0x7f78400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f78400a32d0 0x7f78400a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7844005fd0 tx=0x7f7844005850 comp rx=0 tx=0).stop 2024-09-19T09:02:20.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854101420 msgr2=0x7f7854107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:20.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854101420 0x7f7854107f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f783c009230 tx=0x7f783c004270 comp rx=0 tx=0).stop 2024-09-19T09:02:20.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 shutdown_connections 2024-09-19T09:02:20.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f78400a32d0 0x7f78400a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7854106a80 0x7f7854108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7854101420 0x7f7854107f30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 --2- 172.21.15.1:0/1396142600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7854100a80 0x7f78541079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:20.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 >> 172.21.15.1:0/1396142600 conn(0x7f78540fc7a0 msgr2=0x7f7854104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:20.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 shutdown_connections 2024-09-19T09:02:20.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:20.303+0000 7f785a2d1640 1 -- 172.21.15.1:0/1396142600 wait complete. 2024-09-19T09:02:20.987 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T09:02:21.242 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 -- 172.21.15.1:0/1845520365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 msgr2=0x7f036010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 --2- 172.21.15.1:0/1845520365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 0x7f036010ea90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0358009ca0 tx=0x7f035802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 -- 172.21.15.1:0/1845520365 shutdown_connections 2024-09-19T09:02:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 --2- 172.21.15.1:0/1845520365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 0x7f036010ea90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 --2- 172.21.15.1:0/1845520365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360102790 0x7f03601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 --2- 172.21.15.1:0/1845520365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0360101de0 0x7f03601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 -- 172.21.15.1:0/1845520365 >> 172.21.15.1:0/1845520365 conn(0x7f03600fd8c0 msgr2=0x7f03600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 -- 172.21.15.1:0/1845520365 shutdown_connections 2024-09-19T09:02:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.758+0000 7f0367da5640 1 -- 172.21.15.1:0/1845520365 wait complete. 2024-09-19T09:02:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0367da5640 1 Processor -- start 2024-09-19T09:02:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0367da5640 1 -- start start 2024-09-19T09:02:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0367da5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0360101de0 0x7f0360198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0367da5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360102790 0x7f0360198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0367da5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 0x7f036019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0367da5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f03601120d0 con 0x7f0360106f10 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0367da5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0360111f50 con 0x7f0360101de0 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0367da5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0360112250 con 0x7f0360102790 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 0x7f036019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 0x7f036019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57784/0 (socket says 172.21.15.1:57784) 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 -- 172.21.15.1:0/3654290845 learned_addr learned my addr 172.21.15.1:0/3654290845 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0365b41640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0360101de0 0x7f0360198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0365340640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360102790 0x7f0360198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 -- 172.21.15.1:0/3654290845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360102790 msgr2=0x7f0360198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360102790 0x7f0360198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 -- 172.21.15.1:0/3654290845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0360101de0 msgr2=0x7f0360198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0360101de0 0x7f0360198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 -- 172.21.15.1:0/3654290845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036019d500 con 0x7f0360106f10 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.759+0000 7f0366342640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 0x7f036019ce20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0358006010 tx=0x7f03580319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.760+0000 7f0356ffd640 1 -- 172.21.15.1:0/3654290845 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035802fa20 con 0x7f0360106f10 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.760+0000 7f0356ffd640 1 -- 172.21.15.1:0/3654290845 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f035802fbc0 con 0x7f0360106f10 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.760+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036019d790 con 0x7f0360106f10 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.760+0000 7f0356ffd640 1 -- 172.21.15.1:0/3654290845 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358046860 con 0x7f0360106f10 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.760+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03601a50d0 con 0x7f0360106f10 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.761+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03601021c0 con 0x7f0360106f10 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.762+0000 7f0356ffd640 1 -- 172.21.15.1:0/3654290845 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f035802fd70 con 0x7f0360106f10 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.763+0000 7f0356ffd640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a32d0 0x7f034c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.763+0000 7f0365b41640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a32d0 0x7f034c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.763+0000 7f0356ffd640 1 -- 172.21.15.1:0/3654290845 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f03580f1470 con 0x7f0360106f10 2024-09-19T09:02:21.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.763+0000 7f0365b41640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a32d0 0x7f034c0a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f035c00bbe0 tx=0x7f035c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:21.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.766+0000 7f0356ffd640 1 -- 172.21.15.1:0/3654290845 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03580be1b0 con 0x7f0360106f10 2024-09-19T09:02:21.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.969+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f036010a160 con 0x7f034c0a32d0 2024-09-19T09:02:21.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:21 smithi001 ceph-mon[30939]: pgmap v285: 97 pgs: 97 active+clean; 606 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.5 KiB/s wr, 16 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:21.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:21 smithi001 ceph-mon[30939]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:21.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.973+0000 7f0356ffd640 1 -- 172.21.15.1:0/3654290845 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f035c010c30 con 0x7f034c0a32d0 2024-09-19T09:02:21.973 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_1/08242d8f-c833-411d-9ab8-a26d685647dd 2024-09-19T09:02:21.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a32d0 msgr2=0x7f034c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a32d0 0x7f034c0a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f035c00bbe0 tx=0x7f035c00b390 comp rx=0 tx=0).stop 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 msgr2=0x7f036019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 0x7f036019ce20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0358006010 tx=0x7f03580319f0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 shutdown_connections 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0360106f10 0x7f036019ce20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a32d0 0x7f034c0a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360102790 0x7f0360198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 --2- 172.21.15.1:0/3654290845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0360101de0 0x7f0360198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.975+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 >> 172.21.15.1:0/3654290845 conn(0x7f03600fd8c0 msgr2=0x7f03600fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.976+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 shutdown_connections 2024-09-19T09:02:21.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:21.976+0000 7f0367da5640 1 -- 172.21.15.1:0/3654290845 wait complete. 2024-09-19T09:02:22.011 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:21 smithi022 ceph-mon[35107]: pgmap v285: 97 pgs: 97 active+clean; 606 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.5 KiB/s wr, 16 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:22.011 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:21 smithi022 ceph-mon[35107]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:22.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:21 smithi064 ceph-mon[35179]: pgmap v285: 97 pgs: 97 active+clean; 606 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.5 KiB/s wr, 16 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:02:22.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:21 smithi064 ceph-mon[35179]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:22.624 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.315+0000 7f2cd0e78640 1 -- 172.21.15.1:0/2570045659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc106f10 msgr2=0x7f2ccc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.315+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/2570045659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc106f10 0x7f2ccc10ea90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009ca0 tx=0x7f2cc402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.315+0000 7f2cd0e78640 1 -- 172.21.15.1:0/2570045659 shutdown_connections 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.315+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/2570045659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc106f10 0x7f2ccc10ea90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.315+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/2570045659 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ccc102790 0x7f2ccc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.315+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/2570045659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc101de0 0x7f2ccc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.315+0000 7f2cd0e78640 1 -- 172.21.15.1:0/2570045659 >> 172.21.15.1:0/2570045659 conn(0x7f2ccc0fd8c0 msgr2=0x7f2ccc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.316+0000 7f2cd0e78640 1 -- 172.21.15.1:0/2570045659 shutdown_connections 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.316+0000 7f2cd0e78640 1 -- 172.21.15.1:0/2570045659 wait complete. 2024-09-19T09:02:23.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.316+0000 7f2cd0e78640 1 Processor -- start 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.316+0000 7f2cd0e78640 1 -- start start 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.316+0000 7f2cd0e78640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc101de0 0x7f2ccc1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.316+0000 7f2cd0e78640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ccc102790 0x7f2ccc1a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cd0e78640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc106f10 0x7f2ccc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cd0e78640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc1120d0 con 0x7f2ccc101de0 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cd0e78640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc111f50 con 0x7f2ccc106f10 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cd0e78640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc112250 con 0x7f2ccc102790 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc101de0 0x7f2ccc1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc101de0 0x7f2ccc1a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43814/0 (socket says 172.21.15.1:43814) 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 -- 172.21.15.1:0/1950190650 learned_addr learned my addr 172.21.15.1:0/1950190650 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2ccad9d640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc106f10 0x7f2ccc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cc9d9b640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ccc102790 0x7f2ccc1a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 -- 172.21.15.1:0/1950190650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ccc102790 msgr2=0x7f2ccc1a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ccc102790 0x7f2ccc1a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 -- 172.21.15.1:0/1950190650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc106f10 msgr2=0x7f2ccc19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc106f10 0x7f2ccc19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 -- 172.21.15.1:0/1950190650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc19ad20 con 0x7f2ccc101de0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cca59c640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc101de0 0x7f2ccc1a0430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00d950 tx=0x7f2cbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cbb7fe640 1 -- 172.21.15.1:0/1950190650 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc017030 con 0x7f2ccc101de0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ccc19b010 con 0x7f2ccc101de0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cbb7fe640 1 -- 172.21.15.1:0/1950190650 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2cbc004020 con 0x7f2ccc101de0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cbb7fe640 1 -- 172.21.15.1:0/1950190650 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc004a00 con 0x7f2ccc101de0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.317+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ccc1a7300 con 0x7f2ccc101de0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.318+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ccc1021c0 con 0x7f2ccc101de0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.319+0000 7f2cbb7fe640 1 -- 172.21.15.1:0/1950190650 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2cbc0041d0 con 0x7f2ccc101de0 2024-09-19T09:02:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.320+0000 7f2cbb7fe640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2cb40a32d0 0x7f2cb40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.320+0000 7f2cc9d9b640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2cb40a32d0 0x7f2cb40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.320+0000 7f2cbb7fe640 1 -- 172.21.15.1:0/1950190650 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2cbc0cf4e0 con 0x7f2ccc101de0 2024-09-19T09:02:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.321+0000 7f2cc9d9b640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2cb40a32d0 0x7f2cb40a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc076480 tx=0x7f2cc0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.324+0000 7f2cbb7fe640 1 -- 172.21.15.1:0/1950190650 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2cbc09c080 con 0x7f2ccc101de0 2024-09-19T09:02:23.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.539+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ccc1a75f0 con 0x7f2ccc101de0 2024-09-19T09:02:23.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.539+0000 7f2cbb7fe640 1 -- 172.21.15.1:0/1950190650 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11878 (secure 0 0 0) 0x7f2cbc09b980 con 0x7f2ccc101de0 2024-09-19T09:02:23.540 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:23.540 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"btime":"2024-09-19T09:02:13:694219+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:02:13.157593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:02:23.540 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2cb40a32d0 msgr2=0x7f2cb40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2cb40a32d0 0x7f2cb40a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc076480 tx=0x7f2cc0008040 comp rx=0 tx=0).stop 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc101de0 msgr2=0x7f2ccc1a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc101de0 0x7f2ccc1a0430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00d950 tx=0x7f2cbc00de10 comp rx=0 tx=0).stop 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 shutdown_connections 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ccc106f10 0x7f2ccc19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2cb40a32d0 0x7f2cb40a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ccc102790 0x7f2ccc1a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 --2- 172.21.15.1:0/1950190650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ccc101de0 0x7f2ccc1a0430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 >> 172.21.15.1:0/1950190650 conn(0x7f2ccc0fd8c0 msgr2=0x7f2ccc0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 shutdown_connections 2024-09-19T09:02:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:23.542+0000 7f2cd0e78640 1 -- 172.21.15.1:0/1950190650 wait complete. 2024-09-19T09:02:24.036 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:23 smithi001 ceph-mon[30939]: pgmap v286: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.1 KiB/s wr, 15 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:02:24.036 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:23 smithi001 ceph-mon[30939]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:24.036 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:23 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1950190650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:24.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:23 smithi064 ceph-mon[35179]: pgmap v286: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.1 KiB/s wr, 15 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:02:24.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:23 smithi064 ceph-mon[35179]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:24.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:23 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1950190650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:24.136 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:02:24.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:23 smithi022 ceph-mon[35107]: pgmap v286: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.1 KiB/s wr, 15 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:02:24.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:23 smithi022 ceph-mon[35107]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:02:24.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:23 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1950190650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:24.393 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:24.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.798+0000 7f7d57d01640 1 -- 172.21.15.1:0/3193781194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50101df0 msgr2=0x7f7d501021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.798+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3193781194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50101df0 0x7f7d501021d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009900 tx=0x7f7d4c02a410 comp rx=0 tx=0).stop 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.798+0000 7f7d57d01640 1 -- 172.21.15.1:0/3193781194 shutdown_connections 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.798+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3193781194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d50106f20 0x7f7d5010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.798+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3193781194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d501027a0 0x7f7d501067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.798+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3193781194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50101df0 0x7f7d501021d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.798+0000 7f7d57d01640 1 -- 172.21.15.1:0/3193781194 >> 172.21.15.1:0/3193781194 conn(0x7f7d500fd8f0 msgr2=0x7f7d500ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 -- 172.21.15.1:0/3193781194 shutdown_connections 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 -- 172.21.15.1:0/3193781194 wait complete. 2024-09-19T09:02:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 Processor -- start 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 -- start start 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d50101df0 0x7f7d5019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d501027a0 0x7f7d5019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50106f20 0x7f7d5019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7d50075870 con 0x7f7d50106f20 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500756f0 con 0x7f7d50101df0 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.799+0000 7f7d57d01640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d500759f0 con 0x7f7d501027a0 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50106f20 0x7f7d5019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50106f20 0x7f7d5019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43834/0 (socket says 172.21.15.1:43834) 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 -- 172.21.15.1:0/3867938849 learned_addr learned my addr 172.21.15.1:0/3867938849 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d55a9d640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d50101df0 0x7f7d5019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5529c640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d501027a0 0x7f7d5019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 -- 172.21.15.1:0/3867938849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d501027a0 msgr2=0x7f7d5019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d501027a0 0x7f7d5019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 -- 172.21.15.1:0/3867938849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d50101df0 msgr2=0x7f7d5019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d50101df0 0x7f7d5019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 -- 172.21.15.1:0/3867938849 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5019f6b0 con 0x7f7d50106f20 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d5629e640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50106f20 0x7f7d5019efd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800cad0 tx=0x7f7d4800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d46ffd640 1 -- 172.21.15.1:0/3867938849 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800ad60 con 0x7f7d50106f20 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5019f9a0 con 0x7f7d50106f20 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d46ffd640 1 -- 172.21.15.1:0/3867938849 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d48004b20 con 0x7f7d50106f20 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d46ffd640 1 -- 172.21.15.1:0/3867938849 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800f6f0 con 0x7f7d50106f20 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.800+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d501a7280 con 0x7f7d50106f20 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.801+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d501021d0 con 0x7f7d50106f20 2024-09-19T09:02:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.802+0000 7f7d46ffd640 1 -- 172.21.15.1:0/3867938849 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7d48004cd0 con 0x7f7d50106f20 2024-09-19T09:02:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.803+0000 7f7d46ffd640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.803+0000 7f7d55a9d640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.804+0000 7f7d46ffd640 1 -- 172.21.15.1:0/3867938849 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f7d480cfd00 con 0x7f7d50106f20 2024-09-19T09:02:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.804+0000 7f7d55a9d640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009230 tx=0x7f7d4c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.808+0000 7f7d46ffd640 1 -- 172.21.15.1:0/3867938849 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d48014030 con 0x7f7d50106f20 2024-09-19T09:02:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.985+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d501a7450 con 0x7f7d50106f20 2024-09-19T09:02:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.986+0000 7f7d46ffd640 1 -- 172.21.15.1:0/3867938849 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7f7d4809c8a0 con 0x7f7d50106f20 2024-09-19T09:02:24.987 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:24.987 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7d3c0a32d0 msgr2=0x7f7d3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009230 tx=0x7f7d4c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50106f20 msgr2=0x7f7d5019efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50106f20 0x7f7d5019efd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800cad0 tx=0x7f7d4800ced0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 shutdown_connections 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d50106f20 0x7f7d5019efd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7d3c0a32d0 0x7f7d3c0a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d501027a0 0x7f7d5019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 --2- 172.21.15.1:0/3867938849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d50101df0 0x7f7d5019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.988+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 >> 172.21.15.1:0/3867938849 conn(0x7f7d500fd8f0 msgr2=0x7f7d500fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:24.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.989+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 shutdown_connections 2024-09-19T09:02:24.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:24.989+0000 7f7d57d01640 1 -- 172.21.15.1:0/3867938849 wait complete. 2024-09-19T09:02:25.722 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:02:25.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:02:25.983 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:26.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:25 smithi001 ceph-mon[30939]: pgmap v287: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.4 KiB/s wr, 13 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:02:26.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:25 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3867938849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:26.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:25 smithi064 ceph-mon[35179]: pgmap v287: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.4 KiB/s wr, 13 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:02:26.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:25 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3867938849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:26.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:25 smithi022 ceph-mon[35107]: pgmap v287: 97 pgs: 97 active+clean; 607 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.4 KiB/s wr, 13 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:02:26.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:25 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3867938849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:26.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 -- 172.21.15.1:0/2002477040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d41019d0 msgr2=0x7fe9d4101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 --2- 172.21.15.1:0/2002477040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d41019d0 0x7fe9d4101e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009930 tx=0x7fe9c802a420 comp rx=0 tx=0).stop 2024-09-19T09:02:26.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 -- 172.21.15.1:0/2002477040 shutdown_connections 2024-09-19T09:02:26.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 --2- 172.21.15.1:0/2002477040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d4102370 0x7fe9d410e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 --2- 172.21.15.1:0/2002477040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d41019d0 0x7fe9d4101e30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 --2- 172.21.15.1:0/2002477040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d41079d0 0x7fe9d4107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 -- 172.21.15.1:0/2002477040 >> 172.21.15.1:0/2002477040 conn(0x7fe9d40fd710 msgr2=0x7fe9d40ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 -- 172.21.15.1:0/2002477040 shutdown_connections 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 -- 172.21.15.1:0/2002477040 wait complete. 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.425+0000 7fe9d899f640 1 Processor -- start 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d899f640 1 -- start start 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d899f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d41019d0 0x7fe9d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d899f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d4102370 0x7fe9d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d899f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d41079d0 0x7fe9d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d899f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4111ef0 con 0x7fe9d4102370 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d899f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4111d70 con 0x7fe9d41079d0 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d899f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4112070 con 0x7fe9d41019d0 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d4102370 0x7fe9d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d4102370 0x7fe9d4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43862/0 (socket says 172.21.15.1:43862) 2024-09-19T09:02:26.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d2ffd640 1 -- 172.21.15.1:0/995840797 learned_addr learned my addr 172.21.15.1:0/995840797 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d37fe640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d41019d0 0x7fe9d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d3fff640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d41079d0 0x7fe9d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d2ffd640 1 -- 172.21.15.1:0/995840797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d41019d0 msgr2=0x7fe9d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d2ffd640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d41019d0 0x7fe9d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d2ffd640 1 -- 172.21.15.1:0/995840797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d41079d0 msgr2=0x7fe9d4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d2ffd640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d41079d0 0x7fe9d4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.426+0000 7fe9d2ffd640 1 -- 172.21.15.1:0/995840797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d41a6890 con 0x7fe9d4102370 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.427+0000 7fe9d2ffd640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d4102370 0x7fe9d4074a30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009230 tx=0x7fe9c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.427+0000 7fe9d0ff9640 1 -- 172.21.15.1:0/995840797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c803f030 con 0x7fe9d4102370 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.427+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d41a6b20 con 0x7fe9d4102370 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.427+0000 7fe9d0ff9640 1 -- 172.21.15.1:0/995840797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe9c8003af0 con 0x7fe9d4102370 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.427+0000 7fe9d0ff9640 1 -- 172.21.15.1:0/995840797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8035070 con 0x7fe9d4102370 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.427+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d41a7050 con 0x7fe9d4102370 2024-09-19T09:02:26.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.428+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d4101e30 con 0x7fe9d4102370 2024-09-19T09:02:26.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.429+0000 7fe9d0ff9640 1 -- 172.21.15.1:0/995840797 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe9c8042030 con 0x7fe9d4102370 2024-09-19T09:02:26.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.430+0000 7fe9d0ff9640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9bc0a32d0 0x7fe9bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:26.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.430+0000 7fe9d37fe640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9bc0a32d0 0x7fe9bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:26.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.430+0000 7fe9d0ff9640 1 -- 172.21.15.1:0/995840797 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe9c80f0710 con 0x7fe9d4102370 2024-09-19T09:02:26.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.430+0000 7fe9d37fe640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9bc0a32d0 0x7fe9bc0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4005e00 tx=0x7fe9c4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:26.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.433+0000 7fe9d0ff9640 1 -- 172.21.15.1:0/995840797 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9c80bd2b0 con 0x7fe9d4102370 2024-09-19T09:02:26.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.612+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9d4062630 con 0x7fe9bc0a32d0 2024-09-19T09:02:26.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.619+0000 7fe9d0ff9640 1 -- 172.21.15.1:0/995840797 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258721 (secure 0 0 0) 0x7fe9d4062630 con 0x7fe9bc0a32d0 2024-09-19T09:02:26.622 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:26.624 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:02:26.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9bc0a32d0 msgr2=0x7fe9bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9bc0a32d0 0x7fe9bc0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4005e00 tx=0x7fe9c4005c50 comp rx=0 tx=0).stop 2024-09-19T09:02:26.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d4102370 msgr2=0x7fe9d4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d4102370 0x7fe9d4074a30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009230 tx=0x7fe9c8004270 comp rx=0 tx=0).stop 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 shutdown_connections 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9d41079d0 0x7fe9d4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9d4102370 0x7fe9d4074a30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9bc0a32d0 0x7fe9bc0a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 --2- 172.21.15.1:0/995840797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9d41019d0 0x7fe9d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 >> 172.21.15.1:0/995840797 conn(0x7fe9d40fd710 msgr2=0x7fe9d40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.622+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 shutdown_connections 2024-09-19T09:02:26.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:26.623+0000 7fe9d899f640 1 -- 172.21.15.1:0/995840797 wait complete. 2024-09-19T09:02:27.310 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-19T09:02:25.943047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644208,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":230,"num_read_kb":218,"num_write":335,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390744,"kb_used_data":12360,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551080,"statfs":{"total":1151940427776,"available":1151540305920,"internally_reserved":0,"allocated":12656640,"data_stored":7052304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49912,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":95,"num_read_kb":100,"num_write":62,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003124"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684751+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:02:11.684751+0000","last_peered":"2024-09-19T09:02:11.684751+0000","last_clean":"2024-09-19T09:02:11.684751+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:02:11.684751+0000","last_undegraded":"2024-09-19T09:02:11.684751+0000","last_fullsized":"2024-09-19T09:02:11.684751+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685274+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:02:11.685274+0000","last_peered":"2024-09-19T09:02:11.685274+0000","last_clean":"2024-09-19T09:02:11.685274+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:02:11.685274+0000","last_undegraded":"2024-09-19T09:02:11.685274+0000","last_fullsized":"2024-09-19T09:02:11.685274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685391+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:02:11.685391+0000","last_peered":"2024-09-19T09:02:11.685391+0000","last_clean":"2024-09-19T09:02:11.685391+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:02:11.685391+0000","last_undegraded":"2024-09-19T09:02:11.685391+0000","last_fullsized":"2024-09-19T09:02:11.685391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697115+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:02:11.697115+0000","last_peered":"2024-09-19T09:02:11.697115+0000","last_clean":"2024-09-19T09:02:11.697115+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:02:11.697115+0000","last_undegraded":"2024-09-19T09:02:11.697115+0000","last_fullsized":"2024-09-19T09:02:11.697115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687096+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:02:11.687096+0000","last_peered":"2024-09-19T09:02:11.687096+0000","last_clean":"2024-09-19T09:02:11.687096+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:02:11.687096+0000","last_undegraded":"2024-09-19T09:02:11.687096+0000","last_fullsized":"2024-09-19T09:02:11.687096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683669+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:02:11.683669+0000","last_peered":"2024-09-19T09:02:11.683669+0000","last_clean":"2024-09-19T09:02:11.683669+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:02:11.683669+0000","last_undegraded":"2024-09-19T09:02:11.683669+0000","last_fullsized":"2024-09-19T09:02:11.683669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.722501+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:02:11.722501+0000","last_peered":"2024-09-19T09:02:11.722501+0000","last_clean":"2024-09-19T09:02:11.722501+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:02:11.722501+0000","last_undegraded":"2024-09-19T09:02:11.722501+0000","last_fullsized":"2024-09-19T09:02:11.722501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682881+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:02:11.682881+0000","last_peered":"2024-09-19T09:02:11.682881+0000","last_clean":"2024-09-19T09:02:11.682881+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:02:11.682881+0000","last_undegraded":"2024-09-19T09:02:11.682881+0000","last_fullsized":"2024-09-19T09:02:11.682881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.690180+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:02:11.690180+0000","last_peered":"2024-09-19T09:02:11.690180+0000","last_clean":"2024-09-19T09:02:11.690180+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:02:11.690180+0000","last_undegraded":"2024-09-19T09:02:11.690180+0000","last_fullsized":"2024-09-19T09:02:11.690180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684237+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:02:11.684237+0000","last_peered":"2024-09-19T09:02:11.684237+0000","last_clean":"2024-09-19T09:02:11.684237+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:02:11.684237+0000","last_undegraded":"2024-09-19T09:02:11.684237+0000","last_fullsized":"2024-09-19T09:02:11.684237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688749+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:02:11.688749+0000","last_peered":"2024-09-19T09:02:11.688749+0000","last_clean":"2024-09-19T09:02:11.688749+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:02:11.688749+0000","last_undegraded":"2024-09-19T09:02:11.688749+0000","last_fullsized":"2024-09-19T09:02:11.688749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697164+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:02:11.697164+0000","last_peered":"2024-09-19T09:02:11.697164+0000","last_clean":"2024-09-19T09:02:11.697164+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:02:11.697164+0000","last_undegraded":"2024-09-19T09:02:11.697164+0000","last_fullsized":"2024-09-19T09:02:11.697164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721263+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:02:11.721263+0000","last_peered":"2024-09-19T09:02:11.721263+0000","last_clean":"2024-09-19T09:02:11.721263+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:02:11.721263+0000","last_undegraded":"2024-09-19T09:02:11.721263+0000","last_fullsized":"2024-09-19T09:02:11.721263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685216+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:02:11.685216+0000","last_peered":"2024-09-19T09:02:11.685216+0000","last_clean":"2024-09-19T09:02:11.685216+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:02:11.685216+0000","last_undegraded":"2024-09-19T09:02:11.685216+0000","last_fullsized":"2024-09-19T09:02:11.685216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684970+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:02:11.684970+0000","last_peered":"2024-09-19T09:02:11.684970+0000","last_clean":"2024-09-19T09:02:11.684970+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:02:11.684970+0000","last_undegraded":"2024-09-19T09:02:11.684970+0000","last_fullsized":"2024-09-19T09:02:11.684970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689295+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:02:11.689295+0000","last_peered":"2024-09-19T09:02:11.689295+0000","last_clean":"2024-09-19T09:02:11.689295+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:02:11.689295+0000","last_undegraded":"2024-09-19T09:02:11.689295+0000","last_fullsized":"2024-09-19T09:02:11.689295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684879+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:02:11.684879+0000","last_peered":"2024-09-19T09:02:11.684879+0000","last_clean":"2024-09-19T09:02:11.684879+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:02:11.684879+0000","last_undegraded":"2024-09-19T09:02:11.684879+0000","last_fullsized":"2024-09-19T09:02:11.684879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685449+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:02:11.685449+0000","last_peered":"2024-09-19T09:02:11.685449+0000","last_clean":"2024-09-19T09:02:11.685449+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:02:11.685449+0000","last_undegraded":"2024-09-19T09:02:11.685449+0000","last_fullsized":"2024-09-19T09:02:11.685449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687074+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:02:11.687074+0000","last_peered":"2024-09-19T09:02:11.687074+0000","last_clean":"2024-09-19T09:02:11.687074+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:02:11.687074+0000","last_undegraded":"2024-09-19T09:02:11.687074+0000","last_fullsized":"2024-09-19T09:02:11.687074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684228+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:02:11.684228+0000","last_peered":"2024-09-19T09:02:11.684228+0000","last_clean":"2024-09-19T09:02:11.684228+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:02:11.684228+0000","last_undegraded":"2024-09-19T09:02:11.684228+0000","last_fullsized":"2024-09-19T09:02:11.684228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721356+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:02:11.721356+0000","last_peered":"2024-09-19T09:02:11.721356+0000","last_clean":"2024-09-19T09:02:11.721356+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:02:11.721356+0000","last_undegraded":"2024-09-19T09:02:11.721356+0000","last_fullsized":"2024-09-19T09:02:11.721356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689612+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:02:11.689612+0000","last_peered":"2024-09-19T09:02:11.689612+0000","last_clean":"2024-09-19T09:02:11.689612+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:02:11.689612+0000","last_undegraded":"2024-09-19T09:02:11.689612+0000","last_fullsized":"2024-09-19T09:02:11.689612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682914+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:02:11.682914+0000","last_peered":"2024-09-19T09:02:11.682914+0000","last_clean":"2024-09-19T09:02:11.682914+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:02:11.682914+0000","last_undegraded":"2024-09-19T09:02:11.682914+0000","last_fullsized":"2024-09-19T09:02:11.682914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685454+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:02:11.685454+0000","last_peered":"2024-09-19T09:02:11.685454+0000","last_clean":"2024-09-19T09:02:11.685454+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:02:11.685454+0000","last_undegraded":"2024-09-19T09:02:11.685454+0000","last_fullsized":"2024-09-19T09:02:11.685454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.698766+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:02:11.698766+0000","last_peered":"2024-09-19T09:02:11.698766+0000","last_clean":"2024-09-19T09:02:11.698766+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:02:11.698766+0000","last_undegraded":"2024-09-19T09:02:11.698766+0000","last_fullsized":"2024-09-19T09:02:11.698766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688189+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:02:11.688189+0000","last_peered":"2024-09-19T09:02:11.688189+0000","last_clean":"2024-09-19T09:02:11.688189+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:02:11.688189+0000","last_undegraded":"2024-09-19T09:02:11.688189+0000","last_fullsized":"2024-09-19T09:02:11.688189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684587+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:02:11.684587+0000","last_peered":"2024-09-19T09:02:11.684587+0000","last_clean":"2024-09-19T09:02:11.684587+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:02:11.684587+0000","last_undegraded":"2024-09-19T09:02:11.684587+0000","last_fullsized":"2024-09-19T09:02:11.684587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721255+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:02:11.721255+0000","last_peered":"2024-09-19T09:02:11.721255+0000","last_clean":"2024-09-19T09:02:11.721255+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:02:11.721255+0000","last_undegraded":"2024-09-19T09:02:11.721255+0000","last_fullsized":"2024-09-19T09:02:11.721255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685196+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:02:11.685196+0000","last_peered":"2024-09-19T09:02:11.685196+0000","last_clean":"2024-09-19T09:02:11.685196+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:02:11.685196+0000","last_undegraded":"2024-09-19T09:02:11.685196+0000","last_fullsized":"2024-09-19T09:02:11.685196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686706+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:02:11.686706+0000","last_peered":"2024-09-19T09:02:11.686706+0000","last_clean":"2024-09-19T09:02:11.686706+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:02:11.686706+0000","last_undegraded":"2024-09-19T09:02:11.686706+0000","last_fullsized":"2024-09-19T09:02:11.686706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686681+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:02:11.686681+0000","last_peered":"2024-09-19T09:02:11.686681+0000","last_clean":"2024-09-19T09:02:11.686681+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:02:11.686681+0000","last_undegraded":"2024-09-19T09:02:11.686681+0000","last_fullsized":"2024-09-19T09:02:11.686681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684044+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:02:11.684044+0000","last_peered":"2024-09-19T09:02:11.684044+0000","last_clean":"2024-09-19T09:02:11.684044+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:02:11.684044+0000","last_undegraded":"2024-09-19T09:02:11.684044+0000","last_fullsized":"2024-09-19T09:02:11.684044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.722540+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:02:11.722540+0000","last_peered":"2024-09-19T09:02:11.722540+0000","last_clean":"2024-09-19T09:02:11.722540+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:02:11.722540+0000","last_undegraded":"2024-09-19T09:02:11.722540+0000","last_fullsized":"2024-09-19T09:02:11.722540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:23.526570+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:02:23.526570+0000","last_peered":"2024-09-19T09:02:23.526570+0000","last_clean":"2024-09-19T09:02:23.526570+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:02:23.526570+0000","last_undegraded":"2024-09-19T09:02:23.526570+0000","last_fullsized":"2024-09-19T09:02:23.526570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.692423+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:02:11.692423+0000","last_peered":"2024-09-19T09:02:11.692423+0000","last_clean":"2024-09-19T09:02:11.692423+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:02:11.692423+0000","last_undegraded":"2024-09-19T09:02:11.692423+0000","last_fullsized":"2024-09-19T09:02:11.692423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682939+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:02:11.682939+0000","last_peered":"2024-09-19T09:02:11.682939+0000","last_clean":"2024-09-19T09:02:11.682939+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:02:11.682939+0000","last_undegraded":"2024-09-19T09:02:11.682939+0000","last_fullsized":"2024-09-19T09:02:11.682939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685621+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:02:11.685621+0000","last_peered":"2024-09-19T09:02:11.685621+0000","last_clean":"2024-09-19T09:02:11.685621+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:02:11.685621+0000","last_undegraded":"2024-09-19T09:02:11.685621+0000","last_fullsized":"2024-09-19T09:02:11.685621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:22.524484+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:02:22.524484+0000","last_peered":"2024-09-19T09:02:22.524484+0000","last_clean":"2024-09-19T09:02:22.524484+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:02:22.524484+0000","last_undegraded":"2024-09-19T09:02:22.524484+0000","last_fullsized":"2024-09-19T09:02:22.524484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689854+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:02:11.689854+0000","last_peered":"2024-09-19T09:02:11.689854+0000","last_clean":"2024-09-19T09:02:11.689854+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:02:11.689854+0000","last_undegraded":"2024-09-19T09:02:11.689854+0000","last_fullsized":"2024-09-19T09:02:11.689854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686110+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:02:11.686110+0000","last_peered":"2024-09-19T09:02:11.686110+0000","last_clean":"2024-09-19T09:02:11.686110+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:02:11.686110+0000","last_undegraded":"2024-09-19T09:02:11.686110+0000","last_fullsized":"2024-09-19T09:02:11.686110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689850+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:02:11.689850+0000","last_peered":"2024-09-19T09:02:11.689850+0000","last_clean":"2024-09-19T09:02:11.689850+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:02:11.689850+0000","last_undegraded":"2024-09-19T09:02:11.689850+0000","last_fullsized":"2024-09-19T09:02:11.689850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'25","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:23.715732+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:02:23.715732+0000","last_peered":"2024-09-19T09:02:23.715732+0000","last_clean":"2024-09-19T09:02:23.715732+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:02:23.715732+0000","last_undegraded":"2024-09-19T09:02:23.715732+0000","last_fullsized":"2024-09-19T09:02:23.715732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":64,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688985+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:02:11.688985+0000","last_peered":"2024-09-19T09:02:11.688985+0000","last_clean":"2024-09-19T09:02:11.688985+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:02:11.688985+0000","last_undegraded":"2024-09-19T09:02:11.688985+0000","last_fullsized":"2024-09-19T09:02:11.688985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721116+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:02:11.721116+0000","last_peered":"2024-09-19T09:02:11.721116+0000","last_clean":"2024-09-19T09:02:11.721116+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:02:11.721116+0000","last_undegraded":"2024-09-19T09:02:11.721116+0000","last_fullsized":"2024-09-19T09:02:11.721116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687577+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:02:11.687577+0000","last_peered":"2024-09-19T09:02:11.687577+0000","last_clean":"2024-09-19T09:02:11.687577+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:02:11.687577+0000","last_undegraded":"2024-09-19T09:02:11.687577+0000","last_fullsized":"2024-09-19T09:02:11.687577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:22.711953+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:02:22.711953+0000","last_peered":"2024-09-19T09:02:22.711953+0000","last_clean":"2024-09-19T09:02:22.711953+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:02:22.711953+0000","last_undegraded":"2024-09-19T09:02:22.711953+0000","last_fullsized":"2024-09-19T09:02:22.711953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687831+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:02:11.687831+0000","last_peered":"2024-09-19T09:02:11.687831+0000","last_clean":"2024-09-19T09:02:11.687831+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:02:11.687831+0000","last_undegraded":"2024-09-19T09:02:11.687831+0000","last_fullsized":"2024-09-19T09:02:11.687831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.691526+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:02:11.691526+0000","last_peered":"2024-09-19T09:02:11.691526+0000","last_clean":"2024-09-19T09:02:11.691526+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:02:11.691526+0000","last_undegraded":"2024-09-19T09:02:11.691526+0000","last_fullsized":"2024-09-19T09:02:11.691526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684279+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:02:11.684279+0000","last_peered":"2024-09-19T09:02:11.684279+0000","last_clean":"2024-09-19T09:02:11.684279+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:02:11.684279+0000","last_undegraded":"2024-09-19T09:02:11.684279+0000","last_fullsized":"2024-09-19T09:02:11.684279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688763+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:02:11.688763+0000","last_peered":"2024-09-19T09:02:11.688763+0000","last_clean":"2024-09-19T09:02:11.688763+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:02:11.688763+0000","last_undegraded":"2024-09-19T09:02:11.688763+0000","last_fullsized":"2024-09-19T09:02:11.688763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688709+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:02:11.688709+0000","last_peered":"2024-09-19T09:02:11.688709+0000","last_clean":"2024-09-19T09:02:11.688709+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:02:11.688709+0000","last_undegraded":"2024-09-19T09:02:11.688709+0000","last_fullsized":"2024-09-19T09:02:11.688709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688932+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:02:11.688932+0000","last_peered":"2024-09-19T09:02:11.688932+0000","last_clean":"2024-09-19T09:02:11.688932+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:02:11.688932+0000","last_undegraded":"2024-09-19T09:02:11.688932+0000","last_fullsized":"2024-09-19T09:02:11.688932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688217+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688217+0000","last_peered":"2024-09-19T09:02:11.688217+0000","last_clean":"2024-09-19T09:02:11.688217+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688217+0000","last_undegraded":"2024-09-19T09:02:11.688217+0000","last_fullsized":"2024-09-19T09:02:11.688217+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683138+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:02:11.683138+0000","last_peered":"2024-09-19T09:02:11.683138+0000","last_clean":"2024-09-19T09:02:11.683138+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:02:11.683138+0000","last_undegraded":"2024-09-19T09:02:11.683138+0000","last_fullsized":"2024-09-19T09:02:11.683138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721097+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:02:11.721097+0000","last_peered":"2024-09-19T09:02:11.721097+0000","last_clean":"2024-09-19T09:02:11.721097+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:02:11.721097+0000","last_undegraded":"2024-09-19T09:02:11.721097+0000","last_fullsized":"2024-09-19T09:02:11.721097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:22.711337+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:02:22.711337+0000","last_peered":"2024-09-19T09:02:22.711337+0000","last_clean":"2024-09-19T09:02:22.711337+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:02:22.711337+0000","last_undegraded":"2024-09-19T09:02:22.711337+0000","last_fullsized":"2024-09-19T09:02:22.711337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685572+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:02:11.685572+0000","last_peered":"2024-09-19T09:02:11.685572+0000","last_clean":"2024-09-19T09:02:11.685572+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:02:11.685572+0000","last_undegraded":"2024-09-19T09:02:11.685572+0000","last_fullsized":"2024-09-19T09:02:11.685572+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688006+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:02:11.688006+0000","last_peered":"2024-09-19T09:02:11.688006+0000","last_clean":"2024-09-19T09:02:11.688006+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:02:11.688006+0000","last_undegraded":"2024-09-19T09:02:11.688006+0000","last_fullsized":"2024-09-19T09:02:11.688006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684207+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:02:11.684207+0000","last_peered":"2024-09-19T09:02:11.684207+0000","last_clean":"2024-09-19T09:02:11.684207+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:02:11.684207+0000","last_undegraded":"2024-09-19T09:02:11.684207+0000","last_fullsized":"2024-09-19T09:02:11.684207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721294+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:02:11.721294+0000","last_peered":"2024-09-19T09:02:11.721294+0000","last_clean":"2024-09-19T09:02:11.721294+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:02:11.721294+0000","last_undegraded":"2024-09-19T09:02:11.721294+0000","last_fullsized":"2024-09-19T09:02:11.721294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:20.662776+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:02:20.662776+0000","last_peered":"2024-09-19T09:02:20.662776+0000","last_clean":"2024-09-19T09:02:20.662776+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:02:20.662776+0000","last_undegraded":"2024-09-19T09:02:20.662776+0000","last_fullsized":"2024-09-19T09:02:20.662776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683397+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:02:11.683397+0000","last_peered":"2024-09-19T09:02:11.683397+0000","last_clean":"2024-09-19T09:02:11.683397+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:02:11.683397+0000","last_undegraded":"2024-09-19T09:02:11.683397+0000","last_fullsized":"2024-09-19T09:02:11.683397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.690071+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:02:11.690071+0000","last_peered":"2024-09-19T09:02:11.690071+0000","last_clean":"2024-09-19T09:02:11.690071+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:02:11.690071+0000","last_undegraded":"2024-09-19T09:02:11.690071+0000","last_fullsized":"2024-09-19T09:02:11.690071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686769+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:02:11.686769+0000","last_peered":"2024-09-19T09:02:11.686769+0000","last_clean":"2024-09-19T09:02:11.686769+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:02:11.686769+0000","last_undegraded":"2024-09-19T09:02:11.686769+0000","last_fullsized":"2024-09-19T09:02:11.686769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684129+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:02:11.684129+0000","last_peered":"2024-09-19T09:02:11.684129+0000","last_clean":"2024-09-19T09:02:11.684129+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:02:11.684129+0000","last_undegraded":"2024-09-19T09:02:11.684129+0000","last_fullsized":"2024-09-19T09:02:11.684129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686861+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686861+0000","last_peered":"2024-09-19T09:02:11.686861+0000","last_clean":"2024-09-19T09:02:11.686861+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686861+0000","last_undegraded":"2024-09-19T09:02:11.686861+0000","last_fullsized":"2024-09-19T09:02:11.686861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683078+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:02:11.683078+0000","last_peered":"2024-09-19T09:02:11.683078+0000","last_clean":"2024-09-19T09:02:11.683078+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:02:11.683078+0000","last_undegraded":"2024-09-19T09:02:11.683078+0000","last_fullsized":"2024-09-19T09:02:11.683078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687647+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:02:11.687647+0000","last_peered":"2024-09-19T09:02:11.687647+0000","last_clean":"2024-09-19T09:02:11.687647+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:02:11.687647+0000","last_undegraded":"2024-09-19T09:02:11.687647+0000","last_fullsized":"2024-09-19T09:02:11.687647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687408+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:02:11.687408+0000","last_peered":"2024-09-19T09:02:11.687408+0000","last_clean":"2024-09-19T09:02:11.687408+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:02:11.687408+0000","last_undegraded":"2024-09-19T09:02:11.687408+0000","last_fullsized":"2024-09-19T09:02:11.687408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689665+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:02:11.689665+0000","last_peered":"2024-09-19T09:02:11.689665+0000","last_clean":"2024-09-19T09:02:11.689665+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:02:11.689665+0000","last_undegraded":"2024-09-19T09:02:11.689665+0000","last_fullsized":"2024-09-19T09:02:11.689665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685951+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:02:11.685951+0000","last_peered":"2024-09-19T09:02:11.685951+0000","last_clean":"2024-09-19T09:02:11.685951+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:02:11.685951+0000","last_undegraded":"2024-09-19T09:02:11.685951+0000","last_fullsized":"2024-09-19T09:02:11.685951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.691477+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:02:11.691477+0000","last_peered":"2024-09-19T09:02:11.691477+0000","last_clean":"2024-09-19T09:02:11.691477+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:02:11.691477+0000","last_undegraded":"2024-09-19T09:02:11.691477+0000","last_fullsized":"2024-09-19T09:02:11.691477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686208+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.686208+0000","last_peered":"2024-09-19T09:02:11.686208+0000","last_clean":"2024-09-19T09:02:11.686208+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.686208+0000","last_undegraded":"2024-09-19T09:02:11.686208+0000","last_fullsized":"2024-09-19T09:02:11.686208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53606,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":104,"num_read_kb":109,"num_write":152,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":160818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645328,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1068306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266719,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36796,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708356,"statfs":{"total":95995035648,"available":95957356544,"internally_reserved":0,"allocated":1486848,"data_stored":1019310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1018994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":477952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":476243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":51312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:02:27.315 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:02:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:27.975 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:27 smithi001 ceph-mon[30939]: pgmap v288: 97 pgs: 97 active+clean; 629 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-19T09:02:27.975 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:27 smithi001 ceph-mon[30939]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:28.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.056+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3837983321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 msgr2=0x7fe71810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:28.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.056+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3837983321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 0x7fe71810d910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe710009ca0 tx=0x7fe71002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3837983321 shutdown_connections 2024-09-19T09:02:28.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3837983321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 0x7fe71810d910 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3837983321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe718101240 0x7fe718101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3837983321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe718105a90 0x7fe718105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3837983321 >> 172.21.15.1:0/3837983321 conn(0x7fe718077210 msgr2=0x7fe7180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3837983321 shutdown_connections 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3837983321 wait complete. 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 Processor -- start 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.057+0000 7fe71e6a5640 1 -- start start 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe71e6a5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe718101240 0x7fe718198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe71e6a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 0x7fe718198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe71e6a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe718105a90 0x7fe71819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe71e6a5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe718111090 con 0x7fe718101bc0 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe71e6a5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe718110f10 con 0x7fe718105a90 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe71e6a5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe718111210 con 0x7fe718101240 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 0x7fe718198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:28.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 0x7fe718198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43868/0 (socket says 172.21.15.1:43868) 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 -- 172.21.15.1:0/3337471738 learned_addr learned my addr 172.21.15.1:0/3337471738 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe717fff640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe718101240 0x7fe718198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 -- 172.21.15.1:0/3337471738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe718101240 msgr2=0x7fe718198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe718101240 0x7fe718198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe71cc42640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe718105a90 0x7fe71819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 -- 172.21.15.1:0/3337471738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe718105a90 msgr2=0x7fe71819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe718105a90 0x7fe71819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 -- 172.21.15.1:0/3337471738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71819d4d0 con 0x7fe718101bc0 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7177fe640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 0x7fe718198a60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d770 tx=0x7fe70c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7157fa640 1 -- 172.21.15.1:0/3337471738 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c017070 con 0x7fe718101bc0 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71819d7c0 con 0x7fe718101bc0 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7157fa640 1 -- 172.21.15.1:0/3337471738 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe70c005520 con 0x7fe718101bc0 2024-09-19T09:02:28.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.058+0000 7fe7157fa640 1 -- 172.21.15.1:0/3337471738 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c010460 con 0x7fe718101bc0 2024-09-19T09:02:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.059+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7181a50a0 con 0x7fe718101bc0 2024-09-19T09:02:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.060+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe718101680 con 0x7fe718101bc0 2024-09-19T09:02:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.061+0000 7fe7157fa640 1 -- 172.21.15.1:0/3337471738 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe70c004ea0 con 0x7fe718101bc0 2024-09-19T09:02:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.061+0000 7fe7157fa640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7000a32d0 0x7fe7000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.061+0000 7fe7157fa640 1 -- 172.21.15.1:0/3337471738 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe70c0cf690 con 0x7fe718101bc0 2024-09-19T09:02:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.061+0000 7fe717fff640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7000a32d0 0x7fe7000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.062+0000 7fe717fff640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7000a32d0 0x7fe7000a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7080058c0 tx=0x7fe708005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:28.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.065+0000 7fe7157fa640 1 -- 172.21.15.1:0/3337471738 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe70c09c230 con 0x7fe718101bc0 2024-09-19T09:02:28.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:27 smithi064 ceph-mon[35179]: pgmap v288: 97 pgs: 97 active+clean; 629 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-19T09:02:28.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:27 smithi064 ceph-mon[35179]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:28.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:27 smithi022 ceph-mon[35107]: pgmap v288: 97 pgs: 97 active+clean; 629 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.8 KiB/s wr, 13 op/s 2024-09-19T09:02:28.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:27 smithi022 ceph-mon[35107]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:28.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.238+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7181009b0 con 0x7fe7000a32d0 2024-09-19T09:02:28.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.244+0000 7fe7157fa640 1 -- 172.21.15.1:0/3337471738 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258716 (secure 0 0 0) 0x7fe7181009b0 con 0x7fe7000a32d0 2024-09-19T09:02:28.247 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:28.248 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7000a32d0 msgr2=0x7fe7000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7000a32d0 0x7fe7000a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7080058c0 tx=0x7fe708005c60 comp rx=0 tx=0).stop 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 msgr2=0x7fe718198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 0x7fe718198a60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d770 tx=0x7fe70c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 shutdown_connections 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe718105a90 0x7fe71819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe718101bc0 0x7fe718198a60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe7000a32d0 0x7fe7000a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 --2- 172.21.15.1:0/3337471738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe718101240 0x7fe718198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 >> 172.21.15.1:0/3337471738 conn(0x7fe718077210 msgr2=0x7fe7181002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 shutdown_connections 2024-09-19T09:02:28.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:28.247+0000 7fe71e6a5640 1 -- 172.21.15.1:0/3337471738 wait complete. 2024-09-19T09:02:29.003 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-19T09:02:27.943481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644208,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":230,"num_read_kb":218,"num_write":335,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390744,"kb_used_data":12360,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551080,"statfs":{"total":1151940427776,"available":1151540305920,"internally_reserved":0,"allocated":12656640,"data_stored":7052304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48618,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":80,"num_write":29,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002908"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684751+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:02:11.684751+0000","last_peered":"2024-09-19T09:02:11.684751+0000","last_clean":"2024-09-19T09:02:11.684751+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:02:11.684751+0000","last_undegraded":"2024-09-19T09:02:11.684751+0000","last_fullsized":"2024-09-19T09:02:11.684751+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685274+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:02:11.685274+0000","last_peered":"2024-09-19T09:02:11.685274+0000","last_clean":"2024-09-19T09:02:11.685274+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:02:11.685274+0000","last_undegraded":"2024-09-19T09:02:11.685274+0000","last_fullsized":"2024-09-19T09:02:11.685274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685391+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:02:11.685391+0000","last_peered":"2024-09-19T09:02:11.685391+0000","last_clean":"2024-09-19T09:02:11.685391+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:02:11.685391+0000","last_undegraded":"2024-09-19T09:02:11.685391+0000","last_fullsized":"2024-09-19T09:02:11.685391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697115+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:02:11.697115+0000","last_peered":"2024-09-19T09:02:11.697115+0000","last_clean":"2024-09-19T09:02:11.697115+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:02:11.697115+0000","last_undegraded":"2024-09-19T09:02:11.697115+0000","last_fullsized":"2024-09-19T09:02:11.697115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687096+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:02:11.687096+0000","last_peered":"2024-09-19T09:02:11.687096+0000","last_clean":"2024-09-19T09:02:11.687096+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:02:11.687096+0000","last_undegraded":"2024-09-19T09:02:11.687096+0000","last_fullsized":"2024-09-19T09:02:11.687096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683669+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:02:11.683669+0000","last_peered":"2024-09-19T09:02:11.683669+0000","last_clean":"2024-09-19T09:02:11.683669+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:02:11.683669+0000","last_undegraded":"2024-09-19T09:02:11.683669+0000","last_fullsized":"2024-09-19T09:02:11.683669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.722501+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:02:11.722501+0000","last_peered":"2024-09-19T09:02:11.722501+0000","last_clean":"2024-09-19T09:02:11.722501+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:02:11.722501+0000","last_undegraded":"2024-09-19T09:02:11.722501+0000","last_fullsized":"2024-09-19T09:02:11.722501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682881+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:02:11.682881+0000","last_peered":"2024-09-19T09:02:11.682881+0000","last_clean":"2024-09-19T09:02:11.682881+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:02:11.682881+0000","last_undegraded":"2024-09-19T09:02:11.682881+0000","last_fullsized":"2024-09-19T09:02:11.682881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.690180+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:02:11.690180+0000","last_peered":"2024-09-19T09:02:11.690180+0000","last_clean":"2024-09-19T09:02:11.690180+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:02:11.690180+0000","last_undegraded":"2024-09-19T09:02:11.690180+0000","last_fullsized":"2024-09-19T09:02:11.690180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684237+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:02:11.684237+0000","last_peered":"2024-09-19T09:02:11.684237+0000","last_clean":"2024-09-19T09:02:11.684237+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:02:11.684237+0000","last_undegraded":"2024-09-19T09:02:11.684237+0000","last_fullsized":"2024-09-19T09:02:11.684237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688749+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:02:11.688749+0000","last_peered":"2024-09-19T09:02:11.688749+0000","last_clean":"2024-09-19T09:02:11.688749+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:02:11.688749+0000","last_undegraded":"2024-09-19T09:02:11.688749+0000","last_fullsized":"2024-09-19T09:02:11.688749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697164+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:02:11.697164+0000","last_peered":"2024-09-19T09:02:11.697164+0000","last_clean":"2024-09-19T09:02:11.697164+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:02:11.697164+0000","last_undegraded":"2024-09-19T09:02:11.697164+0000","last_fullsized":"2024-09-19T09:02:11.697164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721263+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:02:11.721263+0000","last_peered":"2024-09-19T09:02:11.721263+0000","last_clean":"2024-09-19T09:02:11.721263+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:02:11.721263+0000","last_undegraded":"2024-09-19T09:02:11.721263+0000","last_fullsized":"2024-09-19T09:02:11.721263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685216+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:02:11.685216+0000","last_peered":"2024-09-19T09:02:11.685216+0000","last_clean":"2024-09-19T09:02:11.685216+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:02:11.685216+0000","last_undegraded":"2024-09-19T09:02:11.685216+0000","last_fullsized":"2024-09-19T09:02:11.685216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684970+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:02:11.684970+0000","last_peered":"2024-09-19T09:02:11.684970+0000","last_clean":"2024-09-19T09:02:11.684970+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:02:11.684970+0000","last_undegraded":"2024-09-19T09:02:11.684970+0000","last_fullsized":"2024-09-19T09:02:11.684970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689295+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:02:11.689295+0000","last_peered":"2024-09-19T09:02:11.689295+0000","last_clean":"2024-09-19T09:02:11.689295+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:02:11.689295+0000","last_undegraded":"2024-09-19T09:02:11.689295+0000","last_fullsized":"2024-09-19T09:02:11.689295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684879+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:02:11.684879+0000","last_peered":"2024-09-19T09:02:11.684879+0000","last_clean":"2024-09-19T09:02:11.684879+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:02:11.684879+0000","last_undegraded":"2024-09-19T09:02:11.684879+0000","last_fullsized":"2024-09-19T09:02:11.684879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685449+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:02:11.685449+0000","last_peered":"2024-09-19T09:02:11.685449+0000","last_clean":"2024-09-19T09:02:11.685449+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:02:11.685449+0000","last_undegraded":"2024-09-19T09:02:11.685449+0000","last_fullsized":"2024-09-19T09:02:11.685449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687074+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:02:11.687074+0000","last_peered":"2024-09-19T09:02:11.687074+0000","last_clean":"2024-09-19T09:02:11.687074+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:02:11.687074+0000","last_undegraded":"2024-09-19T09:02:11.687074+0000","last_fullsized":"2024-09-19T09:02:11.687074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684228+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:02:11.684228+0000","last_peered":"2024-09-19T09:02:11.684228+0000","last_clean":"2024-09-19T09:02:11.684228+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:02:11.684228+0000","last_undegraded":"2024-09-19T09:02:11.684228+0000","last_fullsized":"2024-09-19T09:02:11.684228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721356+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:02:11.721356+0000","last_peered":"2024-09-19T09:02:11.721356+0000","last_clean":"2024-09-19T09:02:11.721356+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:02:11.721356+0000","last_undegraded":"2024-09-19T09:02:11.721356+0000","last_fullsized":"2024-09-19T09:02:11.721356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689612+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:02:11.689612+0000","last_peered":"2024-09-19T09:02:11.689612+0000","last_clean":"2024-09-19T09:02:11.689612+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:02:11.689612+0000","last_undegraded":"2024-09-19T09:02:11.689612+0000","last_fullsized":"2024-09-19T09:02:11.689612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682914+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:02:11.682914+0000","last_peered":"2024-09-19T09:02:11.682914+0000","last_clean":"2024-09-19T09:02:11.682914+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:02:11.682914+0000","last_undegraded":"2024-09-19T09:02:11.682914+0000","last_fullsized":"2024-09-19T09:02:11.682914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685454+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:02:11.685454+0000","last_peered":"2024-09-19T09:02:11.685454+0000","last_clean":"2024-09-19T09:02:11.685454+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:02:11.685454+0000","last_undegraded":"2024-09-19T09:02:11.685454+0000","last_fullsized":"2024-09-19T09:02:11.685454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.698766+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:02:11.698766+0000","last_peered":"2024-09-19T09:02:11.698766+0000","last_clean":"2024-09-19T09:02:11.698766+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:02:11.698766+0000","last_undegraded":"2024-09-19T09:02:11.698766+0000","last_fullsized":"2024-09-19T09:02:11.698766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688189+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:02:11.688189+0000","last_peered":"2024-09-19T09:02:11.688189+0000","last_clean":"2024-09-19T09:02:11.688189+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:02:11.688189+0000","last_undegraded":"2024-09-19T09:02:11.688189+0000","last_fullsized":"2024-09-19T09:02:11.688189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684587+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:02:11.684587+0000","last_peered":"2024-09-19T09:02:11.684587+0000","last_clean":"2024-09-19T09:02:11.684587+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:02:11.684587+0000","last_undegraded":"2024-09-19T09:02:11.684587+0000","last_fullsized":"2024-09-19T09:02:11.684587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721255+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:02:11.721255+0000","last_peered":"2024-09-19T09:02:11.721255+0000","last_clean":"2024-09-19T09:02:11.721255+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:02:11.721255+0000","last_undegraded":"2024-09-19T09:02:11.721255+0000","last_fullsized":"2024-09-19T09:02:11.721255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685196+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:02:11.685196+0000","last_peered":"2024-09-19T09:02:11.685196+0000","last_clean":"2024-09-19T09:02:11.685196+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:02:11.685196+0000","last_undegraded":"2024-09-19T09:02:11.685196+0000","last_fullsized":"2024-09-19T09:02:11.685196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686706+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:02:11.686706+0000","last_peered":"2024-09-19T09:02:11.686706+0000","last_clean":"2024-09-19T09:02:11.686706+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:02:11.686706+0000","last_undegraded":"2024-09-19T09:02:11.686706+0000","last_fullsized":"2024-09-19T09:02:11.686706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686681+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:02:11.686681+0000","last_peered":"2024-09-19T09:02:11.686681+0000","last_clean":"2024-09-19T09:02:11.686681+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:02:11.686681+0000","last_undegraded":"2024-09-19T09:02:11.686681+0000","last_fullsized":"2024-09-19T09:02:11.686681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684044+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:02:11.684044+0000","last_peered":"2024-09-19T09:02:11.684044+0000","last_clean":"2024-09-19T09:02:11.684044+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:02:11.684044+0000","last_undegraded":"2024-09-19T09:02:11.684044+0000","last_fullsized":"2024-09-19T09:02:11.684044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.722540+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:02:11.722540+0000","last_peered":"2024-09-19T09:02:11.722540+0000","last_clean":"2024-09-19T09:02:11.722540+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:02:11.722540+0000","last_undegraded":"2024-09-19T09:02:11.722540+0000","last_fullsized":"2024-09-19T09:02:11.722540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:23.526570+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:02:23.526570+0000","last_peered":"2024-09-19T09:02:23.526570+0000","last_clean":"2024-09-19T09:02:23.526570+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:02:23.526570+0000","last_undegraded":"2024-09-19T09:02:23.526570+0000","last_fullsized":"2024-09-19T09:02:23.526570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.692423+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:02:11.692423+0000","last_peered":"2024-09-19T09:02:11.692423+0000","last_clean":"2024-09-19T09:02:11.692423+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:02:11.692423+0000","last_undegraded":"2024-09-19T09:02:11.692423+0000","last_fullsized":"2024-09-19T09:02:11.692423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682939+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:02:11.682939+0000","last_peered":"2024-09-19T09:02:11.682939+0000","last_clean":"2024-09-19T09:02:11.682939+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:02:11.682939+0000","last_undegraded":"2024-09-19T09:02:11.682939+0000","last_fullsized":"2024-09-19T09:02:11.682939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685621+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:02:11.685621+0000","last_peered":"2024-09-19T09:02:11.685621+0000","last_clean":"2024-09-19T09:02:11.685621+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:02:11.685621+0000","last_undegraded":"2024-09-19T09:02:11.685621+0000","last_fullsized":"2024-09-19T09:02:11.685621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:22.524484+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:02:22.524484+0000","last_peered":"2024-09-19T09:02:22.524484+0000","last_clean":"2024-09-19T09:02:22.524484+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:02:22.524484+0000","last_undegraded":"2024-09-19T09:02:22.524484+0000","last_fullsized":"2024-09-19T09:02:22.524484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689854+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:02:11.689854+0000","last_peered":"2024-09-19T09:02:11.689854+0000","last_clean":"2024-09-19T09:02:11.689854+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:02:11.689854+0000","last_undegraded":"2024-09-19T09:02:11.689854+0000","last_fullsized":"2024-09-19T09:02:11.689854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686110+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:02:11.686110+0000","last_peered":"2024-09-19T09:02:11.686110+0000","last_clean":"2024-09-19T09:02:11.686110+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:02:11.686110+0000","last_undegraded":"2024-09-19T09:02:11.686110+0000","last_fullsized":"2024-09-19T09:02:11.686110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689850+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:02:11.689850+0000","last_peered":"2024-09-19T09:02:11.689850+0000","last_clean":"2024-09-19T09:02:11.689850+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:02:11.689850+0000","last_undegraded":"2024-09-19T09:02:11.689850+0000","last_fullsized":"2024-09-19T09:02:11.689850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'25","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:23.715732+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:02:23.715732+0000","last_peered":"2024-09-19T09:02:23.715732+0000","last_clean":"2024-09-19T09:02:23.715732+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:02:23.715732+0000","last_undegraded":"2024-09-19T09:02:23.715732+0000","last_fullsized":"2024-09-19T09:02:23.715732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":64,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688985+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:02:11.688985+0000","last_peered":"2024-09-19T09:02:11.688985+0000","last_clean":"2024-09-19T09:02:11.688985+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:02:11.688985+0000","last_undegraded":"2024-09-19T09:02:11.688985+0000","last_fullsized":"2024-09-19T09:02:11.688985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721116+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:02:11.721116+0000","last_peered":"2024-09-19T09:02:11.721116+0000","last_clean":"2024-09-19T09:02:11.721116+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:02:11.721116+0000","last_undegraded":"2024-09-19T09:02:11.721116+0000","last_fullsized":"2024-09-19T09:02:11.721116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687577+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:02:11.687577+0000","last_peered":"2024-09-19T09:02:11.687577+0000","last_clean":"2024-09-19T09:02:11.687577+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:02:11.687577+0000","last_undegraded":"2024-09-19T09:02:11.687577+0000","last_fullsized":"2024-09-19T09:02:11.687577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:22.711953+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:02:22.711953+0000","last_peered":"2024-09-19T09:02:22.711953+0000","last_clean":"2024-09-19T09:02:22.711953+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:02:22.711953+0000","last_undegraded":"2024-09-19T09:02:22.711953+0000","last_fullsized":"2024-09-19T09:02:22.711953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687831+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:02:11.687831+0000","last_peered":"2024-09-19T09:02:11.687831+0000","last_clean":"2024-09-19T09:02:11.687831+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:02:11.687831+0000","last_undegraded":"2024-09-19T09:02:11.687831+0000","last_fullsized":"2024-09-19T09:02:11.687831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.691526+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:02:11.691526+0000","last_peered":"2024-09-19T09:02:11.691526+0000","last_clean":"2024-09-19T09:02:11.691526+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:02:11.691526+0000","last_undegraded":"2024-09-19T09:02:11.691526+0000","last_fullsized":"2024-09-19T09:02:11.691526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684279+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:02:11.684279+0000","last_peered":"2024-09-19T09:02:11.684279+0000","last_clean":"2024-09-19T09:02:11.684279+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:02:11.684279+0000","last_undegraded":"2024-09-19T09:02:11.684279+0000","last_fullsized":"2024-09-19T09:02:11.684279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688763+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:02:11.688763+0000","last_peered":"2024-09-19T09:02:11.688763+0000","last_clean":"2024-09-19T09:02:11.688763+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:02:11.688763+0000","last_undegraded":"2024-09-19T09:02:11.688763+0000","last_fullsized":"2024-09-19T09:02:11.688763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688709+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:02:11.688709+0000","last_peered":"2024-09-19T09:02:11.688709+0000","last_clean":"2024-09-19T09:02:11.688709+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:02:11.688709+0000","last_undegraded":"2024-09-19T09:02:11.688709+0000","last_fullsized":"2024-09-19T09:02:11.688709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688932+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:02:11.688932+0000","last_peered":"2024-09-19T09:02:11.688932+0000","last_clean":"2024-09-19T09:02:11.688932+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:02:11.688932+0000","last_undegraded":"2024-09-19T09:02:11.688932+0000","last_fullsized":"2024-09-19T09:02:11.688932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688217+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688217+0000","last_peered":"2024-09-19T09:02:11.688217+0000","last_clean":"2024-09-19T09:02:11.688217+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688217+0000","last_undegraded":"2024-09-19T09:02:11.688217+0000","last_fullsized":"2024-09-19T09:02:11.688217+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683138+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:02:11.683138+0000","last_peered":"2024-09-19T09:02:11.683138+0000","last_clean":"2024-09-19T09:02:11.683138+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:02:11.683138+0000","last_undegraded":"2024-09-19T09:02:11.683138+0000","last_fullsized":"2024-09-19T09:02:11.683138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721097+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:02:11.721097+0000","last_peered":"2024-09-19T09:02:11.721097+0000","last_clean":"2024-09-19T09:02:11.721097+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:02:11.721097+0000","last_undegraded":"2024-09-19T09:02:11.721097+0000","last_fullsized":"2024-09-19T09:02:11.721097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:22.711337+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:02:22.711337+0000","last_peered":"2024-09-19T09:02:22.711337+0000","last_clean":"2024-09-19T09:02:22.711337+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:02:22.711337+0000","last_undegraded":"2024-09-19T09:02:22.711337+0000","last_fullsized":"2024-09-19T09:02:22.711337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685572+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:02:11.685572+0000","last_peered":"2024-09-19T09:02:11.685572+0000","last_clean":"2024-09-19T09:02:11.685572+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:02:11.685572+0000","last_undegraded":"2024-09-19T09:02:11.685572+0000","last_fullsized":"2024-09-19T09:02:11.685572+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688006+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:02:11.688006+0000","last_peered":"2024-09-19T09:02:11.688006+0000","last_clean":"2024-09-19T09:02:11.688006+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:02:11.688006+0000","last_undegraded":"2024-09-19T09:02:11.688006+0000","last_fullsized":"2024-09-19T09:02:11.688006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684207+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:02:11.684207+0000","last_peered":"2024-09-19T09:02:11.684207+0000","last_clean":"2024-09-19T09:02:11.684207+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:02:11.684207+0000","last_undegraded":"2024-09-19T09:02:11.684207+0000","last_fullsized":"2024-09-19T09:02:11.684207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721294+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:02:11.721294+0000","last_peered":"2024-09-19T09:02:11.721294+0000","last_clean":"2024-09-19T09:02:11.721294+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:02:11.721294+0000","last_undegraded":"2024-09-19T09:02:11.721294+0000","last_fullsized":"2024-09-19T09:02:11.721294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:20.662776+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:02:20.662776+0000","last_peered":"2024-09-19T09:02:20.662776+0000","last_clean":"2024-09-19T09:02:20.662776+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:02:20.662776+0000","last_undegraded":"2024-09-19T09:02:20.662776+0000","last_fullsized":"2024-09-19T09:02:20.662776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683397+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:02:11.683397+0000","last_peered":"2024-09-19T09:02:11.683397+0000","last_clean":"2024-09-19T09:02:11.683397+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:02:11.683397+0000","last_undegraded":"2024-09-19T09:02:11.683397+0000","last_fullsized":"2024-09-19T09:02:11.683397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.690071+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:02:11.690071+0000","last_peered":"2024-09-19T09:02:11.690071+0000","last_clean":"2024-09-19T09:02:11.690071+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:02:11.690071+0000","last_undegraded":"2024-09-19T09:02:11.690071+0000","last_fullsized":"2024-09-19T09:02:11.690071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686769+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:02:11.686769+0000","last_peered":"2024-09-19T09:02:11.686769+0000","last_clean":"2024-09-19T09:02:11.686769+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:02:11.686769+0000","last_undegraded":"2024-09-19T09:02:11.686769+0000","last_fullsized":"2024-09-19T09:02:11.686769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684129+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:02:11.684129+0000","last_peered":"2024-09-19T09:02:11.684129+0000","last_clean":"2024-09-19T09:02:11.684129+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:02:11.684129+0000","last_undegraded":"2024-09-19T09:02:11.684129+0000","last_fullsized":"2024-09-19T09:02:11.684129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686861+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686861+0000","last_peered":"2024-09-19T09:02:11.686861+0000","last_clean":"2024-09-19T09:02:11.686861+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686861+0000","last_undegraded":"2024-09-19T09:02:11.686861+0000","last_fullsized":"2024-09-19T09:02:11.686861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683078+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:02:11.683078+0000","last_peered":"2024-09-19T09:02:11.683078+0000","last_clean":"2024-09-19T09:02:11.683078+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:02:11.683078+0000","last_undegraded":"2024-09-19T09:02:11.683078+0000","last_fullsized":"2024-09-19T09:02:11.683078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687647+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:02:11.687647+0000","last_peered":"2024-09-19T09:02:11.687647+0000","last_clean":"2024-09-19T09:02:11.687647+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:02:11.687647+0000","last_undegraded":"2024-09-19T09:02:11.687647+0000","last_fullsized":"2024-09-19T09:02:11.687647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687408+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:02:11.687408+0000","last_peered":"2024-09-19T09:02:11.687408+0000","last_clean":"2024-09-19T09:02:11.687408+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:02:11.687408+0000","last_undegraded":"2024-09-19T09:02:11.687408+0000","last_fullsized":"2024-09-19T09:02:11.687408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689665+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:02:11.689665+0000","last_peered":"2024-09-19T09:02:11.689665+0000","last_clean":"2024-09-19T09:02:11.689665+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:02:11.689665+0000","last_undegraded":"2024-09-19T09:02:11.689665+0000","last_fullsized":"2024-09-19T09:02:11.689665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685951+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:02:11.685951+0000","last_peered":"2024-09-19T09:02:11.685951+0000","last_clean":"2024-09-19T09:02:11.685951+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:02:11.685951+0000","last_undegraded":"2024-09-19T09:02:11.685951+0000","last_fullsized":"2024-09-19T09:02:11.685951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.691477+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:02:11.691477+0000","last_peered":"2024-09-19T09:02:11.691477+0000","last_clean":"2024-09-19T09:02:11.691477+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:02:11.691477+0000","last_undegraded":"2024-09-19T09:02:11.691477+0000","last_fullsized":"2024-09-19T09:02:11.691477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686208+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.686208+0000","last_peered":"2024-09-19T09:02:11.686208+0000","last_clean":"2024-09-19T09:02:11.686208+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.686208+0000","last_undegraded":"2024-09-19T09:02:11.686208+0000","last_fullsized":"2024-09-19T09:02:11.686208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53606,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":104,"num_read_kb":109,"num_write":152,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":160818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645328,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1068306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266719,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36796,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708356,"statfs":{"total":95995035648,"available":95957356544,"internally_reserved":0,"allocated":1486848,"data_stored":1019310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1018994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":477952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":476243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":51312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:02:29.007 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:02:29.008 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T09:02:29.008 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:02:29.269 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:29.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 -- 172.21.15.1:0/1944822638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66441026d0 msgr2=0x7f6644108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 --2- 172.21.15.1:0/1944822638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66441026d0 0x7f6644108f60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f663c009ca0 tx=0x7f663c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 -- 172.21.15.1:0/1944822638 shutdown_connections 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 --2- 172.21.15.1:0/1944822638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66441026d0 0x7f6644108f60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 --2- 172.21.15.1:0/1944822638 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6644101d10 0x7f6644102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 --2- 172.21.15.1:0/1944822638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6644100b10 0x7f6644100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 -- 172.21.15.1:0/1944822638 >> 172.21.15.1:0/1944822638 conn(0x7f66440fc2a0 msgr2=0x7f66440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 -- 172.21.15.1:0/1944822638 shutdown_connections 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 -- 172.21.15.1:0/1944822638 wait complete. 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 Processor -- start 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.739+0000 7f664c631640 1 -- start start 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664c631640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6644100b10 0x7f6644197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664c631640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6644101d10 0x7f66441984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664c631640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66441026d0 0x7f664419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:29.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664c631640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f664410da40 con 0x7f6644101d10 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664c631640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f664410d8c0 con 0x7f66441026d0 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664c631640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f664410dbc0 con 0x7f6644100b10 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6644101d10 0x7f66441984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6644101d10 0x7f66441984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43884/0 (socket says 172.21.15.1:43884) 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 -- 172.21.15.1:0/2346047939 learned_addr learned my addr 172.21.15.1:0/2346047939 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664a3cd640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6644100b10 0x7f6644197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664abce640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66441026d0 0x7f664419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 -- 172.21.15.1:0/2346047939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6644100b10 msgr2=0x7f6644197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6644100b10 0x7f6644197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 -- 172.21.15.1:0/2346047939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66441026d0 msgr2=0x7f664419f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66441026d0 0x7f664419f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 -- 172.21.15.1:0/2346047939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664419fbc0 con 0x7f6644101d10 2024-09-19T09:02:29.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f6649bcc640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6644101d10 0x7f66441984d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f663400e9f0 tx=0x7f663400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f663b7fe640 1 -- 172.21.15.1:0/2346047939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663400cd80 con 0x7f6644101d10 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f663b7fe640 1 -- 172.21.15.1:0/2346047939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6634005520 con 0x7f6644101d10 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664419feb0 con 0x7f6644101d10 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.740+0000 7f663b7fe640 1 -- 172.21.15.1:0/2346047939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634010690 con 0x7f6644101d10 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.741+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66441a0310 con 0x7f6644101d10 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.742+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6644107e40 con 0x7f6644101d10 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.743+0000 7f663b7fe640 1 -- 172.21.15.1:0/2346047939 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f66340046c0 con 0x7f6644101d10 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.743+0000 7f663b7fe640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66300a3300 0x7f66300a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.743+0000 7f664a3cd640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66300a3300 0x7f66300a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.743+0000 7f663b7fe640 1 -- 172.21.15.1:0/2346047939 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f66340cfea0 con 0x7f6644101d10 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.744+0000 7f664a3cd640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66300a3300 0x7f66300a57c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6644101b70 tx=0x7f6640005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:29.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.748+0000 7f663b7fe640 1 -- 172.21.15.1:0/2346047939 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f663409ca40 con 0x7f6644101d10 2024-09-19T09:02:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.989+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f664402d970 con 0x7f6644101d10 2024-09-19T09:02:29.991 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:29 smithi001 ceph-mon[30939]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-19T09:02:29.991 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:29 smithi001 ceph-mon[30939]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:29.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.992+0000 7f663b7fe640 1 -- 172.21.15.1:0/2346047939 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f663409c340 con 0x7f6644101d10 2024-09-19T09:02:29.993 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-19T09:02:29.993 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCl6OtmtfwhOxAATJ3Y4b1Wn6hb5CId+JSFiA== 2024-09-19T09:02:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66300a3300 msgr2=0x7f66300a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66300a3300 0x7f66300a57c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6644101b70 tx=0x7f6640005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6644101d10 msgr2=0x7f66441984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6644101d10 0x7f66441984d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f663400e9f0 tx=0x7f663400edf0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 shutdown_connections 2024-09-19T09:02:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f66441026d0 0x7f664419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6644101d10 0x7f66441984d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f66300a3300 0x7f66300a57c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 --2- 172.21.15.1:0/2346047939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6644100b10 0x7f6644197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 >> 172.21.15.1:0/2346047939 conn(0x7f66440fc2a0 msgr2=0x7f6644105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 shutdown_connections 2024-09-19T09:02:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:29.994+0000 7f664c631640 1 -- 172.21.15.1:0/2346047939 wait complete. 2024-09-19T09:02:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:29 smithi064 ceph-mon[35179]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-19T09:02:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:29 smithi064 ceph-mon[35179]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:30.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:29 smithi022 ceph-mon[35107]: pgmap v289: 97 pgs: 97 active+clean; 629 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.0 KiB/s wr, 7 op/s 2024-09-19T09:02:30.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:29 smithi022 ceph-mon[35107]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:02:30.672 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:02:30.672 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T09:02:30.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:02:30.711 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:02:30.712 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:02:30.712 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T09:02:31.006 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:31.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:30 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2346047939' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:02:31.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:30 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2346047939' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:02:31.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:30 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2346047939' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:02:31.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:30 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2346047939' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:02:31.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:30 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2346047939' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:02:31.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:30 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2346047939' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:02:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 -- 172.21.15.1:0/2477117441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c103740 msgr2=0x7f064c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 --2- 172.21.15.1:0/2477117441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c103740 0x7f064c107b80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0640009930 tx=0x7f064002a420 comp rx=0 tx=0).stop 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 -- 172.21.15.1:0/2477117441 shutdown_connections 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 --2- 172.21.15.1:0/2477117441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f064c108290 0x7f064c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 --2- 172.21.15.1:0/2477117441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c103740 0x7f064c107b80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 --2- 172.21.15.1:0/2477117441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f064c102d90 0x7f064c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 -- 172.21.15.1:0/2477117441 >> 172.21.15.1:0/2477117441 conn(0x7f064c0fc7d0 msgr2=0x7f064c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 -- 172.21.15.1:0/2477117441 shutdown_connections 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 -- 172.21.15.1:0/2477117441 wait complete. 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.464+0000 7f0650f06640 1 Processor -- start 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f0650f06640 1 -- start start 2024-09-19T09:02:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f0650f06640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c102d90 0x7f064c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f0650f06640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f064c103740 0x7f064c198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f0650f06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f064c108290 0x7f064c19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f0650f06640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f064c1121b0 con 0x7f064c102d90 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f0650f06640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f064c112030 con 0x7f064c108290 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f0650f06640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f064c112330 con 0x7f064c103740 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c102d90 0x7f064c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c102d90 0x7f064c198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43906/0 (socket says 172.21.15.1:43906) 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 -- 172.21.15.1:0/2360771558 learned_addr learned my addr 172.21.15.1:0/2360771558 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064ad9d640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f064c108290 0x7f064c19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f0649d9b640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f064c103740 0x7f064c198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 -- 172.21.15.1:0/2360771558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f064c103740 msgr2=0x7f064c198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f064c103740 0x7f064c198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 -- 172.21.15.1:0/2360771558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f064c108290 msgr2=0x7f064c19cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f064c108290 0x7f064c19cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 -- 172.21.15.1:0/2360771558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c19d5c0 con 0x7f064c102d90 2024-09-19T09:02:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.465+0000 7f064a59c640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c102d90 0x7f064c198610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f063c00eab0 tx=0x7f063c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.466+0000 7f063b7fe640 1 -- 172.21.15.1:0/2360771558 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c00ce40 con 0x7f064c102d90 2024-09-19T09:02:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.466+0000 7f063b7fe640 1 -- 172.21.15.1:0/2360771558 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f063c011970 con 0x7f064c102d90 2024-09-19T09:02:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.466+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c19d8b0 con 0x7f064c102d90 2024-09-19T09:02:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.466+0000 7f063b7fe640 1 -- 172.21.15.1:0/2360771558 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c010bb0 con 0x7f064c102d90 2024-09-19T09:02:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.466+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c1a5190 con 0x7f064c102d90 2024-09-19T09:02:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.467+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064c06a7f0 con 0x7f064c102d90 2024-09-19T09:02:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.468+0000 7f063b7fe640 1 -- 172.21.15.1:0/2360771558 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f063c010d50 con 0x7f064c102d90 2024-09-19T09:02:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.469+0000 7f063b7fe640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f06340a32d0 0x7f06340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.469+0000 7f0649d9b640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f06340a32d0 0x7f06340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.469+0000 7f063b7fe640 1 -- 172.21.15.1:0/2360771558 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f063c0d0150 con 0x7f064c102d90 2024-09-19T09:02:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.469+0000 7f0649d9b640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f06340a32d0 0x7f06340a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0640006010 tx=0x7f0640009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.473+0000 7f063b7fe640 1 -- 172.21.15.1:0/2360771558 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f063c016030 con 0x7f064c102d90 2024-09-19T09:02:31.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.699+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f064c10a2a0 con 0x7f064c102d90 2024-09-19T09:02:31.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.704+0000 7f063b7fe640 1 -- 172.21.15.1:0/2360771558 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264037 (secure 0 0 0) 0x7f063c09cc90 con 0x7f064c102d90 2024-09-19T09:02:31.708 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:31.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f06340a32d0 msgr2=0x7f06340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f06340a32d0 0x7f06340a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0640006010 tx=0x7f0640009610 comp rx=0 tx=0).stop 2024-09-19T09:02:31.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c102d90 msgr2=0x7f064c198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:31.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c102d90 0x7f064c198610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f063c00eab0 tx=0x7f063c00ef70 comp rx=0 tx=0).stop 2024-09-19T09:02:31.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 shutdown_connections 2024-09-19T09:02:31.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f064c108290 0x7f064c19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f06340a32d0 0x7f06340a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f064c103740 0x7f064c198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 --2- 172.21.15.1:0/2360771558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f064c102d90 0x7f064c198610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:31.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 >> 172.21.15.1:0/2360771558 conn(0x7f064c0fc7d0 msgr2=0x7f064c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:31.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 shutdown_connections 2024-09-19T09:02:31.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:31.708+0000 7f0650f06640 1 -- 172.21.15.1:0/2360771558 wait complete. 2024-09-19T09:02:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:31 smithi001 ceph-mon[30939]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-19T09:02:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:31 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2360771558' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:02:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:31 smithi064 ceph-mon[35179]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-19T09:02:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:31 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2360771558' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:02:32.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:31 smithi022 ceph-mon[35107]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-19T09:02:32.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:31 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2360771558' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:02:32.349 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":554641341},{"type":"v1","addr":"172.21.15.1:6801","nonce":554641341}]},"active_addr":"172.21.15.1:6801/554641341","active_change":"2024-09-19T08:55:09.857153+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.1:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1715378460}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1895823207}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":834753591}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2627107171}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3991010860}]}]} 2024-09-19T09:02:32.355 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T09:02:32.355 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T09:02:32.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:02:32.612 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.053+0000 7f43f2437640 1 -- 172.21.15.1:0/2613463493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec1036e0 msgr2=0x7f43ec107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.053+0000 7f43f2437640 1 --2- 172.21.15.1:0/2613463493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec1036e0 0x7f43ec107b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009930 tx=0x7f43e002a420 comp rx=0 tx=0).stop 2024-09-19T09:02:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 -- 172.21.15.1:0/2613463493 shutdown_connections 2024-09-19T09:02:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 --2- 172.21.15.1:0/2613463493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec1082a0 0x7f43ec10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 --2- 172.21.15.1:0/2613463493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec1036e0 0x7f43ec107b90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 --2- 172.21.15.1:0/2613463493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec102d30 0x7f43ec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 -- 172.21.15.1:0/2613463493 >> 172.21.15.1:0/2613463493 conn(0x7f43ec0fc7d0 msgr2=0x7f43ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 -- 172.21.15.1:0/2613463493 shutdown_connections 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 -- 172.21.15.1:0/2613463493 wait complete. 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 Processor -- start 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.054+0000 7f43f2437640 1 -- start start 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f2437640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec102d30 0x7f43ec19e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f2437640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec1036e0 0x7f43ec19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f2437640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1082a0 0x7f43ec198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f2437640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112280 con 0x7f43ec102d30 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f2437640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112100 con 0x7f43ec1082a0 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f2437640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112400 con 0x7f43ec1036e0 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec102d30 0x7f43ec19e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec102d30 0x7f43ec19e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52444/0 (socket says 172.21.15.1:52444) 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 -- 172.21.15.1:0/824600900 learned_addr learned my addr 172.21.15.1:0/824600900 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43eb7fe640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec1036e0 0x7f43ec19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f09d4640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1082a0 0x7f43ec198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 -- 172.21.15.1:0/824600900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec1036e0 msgr2=0x7f43ec19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec1036e0 0x7f43ec19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 -- 172.21.15.1:0/824600900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1082a0 msgr2=0x7f43ec198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1082a0 0x7f43ec198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 -- 172.21.15.1:0/824600900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec198f80 con 0x7f43ec102d30 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f09d4640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1082a0 0x7f43ec198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43eb7fe640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec1036e0 0x7f43ec19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43ebfff640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec102d30 0x7f43ec19e640 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00b4a0 tx=0x7f43dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43e97fa640 1 -- 172.21.15.1:0/824600900 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc014070 con 0x7f43ec102d30 2024-09-19T09:02:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ec199270 con 0x7f43ec102d30 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43e97fa640 1 -- 172.21.15.1:0/824600900 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43dc010b10 con 0x7f43ec102d30 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43e97fa640 1 -- 172.21.15.1:0/824600900 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc017d60 con 0x7f43ec102d30 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.055+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ec1a55c0 con 0x7f43ec102d30 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.056+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ec06a850 con 0x7f43ec102d30 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.058+0000 7f43e97fa640 1 -- 172.21.15.1:0/824600900 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f43dc017070 con 0x7f43ec102d30 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.058+0000 7f43e97fa640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43d40a32d0 0x7f43d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.058+0000 7f43eb7fe640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43d40a32d0 0x7f43d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.059+0000 7f43e97fa640 1 -- 172.21.15.1:0/824600900 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f43dc0cf1a0 con 0x7f43ec102d30 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.059+0000 7f43eb7fe640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43d40a32d0 0x7f43d40a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009900 tx=0x7f43e0031720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.061+0000 7f43e97fa640 1 -- 172.21.15.1:0/824600900 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43dc09be50 con 0x7f43ec102d30 2024-09-19T09:02:33.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.238+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43ec199c40 con 0x7f43ec102d30 2024-09-19T09:02:33.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.239+0000 7f43e97fa640 1 -- 172.21.15.1:0/824600900 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7f43dc09b750 con 0x7f43ec102d30 2024-09-19T09:02:33.241 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:33.241 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:02:33.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43d40a32d0 msgr2=0x7f43d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:33.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43d40a32d0 0x7f43d40a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009900 tx=0x7f43e0031720 comp rx=0 tx=0).stop 2024-09-19T09:02:33.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec102d30 msgr2=0x7f43ec19e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:33.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec102d30 0x7f43ec19e640 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00b4a0 tx=0x7f43dc00b960 comp rx=0 tx=0).stop 2024-09-19T09:02:33.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 shutdown_connections 2024-09-19T09:02:33.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1082a0 0x7f43ec198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43d40a32d0 0x7f43d40a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ec1036e0 0x7f43ec19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 --2- 172.21.15.1:0/824600900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec102d30 0x7f43ec19e640 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:33.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 >> 172.21.15.1:0/824600900 conn(0x7f43ec0fc7d0 msgr2=0x7f43ec105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:33.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 shutdown_connections 2024-09-19T09:02:33.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:33.242+0000 7f43f2437640 1 -- 172.21.15.1:0/824600900 wait complete. 2024-09-19T09:02:33.852 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:33 smithi001 ceph-mon[30939]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-19T09:02:33.853 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:33 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/824600900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:33.882 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T09:02:33.882 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:02:34.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:33 smithi064 ceph-mon[35179]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-19T09:02:34.275 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:33 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/824600900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:34.276 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:33 smithi022 ceph-mon[35107]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-19T09:02:34.276 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:33 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/824600900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:34.276 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:34.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/919570890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58106f10 msgr2=0x7f0a5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/919570890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58106f10 0x7f0a5810ea90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009ca0 tx=0x7f0a5002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/919570890 shutdown_connections 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/919570890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58106f10 0x7f0a5810ea90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/919570890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a58102790 0x7f0a581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/919570890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a58101de0 0x7f0a581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/919570890 >> 172.21.15.1:0/919570890 conn(0x7f0a580fd8c0 msgr2=0x7f0a580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/919570890 shutdown_connections 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/919570890 wait complete. 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 Processor -- start 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.570+0000 7f0a5d8e1640 1 -- start start 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5d8e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a58101de0 0x7f0a58198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5d8e1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58102790 0x7f0a58198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:34.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5d8e1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a58106f10 0x7f0a5819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5d8e1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58112090 con 0x7f0a58102790 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5d8e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58111f10 con 0x7f0a58101de0 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5d8e1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58112210 con 0x7f0a58106f10 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58102790 0x7f0a58198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58102790 0x7f0a58198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52456/0 (socket says 172.21.15.1:52456) 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 -- 172.21.15.1:0/757648333 learned_addr learned my addr 172.21.15.1:0/757648333 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a56ffd640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a58101de0 0x7f0a58198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a577fe640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a58106f10 0x7f0a5819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 -- 172.21.15.1:0/757648333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a58106f10 msgr2=0x7f0a5819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a58106f10 0x7f0a5819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 -- 172.21.15.1:0/757648333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a58101de0 msgr2=0x7f0a58198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a58101de0 0x7f0a58198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 -- 172.21.15.1:0/757648333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5819d410 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a567fc640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58102790 0x7f0a58198a40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00d950 tx=0x7f0a4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5c8df640 1 -- 172.21.15.1:0/757648333 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c017070 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5c8df640 1 -- 172.21.15.1:0/757648333 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a4c009c30 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5819d700 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.571+0000 7f0a5c8df640 1 -- 172.21.15.1:0/757648333 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00f740 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.572+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a581a4fe0 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.573+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a581021c0 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.574+0000 7f0a5c8df640 1 -- 172.21.15.1:0/757648333 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0a4c010a80 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.574+0000 7f0a5c8df640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a400a32d0 0x7f0a400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.574+0000 7f0a56ffd640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a400a32d0 0x7f0a400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.575+0000 7f0a5c8df640 1 -- 172.21.15.1:0/757648333 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0a4c0cf5f0 con 0x7f0a58102790 2024-09-19T09:02:34.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.575+0000 7f0a56ffd640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a400a32d0 0x7f0a400a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a480058c0 tx=0x7f0a4800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:34.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.579+0000 7f0a5c8df640 1 -- 172.21.15.1:0/757648333 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a4c009de0 con 0x7f0a58102790 2024-09-19T09:02:34.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.755+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a5810a150 con 0x7f0a58102790 2024-09-19T09:02:34.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.756+0000 7f0a5c8df640 1 -- 172.21.15.1:0/757648333 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7f0a4c09bb40 con 0x7f0a58102790 2024-09-19T09:02:34.758 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:02:34.758 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a400a32d0 msgr2=0x7f0a400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a400a32d0 0x7f0a400a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a480058c0 tx=0x7f0a4800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58102790 msgr2=0x7f0a58198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58102790 0x7f0a58198a40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00d950 tx=0x7f0a4c00de10 comp rx=0 tx=0).stop 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 shutdown_connections 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a400a32d0 0x7f0a400a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a58106f10 0x7f0a5819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a58102790 0x7f0a58198a40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 --2- 172.21.15.1:0/757648333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a58101de0 0x7f0a58198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 >> 172.21.15.1:0/757648333 conn(0x7f0a580fd8c0 msgr2=0x7f0a580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:34.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 shutdown_connections 2024-09-19T09:02:34.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:34.759+0000 7f0a5d8e1640 1 -- 172.21.15.1:0/757648333 wait complete. 2024-09-19T09:02:35.521 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T09:02:35.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T09:02:35.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T09:02:35.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T09:02:35.523 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T09:02:35.523 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T09:02:35.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T09:02:35.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T09:02:35.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T09:02:35.525 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T09:02:35.526 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T09:02:35.526 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T09:02:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:35 smithi001 ceph-mon[30939]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-19T09:02:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:35 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/757648333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:36.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:35 smithi064 ceph-mon[35179]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-19T09:02:36.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:35 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/757648333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:36.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:35 smithi022 ceph-mon[35107]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-19T09:02:36.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:35 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/757648333' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:02:36.375 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.376 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.377 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.381 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.386 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.386 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.391 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.391 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:36.424 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:37.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 -- 172.21.15.1:0/2364656820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 msgr2=0x7fc5d0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:37.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 --2- 172.21.15.1:0/2364656820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 0x7fc5d0106e60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009930 tx=0x7fc5cc02a420 comp rx=0 tx=0).stop 2024-09-19T09:02:37.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 -- 172.21.15.1:0/2364656820 shutdown_connections 2024-09-19T09:02:37.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 --2- 172.21.15.1:0/2364656820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d0101420 0x7fc5d010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:37.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 --2- 172.21.15.1:0/2364656820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0100a80 0x7fc5d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:37.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 --2- 172.21.15.1:0/2364656820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 0x7fc5d0106e60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:37.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 -- 172.21.15.1:0/2364656820 >> 172.21.15.1:0/2364656820 conn(0x7fc5d00fc7a0 msgr2=0x7fc5d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:37.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 -- 172.21.15.1:0/2364656820 shutdown_connections 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.467+0000 7fc5d7a47640 1 -- 172.21.15.1:0/2364656820 wait complete. 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d7a47640 1 Processor -- start 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d7a47640 1 -- start start 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d7a47640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0100a80 0x7fc5d010e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d7a47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d0101420 0x7fc5d010eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d7a47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 0x7fc5d010f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d7a47640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d01120e0 con 0x7fc5d0106a80 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d7a47640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0111f60 con 0x7fc5d0101420 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d7a47640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0112260 con 0x7fc5d0100a80 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d5fe4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 0x7fc5d010f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d5fe4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 0x7fc5d010f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52494/0 (socket says 172.21.15.1:52494) 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d5fe4640 1 -- 172.21.15.1:0/193202074 learned_addr learned my addr 172.21.15.1:0/193202074 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d57e3640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0100a80 0x7fc5d010e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d4fe2640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d0101420 0x7fc5d010eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d5fe4640 1 -- 172.21.15.1:0/193202074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0100a80 msgr2=0x7fc5d010e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d5fe4640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0100a80 0x7fc5d010e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d5fe4640 1 -- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d0101420 msgr2=0x7fc5d010eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d5fe4640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d0101420 0x7fc5d010eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d5fe4640 1 -- 172.21.15.1:0/193202074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d01a6a60 con 0x7fc5d0106a80 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d4fe2640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc5d0101420 0x7fc5d010eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.468+0000 7fc5d57e3640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc5d0100a80 0x7fc5d010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.469+0000 7fc5d5fe4640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 0x7fc5d010f090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800eaa0 tx=0x7fc5c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.469+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800cdb0 con 0x7fc5d0106a80 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.469+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc5c8004b20 con 0x7fc5d0106a80 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.469+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8011760 con 0x7fc5d0106a80 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.469+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d01a6d50 con 0x7fc5d0106a80 2024-09-19T09:02:37.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.469+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d01a7240 con 0x7fc5d0106a80 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.470+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5d00628c0 con 0x7fc5d0106a80 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.471+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc5c8011900 con 0x7fc5d0106a80 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.472+0000 7fc5c67fc640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc5bc0a3350 0x7fc5bc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.472+0000 7fc5d57e3640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc5bc0a3350 0x7fc5bc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.472+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc5c80d01a0 con 0x7fc5d0106a80 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.472+0000 7fc5c67fc640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] conn(0x7fc5bc0ad000 0x7fc5bc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.472+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 --> [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5c8014ec0 con 0x7fc5bc0ad000 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.472+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fc5c80d05f0 con 0x7fc5d0106a80 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.472+0000 7fc5d57e3640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc5bc0a3350 0x7fc5bc0a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc000c00 tx=0x7fc5cc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.472+0000 7fc5d4fe2640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] conn(0x7fc5bc0ad000 0x7fc5bc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:37.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.473+0000 7fc5d4fe2640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] conn(0x7fc5bc0ad000 0x7fc5bc0af4a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:37.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.474+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 <== osd.7 v2:172.21.15.22:6816/1285451266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5c8014ec0 con 0x7fc5bc0ad000 2024-09-19T09:02:37.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.487+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 --> [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5d0062d40 con 0x7fc5bc0ad000 2024-09-19T09:02:37.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5c67fc640 1 -- 172.21.15.1:0/193202074 <== osd.7 v2:172.21.15.22:6816/1285451266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc5d0062d40 con 0x7fc5bc0ad000 2024-09-19T09:02:37.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] conn(0x7fc5bc0ad000 msgr2=0x7fc5bc0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:37.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] conn(0x7fc5bc0ad000 0x7fc5bc0af4a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:37.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc5bc0a3350 msgr2=0x7fc5bc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:37.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc5bc0a3350 0x7fc5bc0a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc000c00 tx=0x7fc5cc005a20 comp rx=0 tx=0).stop 2024-09-19T09:02:37.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 msgr2=0x7fc5d010f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:37.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 --2- 172.21.15.1:0/193202074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5d0106a80 0x7fc5d010f090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800eaa0 tx=0x7fc5c800ef60 comp rx=0 tx=0).stop 2024-09-19T09:02:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d5fe4640 1 -- 172.21.15.1:0/193202074 reap_dead start 2024-09-19T09:02:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 shutdown_connections 2024-09-19T09:02:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 >> 172.21.15.1:0/193202074 conn(0x7fc5d00fc7a0 msgr2=0x7fc5d00fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 shutdown_connections 2024-09-19T09:02:37.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.488+0000 7fc5d7a47640 1 -- 172.21.15.1:0/193202074 wait complete. 2024-09-19T09:02:37.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:37 smithi001 ceph-mon[30939]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-09-19T09:02:38.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:37 smithi064 ceph-mon[35179]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-09-19T09:02:38.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:37 smithi022 ceph-mon[35107]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 9 op/s 2024-09-19T09:02:39.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 -- 172.21.15.1:0/83414409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 msgr2=0x7f3b1c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 --2- 172.21.15.1:0/83414409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 0x7f3b1c1067e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009900 tx=0x7f3b0402a410 comp rx=0 tx=0).stop 2024-09-19T09:02:39.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 -- 172.21.15.1:0/83414409 shutdown_connections 2024-09-19T09:02:39.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 --2- 172.21.15.1:0/83414409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b1c106f10 0x7f3b1c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 --2- 172.21.15.1:0/83414409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 0x7f3b1c1067e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 --2- 172.21.15.1:0/83414409 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1c101de0 0x7f3b1c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 -- 172.21.15.1:0/83414409 >> 172.21.15.1:0/83414409 conn(0x7f3b1c0fd8c0 msgr2=0x7f3b1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 -- 172.21.15.1:0/83414409 shutdown_connections 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.623+0000 7f3b21211640 1 -- 172.21.15.1:0/83414409 wait complete. 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b21211640 1 Processor -- start 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b21211640 1 -- start start 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b21211640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b1c101de0 0x7f3b1c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b21211640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 0x7f3b1c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b21211640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1c106f10 0x7f3b1c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b21211640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c112050 con 0x7f3b1c102790 2024-09-19T09:02:39.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b21211640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c111ed0 con 0x7f3b1c101de0 2024-09-19T09:02:39.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b21211640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1121d0 con 0x7f3b1c106f10 2024-09-19T09:02:39.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 0x7f3b1c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b13fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 0x7f3b1c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52514/0 (socket says 172.21.15.1:52514) 2024-09-19T09:02:39.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b13fff640 1 -- 172.21.15.1:0/3361421998 learned_addr learned my addr 172.21.15.1:0/3361421998 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:39.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b1ad9d640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b1c101de0 0x7f3b1c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b1b59e640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1c106f10 0x7f3b1c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b13fff640 1 -- 172.21.15.1:0/3361421998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1c106f10 msgr2=0x7f3b1c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b13fff640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3b1c106f10 0x7f3b1c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b13fff640 1 -- 172.21.15.1:0/3361421998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b1c101de0 msgr2=0x7f3b1c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b13fff640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b1c101de0 0x7f3b1c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.624+0000 7f3b13fff640 1 -- 172.21.15.1:0/3361421998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c19d4e0 con 0x7f3b1c102790 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.625+0000 7f3b13fff640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 0x7f3b1c198a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b04006010 tx=0x7f3b040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.625+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0403f030 con 0x7f3b1c102790 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.625+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3b04003d00 con 0x7f3b1c102790 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.625+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c19d770 con 0x7f3b1c102790 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.625+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04035070 con 0x7f3b1c102790 2024-09-19T09:02:39.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.625+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c1a50b0 con 0x7f3b1c102790 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.626+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b1c0fee00 con 0x7f3b1c102790 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.627+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3b04042030 con 0x7f3b1c102790 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.628+0000 7f3b18d99640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3b080a32d0 0x7f3b080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.628+0000 7f3b1ad9d640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3b080a32d0 0x7f3b080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.628+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3b040f0810 con 0x7f3b1c102790 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.628+0000 7f3b18d99640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] conn(0x7f3b080acf80 0x7f3b080af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.628+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 --> [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b080afaf0 con 0x7f3b080acf80 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.628+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f3b040f0c60 con 0x7f3b1c102790 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.628+0000 7f3b1ad9d640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3b080a32d0 0x7f3b080a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00abe0 tx=0x7f3b0c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.628+0000 7f3b1b59e640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] conn(0x7f3b080acf80 0x7f3b080af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.629+0000 7f3b1b59e640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] conn(0x7f3b080acf80 0x7f3b080af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:39.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.630+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 <== osd.11 v2:172.21.15.64:6824/1960106906 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b080afaf0 con 0x7f3b080acf80 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.644+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 --> [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b1c1032c0 con 0x7f3b080acf80 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b18d99640 1 -- 172.21.15.1:0/3361421998 <== osd.11 v2:172.21.15.64:6824/1960106906 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3b1c1032c0 con 0x7f3b080acf80 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 >> [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] conn(0x7f3b080acf80 msgr2=0x7f3b080af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] conn(0x7f3b080acf80 0x7f3b080af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3b080a32d0 msgr2=0x7f3b080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3b080a32d0 0x7f3b080a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00abe0 tx=0x7f3b0c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 msgr2=0x7f3b1c198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 --2- 172.21.15.1:0/3361421998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c102790 0x7f3b1c198a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b04006010 tx=0x7f3b040042f0 comp rx=0 tx=0).stop 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b1b59e640 1 -- 172.21.15.1:0/3361421998 reap_dead start 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 shutdown_connections 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 >> 172.21.15.1:0/3361421998 conn(0x7f3b1c0fd8c0 msgr2=0x7f3b1c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:39.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 shutdown_connections 2024-09-19T09:02:39.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:38.645+0000 7f3b21211640 1 -- 172.21.15.1:0/3361421998 wait complete. 2024-09-19T09:02:39.884 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:39 smithi001 ceph-mon[30939]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:02:39.917 INFO:teuthology.orchestra.run.smithi001.stdout:309237645332 2024-09-19T09:02:39.917 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T09:02:40.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:39 smithi064 ceph-mon[35179]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:02:40.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:39 smithi022 ceph-mon[35107]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:02:40.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 -- 172.21.15.1:0/2577880460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c100a80 msgr2=0x7f0f1c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 --2- 172.21.15.1:0/2577880460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c100a80 0x7f0f1c100ee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009930 tx=0x7f0f1002a420 comp rx=0 tx=0).stop 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 -- 172.21.15.1:0/2577880460 shutdown_connections 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 --2- 172.21.15.1:0/2577880460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f1c101420 0x7f0f1c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 --2- 172.21.15.1:0/2577880460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c100a80 0x7f0f1c100ee0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 --2- 172.21.15.1:0/2577880460 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f1c106a80 0x7f0f1c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 -- 172.21.15.1:0/2577880460 >> 172.21.15.1:0/2577880460 conn(0x7f0f1c0fc7a0 msgr2=0x7f0f1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 -- 172.21.15.1:0/2577880460 shutdown_connections 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.400+0000 7f0f246eb640 1 -- 172.21.15.1:0/2577880460 wait complete. 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f246eb640 1 Processor -- start 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f246eb640 1 -- start start 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f246eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f1c100a80 0x7f0f1c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f246eb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f1c101420 0x7f0f1c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f246eb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c106a80 0x7f0f1c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f246eb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c110fa0 con 0x7f0f1c106a80 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f246eb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c110e20 con 0x7f0f1c100a80 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f246eb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c111120 con 0x7f0f1c101420 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f22c88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c106a80 0x7f0f1c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f22487640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f1c100a80 0x7f0f1c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f22c88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c106a80 0x7f0f1c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52548/0 (socket says 172.21.15.1:52548) 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f22c88640 1 -- 172.21.15.1:0/101725926 learned_addr learned my addr 172.21.15.1:0/101725926 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.401+0000 7f0f21c86640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f1c101420 0x7f0f1c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f22487640 1 -- 172.21.15.1:0/101725926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f1c101420 msgr2=0x7f0f1c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f22487640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f1c101420 0x7f0f1c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f22487640 1 -- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c106a80 msgr2=0x7f0f1c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f22487640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c106a80 0x7f0f1c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f22487640 1 -- 172.21.15.1:0/101725926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c19d4e0 con 0x7f0f1c100a80 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f22c88640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0f1c106a80 0x7f0f1c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f22487640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f1c100a80 0x7f0f1c198530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800d6d0 tx=0x7f0f1800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18017070 con 0x7f0f1c100a80 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c19d7d0 con 0x7f0f1c100a80 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0f18009820 con 0x7f0f1c100a80 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18004e00 con 0x7f0f1c100a80 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.402+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c1a50b0 con 0x7f0f1c100a80 2024-09-19T09:02:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.403+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f1c0fd180 con 0x7f0f1c100a80 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.404+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0f180099d0 con 0x7f0f1c100a80 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.405+0000 7f0f0f7fe640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0f080a32d0 0x7f0f080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.405+0000 7f0f21c86640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0f080a32d0 0x7f0f080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.405+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0f180cf8e0 con 0x7f0f1c100a80 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.405+0000 7f0f0f7fe640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] conn(0x7f0f080acf70 0x7f0f080af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.405+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 --> [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f18009090 con 0x7f0f080acf70 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.405+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f0f180cfc90 con 0x7f0f1c100a80 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.406+0000 7f0f22c88640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] conn(0x7f0f080acf70 0x7f0f080af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.406+0000 7f0f21c86640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0f080a32d0 0x7f0f080a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009900 tx=0x7f0f100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.406+0000 7f0f22c88640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] conn(0x7f0f080acf70 0x7f0f080af410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.407+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 <== osd.3 v2:172.21.15.1:6810/4215889166 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f18009090 con 0x7f0f080acf70 2024-09-19T09:02:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 --> [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f1c1021c0 con 0x7f0f080acf70 2024-09-19T09:02:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f0f7fe640 1 -- 172.21.15.1:0/101725926 <== osd.3 v2:172.21.15.1:6810/4215889166 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0f1c1021c0 con 0x7f0f080acf70 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] conn(0x7f0f080acf70 msgr2=0x7f0f080af410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] conn(0x7f0f080acf70 0x7f0f080af410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0f080a32d0 msgr2=0x7f0f080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0f080a32d0 0x7f0f080a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009900 tx=0x7f0f100058d0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f1c100a80 msgr2=0x7f0f1c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 --2- 172.21.15.1:0/101725926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f1c100a80 0x7f0f1c198530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800d6d0 tx=0x7f0f1800db90 comp rx=0 tx=0).stop 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f22c88640 1 -- 172.21.15.1:0/101725926 reap_dead start 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 shutdown_connections 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 >> 172.21.15.1:0/101725926 conn(0x7f0f1c0fc7a0 msgr2=0x7f0f1c104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 shutdown_connections 2024-09-19T09:02:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.424+0000 7f0f246eb640 1 -- 172.21.15.1:0/101725926 wait complete. 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.612+0000 7ff4e91ba640 1 -- 172.21.15.1:0/1286326675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 msgr2=0x7ff4e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.612+0000 7ff4e91ba640 1 --2- 172.21.15.1:0/1286326675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 0x7ff4e410da40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009ca0 tx=0x7ff4dc02a950 comp rx=0 tx=0).stop 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.612+0000 7ff4e91ba640 1 -- 172.21.15.1:0/1286326675 shutdown_connections 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.612+0000 7ff4e91ba640 1 --2- 172.21.15.1:0/1286326675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 0x7ff4e410da40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.612+0000 7ff4e91ba640 1 --2- 172.21.15.1:0/1286326675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e4102570 0x7ff4e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.612+0000 7ff4e91ba640 1 --2- 172.21.15.1:0/1286326675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4e4100e20 0x7ff4e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.612+0000 7ff4e91ba640 1 -- 172.21.15.1:0/1286326675 >> 172.21.15.1:0/1286326675 conn(0x7ff4e40fc7d0 msgr2=0x7ff4e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.613+0000 7ff4e91ba640 1 -- 172.21.15.1:0/1286326675 shutdown_connections 2024-09-19T09:02:40.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.613+0000 7ff4e91ba640 1 -- 172.21.15.1:0/1286326675 wait complete. 2024-09-19T09:02:40.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.613+0000 7ff4e91ba640 1 Processor -- start 2024-09-19T09:02:40.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e91ba640 1 -- start start 2024-09-19T09:02:40.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e91ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e4100e20 0x7ff4e41a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e91ba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4e4102570 0x7ff4e41a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e91ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 0x7ff4e419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e91ba640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e41110a0 con 0x7ff4e4102ef0 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e91ba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e4110f20 con 0x7ff4e4100e20 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e91ba640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e4111220 con 0x7ff4e4102570 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e4100e20 0x7ff4e41a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 0x7ff4e419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e4100e20 0x7ff4e41a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51402/0 (socket says 172.21.15.1:51402) 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e2d9d640 1 -- 172.21.15.1:0/954824550 learned_addr learned my addr 172.21.15.1:0/954824550 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:40.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 0x7ff4e419ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52566/0 (socket says 172.21.15.1:52566) 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e259c640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4e4102570 0x7ff4e41a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e2d9d640 1 -- 172.21.15.1:0/954824550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4e4102570 msgr2=0x7ff4e41a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e2d9d640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4e4102570 0x7ff4e41a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.614+0000 7ff4e2d9d640 1 -- 172.21.15.1:0/954824550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 msgr2=0x7ff4e419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4e2d9d640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 0x7ff4e419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4e2d9d640 1 -- 172.21.15.1:0/954824550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e419f470 con 0x7ff4e4100e20 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4e359e640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e4102ef0 0x7ff4e419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4e2d9d640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e4100e20 0x7ff4e41a4740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400d950 tx=0x7ff4d400dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4017070 con 0x7ff4e4100e20 2024-09-19T09:02:40.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4d400de80 con 0x7ff4e4100e20 2024-09-19T09:02:40.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d400f620 con 0x7ff4e4100e20 2024-09-19T09:02:40.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e419f760 con 0x7ff4e4100e20 2024-09-19T09:02:40.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.615+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e41ab610 con 0x7ff4e4100e20 2024-09-19T09:02:40.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.616+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4e406a9d0 con 0x7ff4e4100e20 2024-09-19T09:02:40.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.617+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff4d4009c30 con 0x7ff4e4100e20 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.618+0000 7ff4cbfff640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff4cc0a32d0 0x7ff4cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.619+0000 7ff4e259c640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff4cc0a32d0 0x7ff4cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.619+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff4d40cfba0 con 0x7ff4e4100e20 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.619+0000 7ff4cbfff640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] conn(0x7ff4cc0acf80 0x7ff4cc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.619+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 --> [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4cc0afaf0 con 0x7ff4cc0acf80 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.619+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff4d40cff50 con 0x7ff4e4100e20 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.619+0000 7ff4e259c640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff4cc0a32d0 0x7ff4cc0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4107740 tx=0x7ff4d800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.619+0000 7ff4e359e640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] conn(0x7ff4cc0acf80 0x7ff4cc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.619+0000 7ff4e359e640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] conn(0x7ff4cc0acf80 0x7ff4cc0af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.620+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 <== osd.4 v2:172.21.15.22:6808/2803831833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4cc0afaf0 con 0x7ff4cc0acf80 2024-09-19T09:02:40.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.634+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 --> [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4e41021b0 con 0x7ff4cc0acf80 2024-09-19T09:02:40.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.634+0000 7ff4cbfff640 1 -- 172.21.15.1:0/954824550 <== osd.4 v2:172.21.15.22:6808/2803831833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff4e41021b0 con 0x7ff4cc0acf80 2024-09-19T09:02:40.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 >> [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] conn(0x7ff4cc0acf80 msgr2=0x7ff4cc0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] conn(0x7ff4cc0acf80 0x7ff4cc0af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff4cc0a32d0 msgr2=0x7ff4cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff4cc0a32d0 0x7ff4cc0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4107740 tx=0x7ff4d800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e4100e20 msgr2=0x7ff4e41a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 --2- 172.21.15.1:0/954824550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e4100e20 0x7ff4e41a4740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400d950 tx=0x7ff4d400dd50 comp rx=0 tx=0).stop 2024-09-19T09:02:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e359e640 1 -- 172.21.15.1:0/954824550 reap_dead start 2024-09-19T09:02:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 shutdown_connections 2024-09-19T09:02:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 >> 172.21.15.1:0/954824550 conn(0x7ff4e40fc7d0 msgr2=0x7ff4e4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 shutdown_connections 2024-09-19T09:02:40.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.635+0000 7ff4e91ba640 1 -- 172.21.15.1:0/954824550 wait complete. 2024-09-19T09:02:40.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3045138349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00106f20 msgr2=0x7ffa0010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 --2- 172.21.15.1:0/3045138349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00106f20 0x7ffa0010eaa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009ca0 tx=0x7ff9f802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3045138349 shutdown_connections 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 --2- 172.21.15.1:0/3045138349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00106f20 0x7ffa0010eaa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 --2- 172.21.15.1:0/3045138349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa001027a0 0x7ffa001067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 --2- 172.21.15.1:0/3045138349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa00101df0 0x7ffa001021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3045138349 >> 172.21.15.1:0/3045138349 conn(0x7ffa000fd8f0 msgr2=0x7ffa000ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3045138349 shutdown_connections 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3045138349 wait complete. 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 Processor -- start 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.388+0000 7ffa06d2d640 1 -- start start 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa06d2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00101df0 0x7ffa00198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa06d2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa001027a0 0x7ffa00198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa06d2d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa00106f20 0x7ffa0019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa06d2d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffa001120e0 con 0x7ffa00101df0 2024-09-19T09:02:40.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa06d2d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00111f60 con 0x7ffa001027a0 2024-09-19T09:02:40.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa06d2d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00112260 con 0x7ffa00106f20 2024-09-19T09:02:40.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00101df0 0x7ffa00198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00101df0 0x7ffa00198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52478/0 (socket says 172.21.15.1:52478) 2024-09-19T09:02:40.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 -- 172.21.15.1:0/3443522378 learned_addr learned my addr 172.21.15.1:0/3443522378 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:40.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ff9fffff640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa001027a0 0x7ffa00198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa052ca640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa00106f20 0x7ffa0019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 -- 172.21.15.1:0/3443522378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa00106f20 msgr2=0x7ffa0019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa00106f20 0x7ffa0019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 -- 172.21.15.1:0/3443522378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa001027a0 msgr2=0x7ffa00198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa001027a0 0x7ffa00198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 -- 172.21.15.1:0/3443522378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0019d4e0 con 0x7ffa00101df0 2024-09-19T09:02:40.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa052ca640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa00106f20 0x7ffa0019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:40.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.389+0000 7ffa04ac9640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00101df0 0x7ffa00198530 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400d950 tx=0x7ff9f400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.390+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4017070 con 0x7ffa00101df0 2024-09-19T09:02:40.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.390+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0019d7d0 con 0x7ffa00101df0 2024-09-19T09:02:40.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.390+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9f400de80 con 0x7ffa00101df0 2024-09-19T09:02:40.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.390+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400f620 con 0x7ffa00101df0 2024-09-19T09:02:40.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.390+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa001a50b0 con 0x7ffa00101df0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.391+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa00062980 con 0x7ffa00101df0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.392+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff9f4009c30 con 0x7ffa00101df0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.392+0000 7ff9fdffb640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9f00a32d0 0x7ff9f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.393+0000 7ff9fffff640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9f00a32d0 0x7ff9f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.393+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff9f40cfc50 con 0x7ffa00101df0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.393+0000 7ff9fdffb640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] conn(0x7ff9f00acf80 0x7ff9f00af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.393+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 --> [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9f00afaf0 con 0x7ff9f00acf80 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.393+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff9f40d0000 con 0x7ffa00101df0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.393+0000 7ffa052ca640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] conn(0x7ff9f00acf80 0x7ff9f00af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.393+0000 7ff9fffff640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9f00a32d0 0x7ff9f00a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa001088c0 tx=0x7ff9ec009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.393+0000 7ffa052ca640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] conn(0x7ff9f00acf80 0x7ff9f00af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.394+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 <== osd.6 v2:172.21.15.1:6818/146026551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9f00afaf0 con 0x7ff9f00acf80 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.408+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 --> [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa00062d80 con 0x7ff9f00acf80 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.408+0000 7ff9fdffb640 1 -- 172.21.15.1:0/3443522378 <== osd.6 v2:172.21.15.1:6818/146026551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffa00062d80 con 0x7ff9f00acf80 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] conn(0x7ff9f00acf80 msgr2=0x7ff9f00af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] conn(0x7ff9f00acf80 0x7ff9f00af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9f00a32d0 msgr2=0x7ff9f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9f00a32d0 0x7ff9f00a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa001088c0 tx=0x7ff9ec009110 comp rx=0 tx=0).stop 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00101df0 msgr2=0x7ffa00198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 --2- 172.21.15.1:0/3443522378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa00101df0 0x7ffa00198530 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400d950 tx=0x7ff9f400dd50 comp rx=0 tx=0).stop 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa052ca640 1 -- 172.21.15.1:0/3443522378 reap_dead start 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 shutdown_connections 2024-09-19T09:02:40.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 >> 172.21.15.1:0/3443522378 conn(0x7ffa000fd8f0 msgr2=0x7ffa000fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 shutdown_connections 2024-09-19T09:02:40.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:37.409+0000 7ffa06d2d640 1 -- 172.21.15.1:0/3443522378 wait complete. 2024-09-19T09:02:40.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.319+0000 7f58f163e640 1 -- 172.21.15.1:0/976478258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 msgr2=0x7f58ec10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.319+0000 7f58f163e640 1 --2- 172.21.15.1:0/976478258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 0x7f58ec10e610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009ca0 tx=0x7f58e402a950 comp rx=0 tx=0).stop 2024-09-19T09:02:40.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.319+0000 7f58f163e640 1 -- 172.21.15.1:0/976478258 shutdown_connections 2024-09-19T09:02:40.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.319+0000 7f58f163e640 1 --2- 172.21.15.1:0/976478258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 0x7f58ec10e610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.319+0000 7f58f163e640 1 --2- 172.21.15.1:0/976478258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ec103660 0x7f58ec10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.319+0000 7f58f163e640 1 --2- 172.21.15.1:0/976478258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58ec102d40 0x7f58ec103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.319+0000 7f58f163e640 1 -- 172.21.15.1:0/976478258 >> 172.21.15.1:0/976478258 conn(0x7f58ec0fc7a0 msgr2=0x7f58ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.319+0000 7f58f163e640 1 -- 172.21.15.1:0/976478258 shutdown_connections 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.320+0000 7f58f163e640 1 -- 172.21.15.1:0/976478258 wait complete. 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.320+0000 7f58f163e640 1 Processor -- start 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.320+0000 7f58f163e640 1 -- start start 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58f163e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58ec102d40 0x7f58ec1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58f163e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ec103660 0x7f58ec100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58f163e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 0x7f58ec101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58f163e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec112170 con 0x7f58ec10c170 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58f163e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec111ff0 con 0x7f58ec102d40 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58f163e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec1122f0 con 0x7f58ec103660 2024-09-19T09:02:40.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 0x7f58ec101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 0x7f58ec101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52536/0 (socket says 172.21.15.1:52536) 2024-09-19T09:02:40.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 -- 172.21.15.1:0/421940938 learned_addr learned my addr 172.21.15.1:0/421940938 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:40.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58e27fc640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ec103660 0x7f58ec100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eaffd640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58ec102d40 0x7f58ec1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 -- 172.21.15.1:0/421940938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ec103660 msgr2=0x7f58ec100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58ec103660 0x7f58ec100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 -- 172.21.15.1:0/421940938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58ec102d40 msgr2=0x7f58ec1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58ec102d40 0x7f58ec1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 -- 172.21.15.1:0/421940938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec1a6ad0 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.321+0000 7f58eb7fe640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 0x7f58ec101420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f58e4005cc0 tx=0x7f58e4030e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.322+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4034040 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.322+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f58e4003e00 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.322+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4045480 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.322+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec1a6d60 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.322+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec1a71f0 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.323+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f58ec0fe7b0 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.325+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f58e4037020 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.325+0000 7f58e8ff9640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58d80a32d0 0x7f58d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.326+0000 7f58eaffd640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58d80a32d0 0x7f58d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.326+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f58e40f0ff0 con 0x7f58ec10c170 2024-09-19T09:02:40.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.326+0000 7f58e8ff9640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] conn(0x7f58d80acf80 0x7f58d80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.326+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 --> [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58e402c030 con 0x7f58d80acf80 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.326+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f58e40f1400 con 0x7f58ec10c170 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.326+0000 7f58e27fc640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] conn(0x7f58d80acf80 0x7f58d80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.326+0000 7f58eaffd640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58d80a32d0 0x7f58d80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009a10 tx=0x7f58dc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.326+0000 7f58e27fc640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] conn(0x7f58d80acf80 0x7f58d80af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.327+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 <== osd.9 v2:172.21.15.1:6826/1622106901 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f58e402c030 con 0x7f58d80acf80 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.355+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 --> [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f58ec06b070 con 0x7f58d80acf80 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.355+0000 7f58e8ff9640 1 -- 172.21.15.1:0/421940938 <== osd.9 v2:172.21.15.1:6826/1622106901 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f58ec06b070 con 0x7f58d80acf80 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] conn(0x7f58d80acf80 msgr2=0x7f58d80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] conn(0x7f58d80acf80 0x7f58d80af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58d80a32d0 msgr2=0x7f58d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58d80a32d0 0x7f58d80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009a10 tx=0x7f58dc009110 comp rx=0 tx=0).stop 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 msgr2=0x7f58ec101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:40.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 --2- 172.21.15.1:0/421940938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ec10c170 0x7f58ec101420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f58e4005cc0 tx=0x7f58e4030e10 comp rx=0 tx=0).stop 2024-09-19T09:02:40.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58eb7fe640 1 -- 172.21.15.1:0/421940938 reap_dead start 2024-09-19T09:02:40.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 shutdown_connections 2024-09-19T09:02:40.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 >> 172.21.15.1:0/421940938 conn(0x7f58ec0fc7a0 msgr2=0x7f58ec0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:40.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 shutdown_connections 2024-09-19T09:02:40.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:40.356+0000 7f58f163e640 1 -- 172.21.15.1:0/421940938 wait complete. 2024-09-19T09:02:41.646 INFO:teuthology.orchestra.run.smithi001.stdout:261993005087 2024-09-19T09:02:41.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T09:02:41.823 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:41 smithi001 ceph-mon[30939]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:02:41.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 -- 172.21.15.1:0/397048718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb010c2f0 msgr2=0x7fecb010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 --2- 172.21.15.1:0/397048718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb010c2f0 0x7fecb010e790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feca8009ca0 tx=0x7feca802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 -- 172.21.15.1:0/397048718 shutdown_connections 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 --2- 172.21.15.1:0/397048718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb010c2f0 0x7fecb010e790 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 --2- 172.21.15.1:0/397048718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb01037a0 0x7fecb010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 --2- 172.21.15.1:0/397048718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb0102df0 0x7fecb01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 -- 172.21.15.1:0/397048718 >> 172.21.15.1:0/397048718 conn(0x7fecb00fc7d0 msgr2=0x7fecb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 -- 172.21.15.1:0/397048718 shutdown_connections 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.816+0000 7fecb4c7c640 1 -- 172.21.15.1:0/397048718 wait complete. 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecb4c7c640 1 Processor -- start 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecb4c7c640 1 -- start start 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecb4c7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb0102df0 0x7fecb01a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecb4c7c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb01037a0 0x7fecb01a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecb4c7c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb010c2f0 0x7fecb019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecb4c7c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fecb0112230 con 0x7fecb01037a0 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecb4c7c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fecb01120b0 con 0x7fecb010c2f0 2024-09-19T09:02:41.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecb4c7c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fecb01123b0 con 0x7fecb0102df0 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7feca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb01037a0 0x7fecb01a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7feca7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb01037a0 0x7fecb01a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52580/0 (socket says 172.21.15.1:52580) 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7feca7fff640 1 -- 172.21.15.1:0/1960739296 learned_addr learned my addr 172.21.15.1:0/1960739296 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecae59c640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb0102df0 0x7fecb01a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecaed9d640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb010c2f0 0x7fecb019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7feca7fff640 1 -- 172.21.15.1:0/1960739296 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb0102df0 msgr2=0x7fecb01a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7feca7fff640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fecb0102df0 0x7fecb01a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7feca7fff640 1 -- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb010c2f0 msgr2=0x7fecb019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7feca7fff640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb010c2f0 0x7fecb019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7feca7fff640 1 -- 172.21.15.1:0/1960739296 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb019af10 con 0x7fecb01037a0 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.817+0000 7fecaed9d640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb010c2f0 0x7fecb019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:41.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.818+0000 7feca7fff640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb01037a0 0x7fecb01a0b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec9800c970 tx=0x7fec9800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.818+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98007bb0 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.818+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb019b200 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.818+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec98007d50 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.818+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9800f450 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.818+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb01a7550 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.819+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecb0102440 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.821+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fec98005000 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.821+0000 7feca77fe640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fec9c0a32d0 0x7fec9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.822+0000 7fecae59c640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fec9c0a32d0 0x7fec9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.822+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fec980cf8b0 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.822+0000 7feca77fe640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] conn(0x7fec9c0acf80 0x7fec9c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.822+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 --> [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec98004490 con 0x7fec9c0acf80 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.822+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fec980d42a0 con 0x7fecb01037a0 2024-09-19T09:02:41.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.822+0000 7fecae59c640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fec9c0a32d0 0x7fec9c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feca000bbe0 tx=0x7feca000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.822+0000 7fecaed9d640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] conn(0x7fec9c0acf80 0x7fec9c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:41.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.823+0000 7fecaed9d640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] conn(0x7fec9c0acf80 0x7fec9c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:41.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.824+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 <== osd.1 v2:172.21.15.22:6800/704223442 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec98004490 con 0x7fec9c0acf80 2024-09-19T09:02:41.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.837+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 --> [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fecb006a790 con 0x7fec9c0acf80 2024-09-19T09:02:41.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.838+0000 7feca77fe640 1 -- 172.21.15.1:0/1960739296 <== osd.1 v2:172.21.15.22:6800/704223442 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fecb006a790 con 0x7fec9c0acf80 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.838+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] conn(0x7fec9c0acf80 msgr2=0x7fec9c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.838+0000 7fecb4c7c640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] conn(0x7fec9c0acf80 0x7fec9c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.838+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fec9c0a32d0 msgr2=0x7fec9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.838+0000 7fecb4c7c640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fec9c0a32d0 0x7fec9c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feca000bbe0 tx=0x7feca000b390 comp rx=0 tx=0).stop 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.838+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb01037a0 msgr2=0x7fecb01a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.838+0000 7fecb4c7c640 1 --2- 172.21.15.1:0/1960739296 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fecb01037a0 0x7fecb01a0b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec9800c970 tx=0x7fec9800ce30 comp rx=0 tx=0).stop 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.838+0000 7fecaed9d640 1 -- 172.21.15.1:0/1960739296 reap_dead start 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.839+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 shutdown_connections 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.839+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 >> 172.21.15.1:0/1960739296 conn(0x7fecb00fc7d0 msgr2=0x7fecb010d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.839+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 shutdown_connections 2024-09-19T09:02:41.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:41.839+0000 7fecb4c7c640 1 -- 172.21.15.1:0/1960739296 wait complete. 2024-09-19T09:02:42.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:41 smithi064 ceph-mon[35179]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:02:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:41 smithi022 ceph-mon[35107]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:02:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 -- 172.21.15.1:0/1546046672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 msgr2=0x7f31c81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 --2- 172.21.15.1:0/1546046672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 0x7f31c81029b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009900 tx=0x7f31b002a480 comp rx=0 tx=0).stop 2024-09-19T09:02:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 -- 172.21.15.1:0/1546046672 shutdown_connections 2024-09-19T09:02:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 --2- 172.21.15.1:0/1546046672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8102ef0 0x7f31c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 --2- 172.21.15.1:0/1546046672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 0x7f31c81029b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 --2- 172.21.15.1:0/1546046672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31c8100e20 0x7f31c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 -- 172.21.15.1:0/1546046672 >> 172.21.15.1:0/1546046672 conn(0x7f31c80fc7d0 msgr2=0x7f31c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 -- 172.21.15.1:0/1546046672 shutdown_connections 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.173+0000 7f31cc9a1640 1 -- 172.21.15.1:0/1546046672 wait complete. 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.174+0000 7f31cc9a1640 1 Processor -- start 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.174+0000 7f31cc9a1640 1 -- start start 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31cc9a1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31c8100e20 0x7f31c8198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31cc9a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 0x7f31c8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31cc9a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8102ef0 0x7f31c819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31cc9a1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8111070 con 0x7f31c8102570 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31cc9a1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8110ef0 con 0x7f31c8102ef0 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31cc9a1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81111f0 con 0x7f31c8100e20 2024-09-19T09:02:42.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 0x7f31c8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 0x7f31c8198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52606/0 (socket says 172.21.15.1:52606) 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 -- 172.21.15.1:0/984197969 learned_addr learned my addr 172.21.15.1:0/984197969 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c659c640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31c8100e20 0x7f31c8198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c6d9d640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8102ef0 0x7f31c819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 -- 172.21.15.1:0/984197969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31c8100e20 msgr2=0x7f31c8198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31c8100e20 0x7f31c8198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 -- 172.21.15.1:0/984197969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8102ef0 msgr2=0x7f31c819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31c8102ef0 0x7f31c819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 -- 172.21.15.1:0/984197969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c819d4d0 con 0x7f31c8102570 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.175+0000 7f31c5d9b640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 0x7f31c8198a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31b0006010 tx=0x7f31b0004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.176+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b003f030 con 0x7f31c8102570 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.176+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31b0005500 con 0x7f31c8102570 2024-09-19T09:02:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.176+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c819d760 con 0x7f31c8102570 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.176+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0035070 con 0x7f31c8102570 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.176+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c81a50a0 con 0x7f31c8102570 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.177+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31c8062980 con 0x7f31c8102570 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.178+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f31b0042030 con 0x7f31c8102570 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.179+0000 7f31bf7fe640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31b40a3350 0x7f31b40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.179+0000 7f31c659c640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31b40a3350 0x7f31b40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.179+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f31b00efe40 con 0x7f31c8102570 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.180+0000 7f31bf7fe640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] conn(0x7f31b40ad000 0x7f31b40af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.180+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 --> [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31b40afb70 con 0x7f31b40ad000 2024-09-19T09:02:42.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.180+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f31b00f24a0 con 0x7f31c8102570 2024-09-19T09:02:42.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.180+0000 7f31c659c640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31b40a3350 0x7f31b40a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f31c0007ec0 tx=0x7f31c00075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:42.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.180+0000 7f31c6d9d640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] conn(0x7f31b40ad000 0x7f31b40af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.180+0000 7f31c6d9d640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] conn(0x7f31b40ad000 0x7f31b40af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:42.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.181+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 <== osd.5 v2:172.21.15.64:6808/2206197763 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31b40afb70 con 0x7f31b40ad000 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.195+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 --> [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f31c8062e00 con 0x7f31b40ad000 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.195+0000 7f31bf7fe640 1 -- 172.21.15.1:0/984197969 <== osd.5 v2:172.21.15.64:6808/2206197763 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f31c8062e00 con 0x7f31b40ad000 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 >> [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] conn(0x7f31b40ad000 msgr2=0x7f31b40af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] conn(0x7f31b40ad000 0x7f31b40af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31b40a3350 msgr2=0x7f31b40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31b40a3350 0x7f31b40a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f31c0007ec0 tx=0x7f31c00075b0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 msgr2=0x7f31c8198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 --2- 172.21.15.1:0/984197969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c8102570 0x7f31c8198a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31b0006010 tx=0x7f31b0004c00 comp rx=0 tx=0).stop 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31c6d9d640 1 -- 172.21.15.1:0/984197969 reap_dead start 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 shutdown_connections 2024-09-19T09:02:42.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 >> 172.21.15.1:0/984197969 conn(0x7f31c80fc7d0 msgr2=0x7f31c806a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 shutdown_connections 2024-09-19T09:02:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.196+0000 7f31cc9a1640 1 -- 172.21.15.1:0/984197969 wait complete. 2024-09-19T09:02:42.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.609+0000 7fe307f07640 1 -- 172.21.15.1:0/1915965587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe300102570 msgr2=0x7fe3001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.609+0000 7fe307f07640 1 --2- 172.21.15.1:0/1915965587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe300102570 0x7fe3001029b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009900 tx=0x7fe2f402a480 comp rx=0 tx=0).stop 2024-09-19T09:02:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.609+0000 7fe307f07640 1 -- 172.21.15.1:0/1915965587 shutdown_connections 2024-09-19T09:02:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.609+0000 7fe307f07640 1 --2- 172.21.15.1:0/1915965587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe300102ef0 0x7fe30010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.609+0000 7fe307f07640 1 --2- 172.21.15.1:0/1915965587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe300102570 0x7fe3001029b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.609+0000 7fe307f07640 1 --2- 172.21.15.1:0/1915965587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe300100e20 0x7fe300101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.609+0000 7fe307f07640 1 -- 172.21.15.1:0/1915965587 >> 172.21.15.1:0/1915965587 conn(0x7fe3000fc7d0 msgr2=0x7fe3000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.609+0000 7fe307f07640 1 -- 172.21.15.1:0/1915965587 shutdown_connections 2024-09-19T09:02:42.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.610+0000 7fe307f07640 1 -- 172.21.15.1:0/1915965587 wait complete. 2024-09-19T09:02:42.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.610+0000 7fe307f07640 1 Processor -- start 2024-09-19T09:02:42.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.610+0000 7fe307f07640 1 -- start start 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe307f07640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe300100e20 0x7fe300199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe307f07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe300102570 0x7fe300199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe307f07640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe300102ef0 0x7fe3001a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe307f07640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe3001110a0 con 0x7fe300102ef0 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe307f07640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe300110f20 con 0x7fe300102570 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe307f07640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe300111220 con 0x7fe300100e20 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe305ca3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe300100e20 0x7fe300199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe305ca3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe300100e20 0x7fe300199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:50640/0 (socket says 172.21.15.1:50640) 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe305ca3640 1 -- 172.21.15.1:0/3034211858 learned_addr learned my addr 172.21.15.1:0/3034211858 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe3054a2640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe300102570 0x7fe300199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe3064a4640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe300102ef0 0x7fe3001a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe305ca3640 1 -- 172.21.15.1:0/3034211858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe300102570 msgr2=0x7fe300199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe305ca3640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe300102570 0x7fe300199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe305ca3640 1 -- 172.21.15.1:0/3034211858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe300102ef0 msgr2=0x7fe3001a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe305ca3640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe300102ef0 0x7fe3001a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.611+0000 7fe305ca3640 1 -- 172.21.15.1:0/3034211858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3001a49f0 con 0x7fe300100e20 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.612+0000 7fe305ca3640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe300100e20 0x7fe300199430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000eab0 tx=0x7fe2f000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.612+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000ce40 con 0x7fe300100e20 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.612+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe300197220 con 0x7fe300100e20 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.612+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2f0011970 con 0x7fe300100e20 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.612+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe300197730 con 0x7fe300100e20 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.612+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0010bb0 con 0x7fe300100e20 2024-09-19T09:02:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.613+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2ec001030 con 0x7fe300100e20 2024-09-19T09:02:42.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.614+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe2f0010d50 con 0x7fe300100e20 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.615+0000 7fe2feffd640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2e80a32d0 0x7fe2e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.615+0000 7fe3054a2640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2e80a32d0 0x7fe2e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.615+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe2f00cffa0 con 0x7fe300100e20 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.615+0000 7fe2feffd640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] conn(0x7fe2e80acf80 0x7fe2e80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.615+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 --> [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2f0014ec0 con 0x7fe2e80acf80 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.615+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fe2f00d0350 con 0x7fe300100e20 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.616+0000 7fe3054a2640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2e80a32d0 0x7fe2e80a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009230 tx=0x7fe2f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.616+0000 7fe3064a4640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] conn(0x7fe2e80acf80 0x7fe2e80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.616+0000 7fe3064a4640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] conn(0x7fe2e80acf80 0x7fe2e80af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:42.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.617+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 <== osd.2 v2:172.21.15.64:6800/3828827490 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2f0014ec0 con 0x7fe2e80acf80 2024-09-19T09:02:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 --> [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe2ec002dd0 con 0x7fe2e80acf80 2024-09-19T09:02:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe2feffd640 1 -- 172.21.15.1:0/3034211858 <== osd.2 v2:172.21.15.64:6800/3828827490 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe2ec002dd0 con 0x7fe2e80acf80 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 >> [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] conn(0x7fe2e80acf80 msgr2=0x7fe2e80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe307f07640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] conn(0x7fe2e80acf80 0x7fe2e80af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2e80a32d0 msgr2=0x7fe2e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe307f07640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe2e80a32d0 0x7fe2e80a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009230 tx=0x7fe2f40058d0 comp rx=0 tx=0).stop 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe300100e20 msgr2=0x7fe300199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe307f07640 1 --2- 172.21.15.1:0/3034211858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe300100e20 0x7fe300199430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000eab0 tx=0x7fe2f000ef70 comp rx=0 tx=0).stop 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.631+0000 7fe3064a4640 1 -- 172.21.15.1:0/3034211858 reap_dead start 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.632+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 shutdown_connections 2024-09-19T09:02:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.632+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 >> 172.21.15.1:0/3034211858 conn(0x7fe3000fc7d0 msgr2=0x7fe3000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.632+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 shutdown_connections 2024-09-19T09:02:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.632+0000 7fe307f07640 1 -- 172.21.15.1:0/3034211858 wait complete. 2024-09-19T09:02:43.323 INFO:teuthology.orchestra.run.smithi001.stdout:73014444098 2024-09-19T09:02:43.324 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T09:02:43.866 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:43 smithi001 ceph-mon[30939]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T09:02:44.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:43 smithi064 ceph-mon[35179]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T09:02:44.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:43 smithi022 ceph-mon[35107]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T09:02:44.484 INFO:teuthology.orchestra.run.smithi001.stdout:98784247868 2024-09-19T09:02:44.485 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T09:02:45.106 INFO:teuthology.orchestra.run.smithi001.stdout:128849018935 2024-09-19T09:02:45.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T09:02:45.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1561505243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1036e0 msgr2=0x7f0a8c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 --2- 172.21.15.1:0/1561505243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1036e0 0x7f0a8c107b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009930 tx=0x7f0a7402a420 comp rx=0 tx=0).stop 2024-09-19T09:02:45.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1561505243 shutdown_connections 2024-09-19T09:02:45.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 --2- 172.21.15.1:0/1561505243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a8c1082a0 0x7f0a8c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 --2- 172.21.15.1:0/1561505243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1036e0 0x7f0a8c107b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 --2- 172.21.15.1:0/1561505243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8c102d30 0x7f0a8c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1561505243 >> 172.21.15.1:0/1561505243 conn(0x7f0a8c0fc7d0 msgr2=0x7f0a8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1561505243 shutdown_connections 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1561505243 wait complete. 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.838+0000 7f0a91d3b640 1 Processor -- start 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a91d3b640 1 -- start start 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a91d3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8c102d30 0x7f0a8c19e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a91d3b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a8c1036e0 0x7f0a8c19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a91d3b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1082a0 0x7f0a8c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a91d3b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c112280 con 0x7f0a8c1082a0 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a91d3b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c112100 con 0x7f0a8c102d30 2024-09-19T09:02:45.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a91d3b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c112400 con 0x7f0a8c1036e0 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1082a0 0x7f0a8c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1082a0 0x7f0a8c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47394/0 (socket says 172.21.15.1:47394) 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8bfff640 1 -- 172.21.15.1:0/1674508253 learned_addr learned my addr 172.21.15.1:0/1674508253 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8b7fe640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8c102d30 0x7f0a8c19e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8affd640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a8c1036e0 0x7f0a8c19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8bfff640 1 -- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a8c1036e0 msgr2=0x7f0a8c19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8bfff640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a8c1036e0 0x7f0a8c19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8bfff640 1 -- 172.21.15.1:0/1674508253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8c102d30 msgr2=0x7f0a8c19e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8bfff640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a8c102d30 0x7f0a8c19e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8bfff640 1 -- 172.21.15.1:0/1674508253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c198ee0 con 0x7f0a8c1082a0 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.839+0000 7f0a8affd640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a8c1036e0 0x7f0a8c19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.840+0000 7f0a8bfff640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1082a0 0x7f0a8c198670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009fd0 tx=0x7f0a8400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.840+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84011830 con 0x7f0a8c1082a0 2024-09-19T09:02:45.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.840+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a84016070 con 0x7f0a8c1082a0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.840+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400f2e0 con 0x7f0a8c1082a0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.840+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c1991d0 con 0x7f0a8c1082a0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.840+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c1a5520 con 0x7f0a8c1082a0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.841+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a8c062940 con 0x7f0a8c1082a0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.842+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0a8401b460 con 0x7f0a8c1082a0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.843+0000 7f0a88ff9640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a780a3350 0x7f0a780a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.843+0000 7f0a8b7fe640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a780a3350 0x7f0a780a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.843+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0a840cfa70 con 0x7f0a8c1082a0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.843+0000 7f0a88ff9640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] conn(0x7f0a780ad000 0x7f0a780af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.843+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 --> [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a84022e50 con 0x7f0a780ad000 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.843+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f0a840cfec0 con 0x7f0a8c1082a0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.843+0000 7f0a8b7fe640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a780a3350 0x7f0a780a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00a400 tx=0x7f0a7c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:45.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.844+0000 7f0a8affd640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] conn(0x7f0a780ad000 0x7f0a780af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:45.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.844+0000 7f0a8affd640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] conn(0x7f0a780ad000 0x7f0a780af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:45.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.845+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 <== osd.8 v2:172.21.15.64:6816/2825124096 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a84022e50 con 0x7f0a780ad000 2024-09-19T09:02:45.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.859+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 --> [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0a8c062d40 con 0x7f0a780ad000 2024-09-19T09:02:45.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.859+0000 7f0a88ff9640 1 -- 172.21.15.1:0/1674508253 <== osd.8 v2:172.21.15.64:6816/2825124096 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0a8c062d40 con 0x7f0a780ad000 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] conn(0x7f0a780ad000 msgr2=0x7f0a780af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] conn(0x7f0a780ad000 0x7f0a780af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a780a3350 msgr2=0x7f0a780a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0a780a3350 0x7f0a780a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00a400 tx=0x7f0a7c00d040 comp rx=0 tx=0).stop 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1082a0 msgr2=0x7f0a8c198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 --2- 172.21.15.1:0/1674508253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0a8c1082a0 0x7f0a8c198670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009fd0 tx=0x7f0a8400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a8bfff640 1 -- 172.21.15.1:0/1674508253 reap_dead start 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 shutdown_connections 2024-09-19T09:02:45.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 >> 172.21.15.1:0/1674508253 conn(0x7f0a8c0fc7d0 msgr2=0x7f0a8c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:45.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 shutdown_connections 2024-09-19T09:02:45.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:45.860+0000 7f0a91d3b640 1 -- 172.21.15.1:0/1674508253 wait complete. 2024-09-19T09:02:46.011 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:45 smithi001 ceph-mon[30939]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:02:46.012 INFO:teuthology.orchestra.run.smithi001.stdout:51539607623 2024-09-19T09:02:46.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T09:02:46.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:45 smithi064 ceph-mon[35179]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:02:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.038+0000 7f4e1d007640 1 -- 172.21.15.1:0/1940640302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18106f20 msgr2=0x7f4e1810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 --2- 172.21.15.1:0/1940640302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18106f20 0x7f4e1810eaa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009ca0 tx=0x7f4e1002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 -- 172.21.15.1:0/1940640302 shutdown_connections 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 --2- 172.21.15.1:0/1940640302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18106f20 0x7f4e1810eaa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 --2- 172.21.15.1:0/1940640302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e181027a0 0x7f4e181067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 --2- 172.21.15.1:0/1940640302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e18101df0 0x7f4e181021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 -- 172.21.15.1:0/1940640302 >> 172.21.15.1:0/1940640302 conn(0x7f4e180fd8f0 msgr2=0x7f4e180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 -- 172.21.15.1:0/1940640302 shutdown_connections 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 -- 172.21.15.1:0/1940640302 wait complete. 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.039+0000 7f4e1d007640 1 Processor -- start 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1d007640 1 -- start start 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1d007640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18101df0 0x7f4e18198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1d007640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e181027a0 0x7f4e18198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1d007640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e18106f20 0x7f4e1819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1d007640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4e181120a0 con 0x7f4e18101df0 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1d007640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4e18111f20 con 0x7f4e181027a0 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1d007640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4e18112220 con 0x7f4e18106f20 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18101df0 0x7f4e18198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18101df0 0x7f4e18198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52584/0 (socket says 172.21.15.1:52584) 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 -- 172.21.15.1:0/2251671944 learned_addr learned my addr 172.21.15.1:0/2251671944 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1659c640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e181027a0 0x7f4e18198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e1759e640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e18106f20 0x7f4e1819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 -- 172.21.15.1:0/2251671944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e18106f20 msgr2=0x7f4e1819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e18106f20 0x7f4e1819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 -- 172.21.15.1:0/2251671944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e181027a0 msgr2=0x7f4e18198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e181027a0 0x7f4e18198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 -- 172.21.15.1:0/2251671944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1819d3f0 con 0x7f4e18101df0 2024-09-19T09:02:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.040+0000 7f4e16d9d640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18101df0 0x7f4e18198440 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800d770 tx=0x7f4e0800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.041+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08017070 con 0x7f4e18101df0 2024-09-19T09:02:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.041+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4e08009820 con 0x7f4e18101df0 2024-09-19T09:02:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.041+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1819d6e0 con 0x7f4e18101df0 2024-09-19T09:02:46.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.041+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08004dd0 con 0x7f4e18101df0 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.041+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e181a4fc0 con 0x7f4e18101df0 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.041+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e180fede0 con 0x7f4e18101df0 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.043+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4e080099d0 con 0x7f4e18101df0 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.044+0000 7f4dfffff640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e000a32d0 0x7f4e000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.044+0000 7f4e1659c640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e000a32d0 0x7f4e000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.044+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4e080cf920 con 0x7f4e18101df0 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.044+0000 7f4dfffff640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] conn(0x7f4e000acf80 0x7f4e000af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.044+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 --> [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e08001d30 con 0x7f4e000acf80 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.044+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f4e080cfcd0 con 0x7f4e18101df0 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.044+0000 7f4e1659c640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e000a32d0 0x7f4e000a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e181083b0 tx=0x7f4e0c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.044+0000 7f4e1759e640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] conn(0x7f4e000acf80 0x7f4e000af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.045+0000 7f4e1759e640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] conn(0x7f4e000acf80 0x7f4e000af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.045+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 <== osd.10 v2:172.21.15.22:6824/3539045596 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e08001d30 con 0x7f4e000acf80 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.059+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 --> [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e181032d0 con 0x7f4e000acf80 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.059+0000 7f4dfffff640 1 -- 172.21.15.1:0/2251671944 <== osd.10 v2:172.21.15.22:6824/3539045596 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4e181032d0 con 0x7f4e000acf80 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 >> [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] conn(0x7f4e000acf80 msgr2=0x7f4e000af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] conn(0x7f4e000acf80 0x7f4e000af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e000a32d0 msgr2=0x7f4e000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e000a32d0 0x7f4e000a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e181083b0 tx=0x7f4e0c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18101df0 msgr2=0x7f4e18198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 --2- 172.21.15.1:0/2251671944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e18101df0 0x7f4e18198440 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800d770 tx=0x7f4e0800db70 comp rx=0 tx=0).stop 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1759e640 1 -- 172.21.15.1:0/2251671944 reap_dead start 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 shutdown_connections 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 >> 172.21.15.1:0/2251671944 conn(0x7f4e180fd8f0 msgr2=0x7f4e180fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:46.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 shutdown_connections 2024-09-19T09:02:46.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:42.060+0000 7f4e1d007640 1 -- 172.21.15.1:0/2251671944 wait complete. 2024-09-19T09:02:46.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:45 smithi022 ceph-mon[35107]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:02:46.772 INFO:teuthology.orchestra.run.smithi001.stdout:279172874266 2024-09-19T09:02:46.772 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T09:02:47.607 INFO:teuthology.orchestra.run.smithi001.stdout:180388626477 2024-09-19T09:02:47.608 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T09:02:47.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:47 smithi001 ceph-mon[30939]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T09:02:48.022 INFO:teuthology.orchestra.run.smithi001.stdout:197568495655 2024-09-19T09:02:48.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T09:02:48.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:47 smithi064 ceph-mon[35179]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T09:02:48.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:47 smithi022 ceph-mon[35107]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T09:02:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 -- 172.21.15.1:0/1575896206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 msgr2=0x7f90e010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 --2- 172.21.15.1:0/1575896206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 0x7f90e010da40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009ca0 tx=0x7f90d802a950 comp rx=0 tx=0).stop 2024-09-19T09:02:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 -- 172.21.15.1:0/1575896206 shutdown_connections 2024-09-19T09:02:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 --2- 172.21.15.1:0/1575896206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 0x7f90e010da40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 --2- 172.21.15.1:0/1575896206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0102570 0x7f90e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 --2- 172.21.15.1:0/1575896206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90e0100e20 0x7f90e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 -- 172.21.15.1:0/1575896206 >> 172.21.15.1:0/1575896206 conn(0x7f90e00fc7d0 msgr2=0x7f90e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 -- 172.21.15.1:0/1575896206 shutdown_connections 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.212+0000 7f90e5c1a640 1 -- 172.21.15.1:0/1575896206 wait complete. 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.213+0000 7f90e5c1a640 1 Processor -- start 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.213+0000 7f90e5c1a640 1 -- start start 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.213+0000 7f90e5c1a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90e0100e20 0x7f90e0197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.213+0000 7f90e5c1a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0102570 0x7f90e0197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.213+0000 7f90e5c1a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 0x7f90e019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.213+0000 7f90e5c1a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90e01110a0 con 0x7f90e0102ef0 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.213+0000 7f90e5c1a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0110f20 con 0x7f90e0100e20 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.213+0000 7f90e5c1a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0111220 con 0x7f90e0102570 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 0x7f90e019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90df7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90e0100e20 0x7f90e0197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 0x7f90e019bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47408/0 (socket says 172.21.15.1:47408) 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 -- 172.21.15.1:0/137440930 learned_addr learned my addr 172.21.15.1:0/137440930 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90d7fff640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0102570 0x7f90e0197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 -- 172.21.15.1:0/137440930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0102570 msgr2=0x7f90e0197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e0102570 0x7f90e0197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 -- 172.21.15.1:0/137440930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90e0100e20 msgr2=0x7f90e0197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90e0100e20 0x7f90e0197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 -- 172.21.15.1:0/137440930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e019c200 con 0x7f90e0102ef0 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dffff640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 0x7f90e019bb20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f90d8005e30 tx=0x7f90d802f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8034040 con 0x7f90e0102ef0 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e019c490 con 0x7f90e0102ef0 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90d8030940 con 0x7f90e0102ef0 2024-09-19T09:02:48.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.214+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d80456e0 con 0x7f90e0102ef0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.215+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e01a3dd0 con 0x7f90e0102ef0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.215+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90e00fe620 con 0x7f90e0102ef0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.217+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f90d8037020 con 0x7f90e0102ef0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.218+0000 7f90dd7fa640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90cc0a3350 0x7f90cc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.218+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f90d80f0a80 con 0x7f90e0102ef0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.218+0000 7f90df7fe640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90cc0a3350 0x7f90cc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.218+0000 7f90dd7fa640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] conn(0x7f90cc0ad000 0x7f90cc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.218+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 --> [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90cc0afb70 con 0x7f90cc0ad000 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.218+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f90d80f0e70 con 0x7f90e0102ef0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.218+0000 7f90d7fff640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] conn(0x7f90cc0ad000 0x7f90cc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.218+0000 7f90df7fe640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90cc0a3350 0x7f90cc0a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f90d000bbe0 tx=0x7f90d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.219+0000 7f90d7fff640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] conn(0x7f90cc0ad000 0x7f90cc0af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:48.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.219+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 <== osd.0 v2:172.21.15.1:6802/285096053 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90cc0afb70 con 0x7f90cc0ad000 2024-09-19T09:02:48.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.234+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 --> [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f90e019c970 con 0x7f90cc0ad000 2024-09-19T09:02:48.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.235+0000 7f90dd7fa640 1 -- 172.21.15.1:0/137440930 <== osd.0 v2:172.21.15.1:6802/285096053 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f90c80042a0 con 0x7f90cc0ad000 2024-09-19T09:02:48.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.235+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] conn(0x7f90cc0ad000 msgr2=0x7f90cc0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.235+0000 7f90e5c1a640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] conn(0x7f90cc0ad000 0x7f90cc0af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.235+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90cc0a3350 msgr2=0x7f90cc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.235+0000 7f90e5c1a640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90cc0a3350 0x7f90cc0a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f90d000bbe0 tx=0x7f90d000b390 comp rx=0 tx=0).stop 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.236+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 msgr2=0x7f90e019bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.236+0000 7f90e5c1a640 1 --2- 172.21.15.1:0/137440930 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90e0102ef0 0x7f90e019bb20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f90d8005e30 tx=0x7f90d802f950 comp rx=0 tx=0).stop 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.236+0000 7f90dffff640 1 -- 172.21.15.1:0/137440930 reap_dead start 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.236+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 shutdown_connections 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.236+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 >> 172.21.15.1:0/137440930 conn(0x7f90e00fc7d0 msgr2=0x7f90e00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.236+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 shutdown_connections 2024-09-19T09:02:48.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:48.236+0000 7f90e5c1a640 1 -- 172.21.15.1:0/137440930 wait complete. 2024-09-19T09:02:48.996 INFO:teuthology.orchestra.run.smithi001.stdout:227633266724 2024-09-19T09:02:48.997 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T09:02:49.411 INFO:teuthology.orchestra.run.smithi001.stdout:150323855411 2024-09-19T09:02:49.412 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T09:02:49.889 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:49.898 INFO:teuthology.orchestra.run.smithi001.stdout:34359738445 2024-09-19T09:02:49.898 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T09:02:49.905 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:49.961 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:49.982 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:49.986 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:50.035 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:49 smithi001 ceph-mon[30939]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:49 smithi064 ceph-mon[35179]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:50.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:49 smithi022 ceph-mon[35107]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:50.416 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:50.419 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:50.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 -- 172.21.15.1:0/4914027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec106f10 msgr2=0x7f5fec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/4914027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec106f10 0x7f5fec10ea90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009ca0 tx=0x7f5fe402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 -- 172.21.15.1:0/4914027 shutdown_connections 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/4914027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec106f10 0x7f5fec10ea90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/4914027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fec102790 0x7f5fec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/4914027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fec101de0 0x7f5fec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 -- 172.21.15.1:0/4914027 >> 172.21.15.1:0/4914027 conn(0x7f5fec0fd8c0 msgr2=0x7f5fec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 -- 172.21.15.1:0/4914027 shutdown_connections 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.621+0000 7f5ff44b7640 1 -- 172.21.15.1:0/4914027 wait complete. 2024-09-19T09:02:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff44b7640 1 Processor -- start 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff44b7640 1 -- start start 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff44b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec101de0 0x7f5fec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff44b7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fec102790 0x7f5fec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff44b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fec106f10 0x7f5fec074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff44b7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec112090 con 0x7f5fec101de0 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff44b7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec111f10 con 0x7f5fec106f10 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff44b7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec112210 con 0x7f5fec102790 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff2253640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec101de0 0x7f5fec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff2253640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec101de0 0x7f5fec0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47424/0 (socket says 172.21.15.1:47424) 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff2253640 1 -- 172.21.15.1:0/561967343 learned_addr learned my addr 172.21.15.1:0/561967343 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.622+0000 7f5ff1a52640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fec102790 0x7f5fec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff2a54640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fec106f10 0x7f5fec074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff2253640 1 -- 172.21.15.1:0/561967343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fec102790 msgr2=0x7f5fec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff2253640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fec102790 0x7f5fec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff2253640 1 -- 172.21.15.1:0/561967343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fec106f10 msgr2=0x7f5fec074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff2253640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fec106f10 0x7f5fec074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff2253640 1 -- 172.21.15.1:0/561967343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec1a6980 con 0x7f5fec101de0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff2253640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec101de0 0x7f5fec0744f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800d950 tx=0x7f5fe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5fe37fe640 1 -- 172.21.15.1:0/561967343 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8017070 con 0x7f5fec101de0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fec1a6c70 con 0x7f5fec101de0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5fe37fe640 1 -- 172.21.15.1:0/561967343 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5fe8009c30 con 0x7f5fec101de0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5fe37fe640 1 -- 172.21.15.1:0/561967343 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800f740 con 0x7f5fec101de0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.623+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fec1a71b0 con 0x7f5fec101de0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.624+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fec1021c0 con 0x7f5fec101de0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.625+0000 7f5fe37fe640 1 -- 172.21.15.1:0/561967343 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5fe8010a80 con 0x7f5fec101de0 2024-09-19T09:02:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.626+0000 7f5fe37fe640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5fd80a32d0 0x7f5fd80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.626+0000 7f5ff1a52640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5fd80a32d0 0x7f5fd80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.626+0000 7f5fe37fe640 1 -- 172.21.15.1:0/561967343 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5fe80cf800 con 0x7f5fec101de0 2024-09-19T09:02:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.626+0000 7f5ff1a52640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5fd80a32d0 0x7f5fd80a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005e00 tx=0x7f5fdc005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.630+0000 7f5fe37fe640 1 -- 172.21.15.1:0/561967343 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fe8009de0 con 0x7f5fec101de0 2024-09-19T09:02:50.651 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.816+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f5fec075a20 con 0x7f5fec101de0 2024-09-19T09:02:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.817+0000 7f5fe37fe640 1 -- 172.21.15.1:0/561967343 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5fe809c3a0 con 0x7f5fec101de0 2024-09-19T09:02:50.817 INFO:teuthology.orchestra.run.smithi001.stdout:261993005089 2024-09-19T09:02:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5fd80a32d0 msgr2=0x7f5fd80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5fd80a32d0 0x7f5fd80a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005e00 tx=0x7f5fdc005c50 comp rx=0 tx=0).stop 2024-09-19T09:02:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec101de0 msgr2=0x7f5fec0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec101de0 0x7f5fec0744f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800d950 tx=0x7f5fe800de10 comp rx=0 tx=0).stop 2024-09-19T09:02:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 shutdown_connections 2024-09-19T09:02:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fec106f10 0x7f5fec074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5fd80a32d0 0x7f5fd80a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5fec102790 0x7f5fec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 --2- 172.21.15.1:0/561967343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5fec101de0 0x7f5fec0744f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 >> 172.21.15.1:0/561967343 conn(0x7f5fec0fd8c0 msgr2=0x7f5fec0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 shutdown_connections 2024-09-19T09:02:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:50.819+0000 7f5ff44b7640 1 -- 172.21.15.1:0/561967343 wait complete. 2024-09-19T09:02:51.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 -- 172.21.15.1:0/1515318622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f801082a0 msgr2=0x7f7f8010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 --2- 172.21.15.1:0/1515318622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f801082a0 0x7f7f8010ec40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009cd0 tx=0x7f7f7802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 -- 172.21.15.1:0/1515318622 shutdown_connections 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 --2- 172.21.15.1:0/1515318622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f801082a0 0x7f7f8010ec40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 --2- 172.21.15.1:0/1515318622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f801036e0 0x7f7f80107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 --2- 172.21.15.1:0/1515318622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f80102d30 0x7f7f80103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 -- 172.21.15.1:0/1515318622 >> 172.21.15.1:0/1515318622 conn(0x7f7f800fc7d0 msgr2=0x7f7f800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 -- 172.21.15.1:0/1515318622 shutdown_connections 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.334+0000 7f7f8747e640 1 -- 172.21.15.1:0/1515318622 wait complete. 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8747e640 1 Processor -- start 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8747e640 1 -- start start 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8747e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f80102d30 0x7f7f801986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8747e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f801036e0 0x7f7f80198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8747e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f801082a0 0x7f7f8019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8747e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801121e0 con 0x7f7f80102d30 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8747e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80112060 con 0x7f7f801036e0 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8747e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80112360 con 0x7f7f801082a0 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8521a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f80102d30 0x7f7f801986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8521a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f80102d30 0x7f7f801986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47444/0 (socket says 172.21.15.1:47444) 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8521a640 1 -- 172.21.15.1:0/152067252 learned_addr learned my addr 172.21.15.1:0/152067252 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f84a19640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f801036e0 0x7f7f80198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f85a1b640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f801082a0 0x7f7f8019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8521a640 1 -- 172.21.15.1:0/152067252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f801082a0 msgr2=0x7f7f8019cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8521a640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f801082a0 0x7f7f8019cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8521a640 1 -- 172.21.15.1:0/152067252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f801036e0 msgr2=0x7f7f80198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8521a640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f801036e0 0x7f7f80198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f8521a640 1 -- 172.21.15.1:0/152067252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8019d650 con 0x7f7f80102d30 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f85a1b640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f801082a0 0x7f7f8019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.335+0000 7f7f84a19640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f801036e0 0x7f7f80198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.336+0000 7f7f8521a640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f80102d30 0x7f7f801986a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00d950 tx=0x7f7f7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.336+0000 7f7f767fc640 1 -- 172.21.15.1:0/152067252 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c017030 con 0x7f7f80102d30 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.336+0000 7f7f767fc640 1 -- 172.21.15.1:0/152067252 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f7c004020 con 0x7f7f80102d30 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.336+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8019d940 con 0x7f7f80102d30 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.336+0000 7f7f767fc640 1 -- 172.21.15.1:0/152067252 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c004a00 con 0x7f7f80102d30 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.336+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f801a5220 con 0x7f7f80102d30 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.337+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f80103110 con 0x7f7f80102d30 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.338+0000 7f7f767fc640 1 -- 172.21.15.1:0/152067252 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7f7c0041d0 con 0x7f7f80102d30 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.338+0000 7f7f767fc640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7f6c0a3350 0x7f7f6c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.339+0000 7f7f767fc640 1 -- 172.21.15.1:0/152067252 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f7f7c0cfb60 con 0x7f7f80102d30 2024-09-19T09:02:51.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.339+0000 7f7f84a19640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7f6c0a3350 0x7f7f6c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.339+0000 7f7f84a19640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7f6c0a3350 0x7f7f6c0a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f70005d70 tx=0x7f7f70005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.342+0000 7f7f767fc640 1 -- 172.21.15.1:0/152067252 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f7c0cfe20 con 0x7f7f80102d30 2024-09-19T09:02:51.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.523+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7f80199a00 con 0x7f7f80102d30 2024-09-19T09:02:51.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.527+0000 7f7f767fc640 1 -- 172.21.15.1:0/152067252 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7f7c024330 con 0x7f7f80102d30 2024-09-19T09:02:51.527 INFO:teuthology.orchestra.run.smithi001.stdout:197568495658 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.529+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7f6c0a3350 msgr2=0x7f7f6c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.529+0000 7f7f8747e640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7f6c0a3350 0x7f7f6c0a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f70005d70 tx=0x7f7f70005d00 comp rx=0 tx=0).stop 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.529+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f80102d30 msgr2=0x7f7f801986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.529+0000 7f7f8747e640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f80102d30 0x7f7f801986a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00d950 tx=0x7f7f7c00de10 comp rx=0 tx=0).stop 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.530+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 shutdown_connections 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.530+0000 7f7f8747e640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7f6c0a3350 0x7f7f6c0a5810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.530+0000 7f7f8747e640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f801082a0 0x7f7f8019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.530+0000 7f7f8747e640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f801036e0 0x7f7f80198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.530+0000 7f7f8747e640 1 --2- 172.21.15.1:0/152067252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f80102d30 0x7f7f801986a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.530+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 >> 172.21.15.1:0/152067252 conn(0x7f7f800fc7d0 msgr2=0x7f7f800fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.530+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 shutdown_connections 2024-09-19T09:02:51.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.530+0000 7f7f8747e640 1 -- 172.21.15.1:0/152067252 wait complete. 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.518+0000 7f0b78913640 1 -- 172.21.15.1:0/3213015251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b741036e0 msgr2=0x7f0b74107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.518+0000 7f0b78913640 1 --2- 172.21.15.1:0/3213015251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b741036e0 0x7f0b74107b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009930 tx=0x7f0b6802a420 comp rx=0 tx=0).stop 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 -- 172.21.15.1:0/3213015251 shutdown_connections 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 --2- 172.21.15.1:0/3213015251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741082a0 0x7f0b7410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 --2- 172.21.15.1:0/3213015251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b741036e0 0x7f0b74107b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 --2- 172.21.15.1:0/3213015251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b74102d30 0x7f0b74103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 -- 172.21.15.1:0/3213015251 >> 172.21.15.1:0/3213015251 conn(0x7f0b740fc7d0 msgr2=0x7f0b740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 -- 172.21.15.1:0/3213015251 shutdown_connections 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 -- 172.21.15.1:0/3213015251 wait complete. 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 Processor -- start 2024-09-19T09:02:51.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.519+0000 7f0b78913640 1 -- start start 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b78913640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74102d30 0x7f0b74100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b78913640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741036e0 0x7f0b74100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b78913640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b741082a0 0x7f0b74101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b78913640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b741121c0 con 0x7f0b74102d30 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b78913640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74112040 con 0x7f0b741036e0 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b78913640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74112340 con 0x7f0b741082a0 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74102d30 0x7f0b74100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74102d30 0x7f0b74100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47472/0 (socket says 172.21.15.1:47472) 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 -- 172.21.15.1:0/1369562021 learned_addr learned my addr 172.21.15.1:0/1369562021 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b71d9b640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741036e0 0x7f0b74100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b72d9d640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b741082a0 0x7f0b74101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 -- 172.21.15.1:0/1369562021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b741082a0 msgr2=0x7f0b74101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b741082a0 0x7f0b74101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 -- 172.21.15.1:0/1369562021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741036e0 msgr2=0x7f0b74100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741036e0 0x7f0b74100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 -- 172.21.15.1:0/1369562021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b741a6b80 con 0x7f0b74102d30 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b72d9d640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b741082a0 0x7f0b74101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b7259c640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74102d30 0x7f0b74100990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400e9f0 tx=0x7f0b6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b637fe640 1 -- 172.21.15.1:0/1369562021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400cd80 con 0x7f0b74102d30 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b637fe640 1 -- 172.21.15.1:0/1369562021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b64005520 con 0x7f0b74102d30 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b741a6e70 con 0x7f0b74102d30 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.520+0000 7f0b637fe640 1 -- 172.21.15.1:0/1369562021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64010690 con 0x7f0b74102d30 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.521+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b741a72d0 con 0x7f0b74102d30 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.521+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b74103110 con 0x7f0b74102d30 2024-09-19T09:02:51.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.524+0000 7f0b637fe640 1 -- 172.21.15.1:0/1369562021 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0b640046c0 con 0x7f0b74102d30 2024-09-19T09:02:51.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.524+0000 7f0b637fe640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b5c0a32d0 0x7f0b5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:51.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.524+0000 7f0b637fe640 1 -- 172.21.15.1:0/1369562021 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0b640d0130 con 0x7f0b74102d30 2024-09-19T09:02:51.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.524+0000 7f0b71d9b640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b5c0a32d0 0x7f0b5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:51.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.525+0000 7f0b71d9b640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b5c0a32d0 0x7f0b5c0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b68005940 tx=0x7f0b680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:51.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.528+0000 7f0b637fe640 1 -- 172.21.15.1:0/1369562021 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b64054210 con 0x7f0b74102d30 2024-09-19T09:02:51.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.708+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0b74101ec0 con 0x7f0b74102d30 2024-09-19T09:02:51.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.709+0000 7f0b637fe640 1 -- 172.21.15.1:0/1369562021 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0b74101ec0 con 0x7f0b74102d30 2024-09-19T09:02:51.709 INFO:teuthology.orchestra.run.smithi001.stdout:128849018937 2024-09-19T09:02:51.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b5c0a32d0 msgr2=0x7f0b5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b5c0a32d0 0x7f0b5c0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b68005940 tx=0x7f0b680058d0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74102d30 msgr2=0x7f0b74100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:51.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74102d30 0x7f0b74100990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400e9f0 tx=0x7f0b6400edf0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 shutdown_connections 2024-09-19T09:02:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b5c0a32d0 0x7f0b5c0a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b741082a0 0x7f0b74101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741036e0 0x7f0b74100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 --2- 172.21.15.1:0/1369562021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74102d30 0x7f0b74100990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 >> 172.21.15.1:0/1369562021 conn(0x7f0b740fc7d0 msgr2=0x7f0b74105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 shutdown_connections 2024-09-19T09:02:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:51.711+0000 7f0b78913640 1 -- 172.21.15.1:0/1369562021 wait complete. 2024-09-19T09:02:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:51 smithi001 ceph-mon[30939]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:02:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:51 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/561967343' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:02:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:51 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/152067252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:02:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:51 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1369562021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:02:52.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:51 smithi064 ceph-mon[35179]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:02:52.216 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:51 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/561967343' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:02:52.216 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:51 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/152067252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:02:52.216 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:51 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1369562021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:02:52.217 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:51 smithi022 ceph-mon[35107]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:02:52.217 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:51 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/561967343' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:02:52.217 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:51 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/152067252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:02:52.217 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:51 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1369562021' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:02:52.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018935 got 128849018937 for osd.4 2024-09-19T09:02:52.418 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.745+0000 7fd489d96640 1 -- 172.21.15.1:0/1369832202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 msgr2=0x7fd48410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.745+0000 7fd489d96640 1 --2- 172.21.15.1:0/1369832202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 0x7fd48410d950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009cd0 tx=0x7fd47c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.745+0000 7fd489d96640 1 -- 172.21.15.1:0/1369832202 shutdown_connections 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.745+0000 7fd489d96640 1 --2- 172.21.15.1:0/1369832202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 0x7fd48410d950 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.745+0000 7fd489d96640 1 --2- 172.21.15.1:0/1369832202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd484100a80 0x7fd484100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.745+0000 7fd489d96640 1 --2- 172.21.15.1:0/1369832202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd484106a80 0x7fd484106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.745+0000 7fd489d96640 1 -- 172.21.15.1:0/1369832202 >> 172.21.15.1:0/1369832202 conn(0x7fd4840fc7a0 msgr2=0x7fd4840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.745+0000 7fd489d96640 1 -- 172.21.15.1:0/1369832202 shutdown_connections 2024-09-19T09:02:53.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.746+0000 7fd489d96640 1 -- 172.21.15.1:0/1369832202 wait complete. 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.746+0000 7fd489d96640 1 Processor -- start 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.746+0000 7fd489d96640 1 -- start start 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd489d96640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd484100a80 0x7fd48410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd489d96640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 0x7fd48410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd489d96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd484106a80 0x7fd48410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd489d96640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4841120c0 con 0x7fd484101420 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd489d96640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd484111f40 con 0x7fd484106a80 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd489d96640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd484112240 con 0x7fd484100a80 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 0x7fd48410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 0x7fd48410e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54770/0 (socket says 172.21.15.1:54770) 2024-09-19T09:02:53.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 -- 172.21.15.1:0/120483682 learned_addr learned my addr 172.21.15.1:0/120483682 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd483fff640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd484106a80 0x7fd48410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd4837fe640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd484100a80 0x7fd48410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 -- 172.21.15.1:0/120483682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd484100a80 msgr2=0x7fd48410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd484100a80 0x7fd48410e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 -- 172.21.15.1:0/120483682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd484106a80 msgr2=0x7fd48410ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd484106a80 0x7fd48410ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 -- 172.21.15.1:0/120483682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4841a6990 con 0x7fd484101420 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd482ffd640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 0x7fd48410e920 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd47800d950 tx=0x7fd47800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd480ff9640 1 -- 172.21.15.1:0/120483682 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478017030 con 0x7fd484101420 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd480ff9640 1 -- 172.21.15.1:0/120483682 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd478004020 con 0x7fd484101420 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd480ff9640 1 -- 172.21.15.1:0/120483682 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478004a00 con 0x7fd484101420 2024-09-19T09:02:53.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.747+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4841a6c80 con 0x7fd484101420 2024-09-19T09:02:53.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.748+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841a7170 con 0x7fd484101420 2024-09-19T09:02:53.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.749+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484100ee0 con 0x7fd484101420 2024-09-19T09:02:53.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.750+0000 7fd480ff9640 1 -- 172.21.15.1:0/120483682 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd4780041d0 con 0x7fd484101420 2024-09-19T09:02:53.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.750+0000 7fd480ff9640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd46c0a3350 0x7fd46c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:53.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.751+0000 7fd4837fe640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd46c0a3350 0x7fd46c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:53.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.751+0000 7fd480ff9640 1 -- 172.21.15.1:0/120483682 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd4780cf470 con 0x7fd484101420 2024-09-19T09:02:53.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.751+0000 7fd4837fe640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd46c0a3350 0x7fd46c0a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd474005fd0 tx=0x7fd474005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:53.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.755+0000 7fd480ff9640 1 -- 172.21.15.1:0/120483682 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd47809c010 con 0x7fd484101420 2024-09-19T09:02:53.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.936+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd48410f910 con 0x7fd484101420 2024-09-19T09:02:53.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.937+0000 7fd480ff9640 1 -- 172.21.15.1:0/120483682 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd4780860e0 con 0x7fd484101420 2024-09-19T09:02:53.937 INFO:teuthology.orchestra.run.smithi001.stdout:180388626480 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.938+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd46c0a3350 msgr2=0x7fd46c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.938+0000 7fd489d96640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd46c0a3350 0x7fd46c0a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd474005fd0 tx=0x7fd474005850 comp rx=0 tx=0).stop 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 msgr2=0x7fd48410e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 0x7fd48410e920 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd47800d950 tx=0x7fd47800de10 comp rx=0 tx=0).stop 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 shutdown_connections 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd484106a80 0x7fd48410ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd484101420 0x7fd48410e920 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd46c0a3350 0x7fd46c0a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 --2- 172.21.15.1:0/120483682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd484100a80 0x7fd48410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 >> 172.21.15.1:0/120483682 conn(0x7fd4840fc7a0 msgr2=0x7fd4840fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 shutdown_connections 2024-09-19T09:02:53.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.939+0000 7fd489d96640 1 -- 172.21.15.1:0/120483682 wait complete. 2024-09-19T09:02:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:53 smithi001 ceph-mon[30939]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:53 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2801838302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:02:54.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:53 smithi064 ceph-mon[35179]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:54.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:53 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2801838302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:02:54.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:53 smithi022 ceph-mon[35107]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:54.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:53 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2801838302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:02:54.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.327+0000 7f8f3feb9640 1 -- 172.21.15.1:0/977684712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38101de0 msgr2=0x7f8f381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.327+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/977684712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38101de0 0x7f8f381021c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009900 tx=0x7f8f3002a410 comp rx=0 tx=0).stop 2024-09-19T09:02:54.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 -- 172.21.15.1:0/977684712 shutdown_connections 2024-09-19T09:02:54.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/977684712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f38106f10 0x7f8f3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/977684712 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f38102790 0x7f8f381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/977684712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38101de0 0x7f8f381021c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 -- 172.21.15.1:0/977684712 >> 172.21.15.1:0/977684712 conn(0x7f8f380fd8c0 msgr2=0x7f8f380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 -- 172.21.15.1:0/977684712 shutdown_connections 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 -- 172.21.15.1:0/977684712 wait complete. 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 Processor -- start 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 -- start start 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f38101de0 0x7f8f3819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f38102790 0x7f8f3819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38106f10 0x7f8f3819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38112090 con 0x7f8f38106f10 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38111f10 con 0x7f8f38101de0 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.328+0000 7f8f3feb9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38112210 con 0x7f8f38102790 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38106f10 0x7f8f3819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38106f10 0x7f8f3819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54752/0 (socket says 172.21.15.1:54752) 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 -- 172.21.15.1:0/2801838302 learned_addr learned my addr 172.21.15.1:0/2801838302 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3dc55640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f38101de0 0x7f8f3819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3d454640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f38102790 0x7f8f3819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 -- 172.21.15.1:0/2801838302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f38102790 msgr2=0x7f8f3819ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f38102790 0x7f8f3819ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 -- 172.21.15.1:0/2801838302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f38101de0 msgr2=0x7f8f3819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f38101de0 0x7f8f3819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 -- 172.21.15.1:0/2801838302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3819f6f0 con 0x7f8f38106f10 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3dc55640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f38101de0 0x7f8f3819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:54.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3d454640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f38102790 0x7f8f3819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3e456640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38106f10 0x7f8f3819f010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800eb10 tx=0x7f8f2800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f36ffd640 1 -- 172.21.15.1:0/2801838302 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28004b20 con 0x7f8f38106f10 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f36ffd640 1 -- 172.21.15.1:0/2801838302 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f28004cc0 con 0x7f8f38106f10 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3819f9e0 con 0x7f8f38106f10 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f36ffd640 1 -- 172.21.15.1:0/2801838302 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f280107f0 con 0x7f8f38106f10 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.329+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f381a72c0 con 0x7f8f38106f10 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.330+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f381021c0 con 0x7f8f38106f10 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.332+0000 7f8f36ffd640 1 -- 172.21.15.1:0/2801838302 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8f28010990 con 0x7f8f38106f10 2024-09-19T09:02:54.262 INFO:teuthology.orchestra.run.smithi001.stdout:309237645334 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.332+0000 7f8f36ffd640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8f200a3350 0x7f8f200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.333+0000 7f8f3dc55640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8f200a3350 0x7f8f200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.333+0000 7f8f36ffd640 1 -- 172.21.15.1:0/2801838302 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8f280d0380 con 0x7f8f38106f10 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.333+0000 7f8f3dc55640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8f200a3350 0x7f8f200a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f30005ab0 tx=0x7f8f30005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.336+0000 7f8f36ffd640 1 -- 172.21.15.1:0/2801838302 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8f28054210 con 0x7f8f38106f10 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.513+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f8f3819baa0 con 0x7f8f38106f10 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.514+0000 7f8f36ffd640 1 -- 172.21.15.1:0/2801838302 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f8f3819baa0 con 0x7f8f38106f10 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8f200a3350 msgr2=0x7f8f200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8f200a3350 0x7f8f200a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f30005ab0 tx=0x7f8f30005a20 comp rx=0 tx=0).stop 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38106f10 msgr2=0x7f8f3819f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38106f10 0x7f8f3819f010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800eb10 tx=0x7f8f2800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 shutdown_connections 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8f38106f10 0x7f8f3819f010 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8f200a3350 0x7f8f200a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8f38102790 0x7f8f3819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 --2- 172.21.15.1:0/2801838302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8f38101de0 0x7f8f3819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 >> 172.21.15.1:0/2801838302 conn(0x7f8f380fd8c0 msgr2=0x7f8f380feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 shutdown_connections 2024-09-19T09:02:54.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:53.516+0000 7f8f3feb9640 1 -- 172.21.15.1:0/2801838302 wait complete. 2024-09-19T09:02:54.862 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495655 got 197568495658 for osd.7 2024-09-19T09:02:54.862 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:54.938 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:54 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/120483682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:02:55.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:54 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/120483682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:02:55.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:54 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/120483682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:02:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 -- 172.21.15.1:0/1898641246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c106f10 msgr2=0x7f1e9c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 --2- 172.21.15.1:0/1898641246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c106f10 0x7f1e9c10ea90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009ca0 tx=0x7f1e9402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 -- 172.21.15.1:0/1898641246 shutdown_connections 2024-09-19T09:02:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 --2- 172.21.15.1:0/1898641246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c106f10 0x7f1e9c10ea90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 --2- 172.21.15.1:0/1898641246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e9c102790 0x7f1e9c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 --2- 172.21.15.1:0/1898641246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e9c101de0 0x7f1e9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 -- 172.21.15.1:0/1898641246 >> 172.21.15.1:0/1898641246 conn(0x7f1e9c0fd8c0 msgr2=0x7f1e9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 -- 172.21.15.1:0/1898641246 shutdown_connections 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.312+0000 7f1ea3131640 1 -- 172.21.15.1:0/1898641246 wait complete. 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea3131640 1 Processor -- start 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea3131640 1 -- start start 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea3131640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e9c101de0 0x7f1e9c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea3131640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c102790 0x7f1e9c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea3131640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e9c106f10 0x7f1e9c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea3131640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c1120d0 con 0x7f1e9c102790 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea3131640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c111f50 con 0x7f1e9c101de0 2024-09-19T09:02:55.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea3131640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c112250 con 0x7f1e9c106f10 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1e9bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c102790 0x7f1e9c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1e9bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c102790 0x7f1e9c198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54782/0 (socket says 172.21.15.1:54782) 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1e9bfff640 1 -- 172.21.15.1:0/321678825 learned_addr learned my addr 172.21.15.1:0/321678825 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea16ce640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e9c106f10 0x7f1e9c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1ea0ecd640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e9c101de0 0x7f1e9c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1e9bfff640 1 -- 172.21.15.1:0/321678825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e9c106f10 msgr2=0x7f1e9c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1e9bfff640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e9c106f10 0x7f1e9c19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1e9bfff640 1 -- 172.21.15.1:0/321678825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e9c101de0 msgr2=0x7f1e9c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1e9bfff640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e9c101de0 0x7f1e9c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.313+0000 7f1e9bfff640 1 -- 172.21.15.1:0/321678825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c19d470 con 0x7f1e9c102790 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.314+0000 7f1e9bfff640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c102790 0x7f1e9c198a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800d950 tx=0x7f1e8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:55.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.314+0000 7f1e99ffb640 1 -- 172.21.15.1:0/321678825 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88017070 con 0x7f1e9c102790 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.314+0000 7f1e99ffb640 1 -- 172.21.15.1:0/321678825 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1e88009c30 con 0x7f1e9c102790 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.314+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9c19d760 con 0x7f1e9c102790 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.314+0000 7f1e99ffb640 1 -- 172.21.15.1:0/321678825 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800f740 con 0x7f1e9c102790 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.314+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9c1a5040 con 0x7f1e9c102790 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.315+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9c1021c0 con 0x7f1e9c102790 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.316+0000 7f1e99ffb640 1 -- 172.21.15.1:0/321678825 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1e88010a80 con 0x7f1e9c102790 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.317+0000 7f1e99ffb640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e8c0a3350 0x7f1e8c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.317+0000 7f1ea0ecd640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e8c0a3350 0x7f1e8c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.317+0000 7f1e99ffb640 1 -- 172.21.15.1:0/321678825 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f1e880cf750 con 0x7f1e9c102790 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.317+0000 7f1ea0ecd640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e8c0a3350 0x7f1e8c0a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000a810 tx=0x7f1e90008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:55.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.321+0000 7f1e99ffb640 1 -- 172.21.15.1:0/321678825 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e88009de0 con 0x7f1e9c102790 2024-09-19T09:02:55.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.500+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1e9c10a150 con 0x7f1e9c102790 2024-09-19T09:02:55.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.500+0000 7f1e99ffb640 1 -- 172.21.15.1:0/321678825 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e8809c2f0 con 0x7f1e9c102790 2024-09-19T09:02:55.500 INFO:teuthology.orchestra.run.smithi001.stdout:73014444100 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e8c0a3350 msgr2=0x7f1e8c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e8c0a3350 0x7f1e8c0a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000a810 tx=0x7f1e90008040 comp rx=0 tx=0).stop 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c102790 msgr2=0x7f1e9c198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c102790 0x7f1e9c198a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800d950 tx=0x7f1e8800de10 comp rx=0 tx=0).stop 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 shutdown_connections 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e8c0a3350 0x7f1e8c0a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e9c106f10 0x7f1e9c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e9c102790 0x7f1e9c198a00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 --2- 172.21.15.1:0/321678825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e9c101de0 0x7f1e9c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 >> 172.21.15.1:0/321678825 conn(0x7f1e9c0fd8c0 msgr2=0x7f1e9c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 shutdown_connections 2024-09-19T09:02:55.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.503+0000 7f1ea3131640 1 -- 172.21.15.1:0/321678825 wait complete. 2024-09-19T09:02:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1373808711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100480 msgr2=0x7fb8cc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1373808711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100480 0x7fb8cc100860 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00aa10 tx=0x7fb8bc02b720 comp rx=0 tx=0).stop 2024-09-19T09:02:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1373808711 shutdown_connections 2024-09-19T09:02:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1373808711 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8cc1055b0 0x7fb8cc10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1373808711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8cc100e30 0x7fb8cc104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1373808711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100480 0x7fb8cc100860 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1373808711 >> 172.21.15.1:0/1373808711 conn(0x7fb8cc077210 msgr2=0x7fb8cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1373808711 shutdown_connections 2024-09-19T09:02:55.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.719+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1373808711 wait complete. 2024-09-19T09:02:55.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.720+0000 7fb8d18d5640 1 Processor -- start 2024-09-19T09:02:55.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.720+0000 7fb8d18d5640 1 -- start start 2024-09-19T09:02:55.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8d18d5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8cc100480 0x7fb8cc0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:55.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8d18d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100e30 0x7fb8cc0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8d18d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8cc1055b0 0x7fb8cc0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8d18d5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc10ff60 con 0x7fb8cc100e30 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8d18d5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc10fde0 con 0x7fb8cc1055b0 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8d18d5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc1100e0 con 0x7fb8cc100480 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100e30 0x7fb8cc0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8cb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8cc1055b0 0x7fb8cc0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100e30 0x7fb8cc0fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54810/0 (socket says 172.21.15.1:54810) 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8cb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8cc1055b0 0x7fb8cc0fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:47036/0 (socket says 172.21.15.1:47036) 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 -- 172.21.15.1:0/1952170853 learned_addr learned my addr 172.21.15.1:0/1952170853 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8caffd640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8cc100480 0x7fb8cc0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 -- 172.21.15.1:0/1952170853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8cc100480 msgr2=0x7fb8cc0fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8cc100480 0x7fb8cc0fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 -- 172.21.15.1:0/1952170853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8cc1055b0 msgr2=0x7fb8cc0fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8cc1055b0 0x7fb8cc0fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 -- 172.21.15.1:0/1952170853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8cc1ab090 con 0x7fb8cc100e30 2024-09-19T09:02:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.721+0000 7fb8ca7fc640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100e30 0x7fb8cc0fcbd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000b4a0 tx=0x7fb8c000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.722+0000 7fb8d08d3640 1 -- 172.21.15.1:0/1952170853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0014070 con 0x7fb8cc100e30 2024-09-19T09:02:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.722+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8cc1ab2c0 con 0x7fb8cc100e30 2024-09-19T09:02:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.722+0000 7fb8d08d3640 1 -- 172.21.15.1:0/1952170853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8c0010b10 con 0x7fb8cc100e30 2024-09-19T09:02:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.722+0000 7fb8d08d3640 1 -- 172.21.15.1:0/1952170853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0017d60 con 0x7fb8cc100e30 2024-09-19T09:02:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.722+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8cc1ab850 con 0x7fb8cc100e30 2024-09-19T09:02:55.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.723+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8cc101960 con 0x7fb8cc100e30 2024-09-19T09:02:55.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.724+0000 7fb8d08d3640 1 -- 172.21.15.1:0/1952170853 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb8c0017070 con 0x7fb8cc100e30 2024-09-19T09:02:55.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.724+0000 7fb8d08d3640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8b40a32d0 0x7fb8b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:55.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.725+0000 7fb8caffd640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8b40a32d0 0x7fb8b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:55.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.725+0000 7fb8d08d3640 1 -- 172.21.15.1:0/1952170853 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb8c00ced60 con 0x7fb8cc100e30 2024-09-19T09:02:55.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.725+0000 7fb8caffd640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8b40a32d0 0x7fb8b40a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00a340 tx=0x7fb8bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:55.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.729+0000 7fb8d08d3640 1 -- 172.21.15.1:0/1952170853 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8c009b360 con 0x7fb8cc100e30 2024-09-19T09:02:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.909+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb8cc10a7a0 con 0x7fb8cc100e30 2024-09-19T09:02:55.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.910+0000 7fb8d08d3640 1 -- 172.21.15.1:0/1952170853 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8c009f660 con 0x7fb8cc100e30 2024-09-19T09:02:55.910 INFO:teuthology.orchestra.run.smithi001.stdout:98784247871 2024-09-19T09:02:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8b40a32d0 msgr2=0x7fb8b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8b40a32d0 0x7fb8b40a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00a340 tx=0x7fb8bc0058d0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100e30 msgr2=0x7fb8cc0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100e30 0x7fb8cc0fcbd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000b4a0 tx=0x7fb8c000b960 comp rx=0 tx=0).stop 2024-09-19T09:02:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 shutdown_connections 2024-09-19T09:02:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8cc1055b0 0x7fb8cc0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8cc100e30 0x7fb8cc0fcbd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8b40a32d0 0x7fb8b40a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 --2- 172.21.15.1:0/1952170853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8cc100480 0x7fb8cc0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:55.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 >> 172.21.15.1:0/1952170853 conn(0x7fb8cc077210 msgr2=0x7fb8cc103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:55.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 shutdown_connections 2024-09-19T09:02:55.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:55.912+0000 7fb8d18d5640 1 -- 172.21.15.1:0/1952170853 wait complete. 2024-09-19T09:02:56.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:55 smithi001 ceph-mon[30939]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:56.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:55 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/321678825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:02:56.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:55 smithi064 ceph-mon[35179]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:56.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:55 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/321678825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:02:56.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:55 smithi022 ceph-mon[35107]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:02:56.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:55 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/321678825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:02:56.510 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005087 got 261993005089 for osd.9 2024-09-19T09:02:56.510 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 -- 172.21.15.1:0/1327867352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 msgr2=0x7f67341067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 --2- 172.21.15.1:0/1327867352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 0x7f67341067f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6728009900 tx=0x7f672802a410 comp rx=0 tx=0).stop 2024-09-19T09:02:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 -- 172.21.15.1:0/1327867352 shutdown_connections 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 --2- 172.21.15.1:0/1327867352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6734106f20 0x7f673410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 --2- 172.21.15.1:0/1327867352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 0x7f67341067f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 --2- 172.21.15.1:0/1327867352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6734101df0 0x7f67341021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 -- 172.21.15.1:0/1327867352 >> 172.21.15.1:0/1327867352 conn(0x7f67340fd8b0 msgr2=0x7f67340ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 -- 172.21.15.1:0/1327867352 shutdown_connections 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.468+0000 7f673b860640 1 -- 172.21.15.1:0/1327867352 wait complete. 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f673b860640 1 Processor -- start 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f673b860640 1 -- start start 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f673b860640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6734101df0 0x7f6734198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f673b860640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 0x7f6734198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f673b860640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6734106f20 0x7f673419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f673b860640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6734112060 con 0x7f67341027a0 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f673b860640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6734111ee0 con 0x7f6734101df0 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f673b860640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f67341121e0 con 0x7f6734106f20 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f6738dfb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 0x7f6734198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f6738dfb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 0x7f6734198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54826/0 (socket says 172.21.15.1:54826) 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f6738dfb640 1 -- 172.21.15.1:0/2305129642 learned_addr learned my addr 172.21.15.1:0/2305129642 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f6739dfd640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6734106f20 0x7f673419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.469+0000 7f67395fc640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6734101df0 0x7f6734198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f6738dfb640 1 -- 172.21.15.1:0/2305129642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6734106f20 msgr2=0x7f673419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f6738dfb640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6734106f20 0x7f673419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f6738dfb640 1 -- 172.21.15.1:0/2305129642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6734101df0 msgr2=0x7f6734198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f6738dfb640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6734101df0 0x7f6734198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f6738dfb640 1 -- 172.21.15.1:0/2305129642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673419d4b0 con 0x7f67341027a0 2024-09-19T09:02:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f6738dfb640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 0x7f6734198a40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6728006010 tx=0x7f67280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f67267fc640 1 -- 172.21.15.1:0/2305129642 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672803f030 con 0x7f67341027a0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673419d740 con 0x7f67341027a0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f67267fc640 1 -- 172.21.15.1:0/2305129642 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6728003d00 con 0x7f67341027a0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f67267fc640 1 -- 172.21.15.1:0/2305129642 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728035070 con 0x7f67341027a0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.470+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67341a5080 con 0x7f67341027a0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.471+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67341032d0 con 0x7f67341027a0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.472+0000 7f67267fc640 1 -- 172.21.15.1:0/2305129642 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6728042030 con 0x7f67341027a0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.473+0000 7f67267fc640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f67200a32d0 0x7f67200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.473+0000 7f67395fc640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f67200a32d0 0x7f67200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.473+0000 7f67267fc640 1 -- 172.21.15.1:0/2305129642 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f67280f0350 con 0x7f67341027a0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.474+0000 7f67395fc640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f67200a32d0 0x7f67200a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f673000abe0 tx=0x7f673000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.476+0000 7f67267fc640 1 -- 172.21.15.1:0/2305129642 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67280bce90 con 0x7f67341027a0 2024-09-19T09:02:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:56.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.673+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f673410a160 con 0x7f67341027a0 2024-09-19T09:02:56.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.673+0000 7f67267fc640 1 -- 172.21.15.1:0/2305129642 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f67280bc790 con 0x7f67341027a0 2024-09-19T09:02:56.673 INFO:teuthology.orchestra.run.smithi001.stdout:279172874268 2024-09-19T09:02:56.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f67200a32d0 msgr2=0x7f67200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f67200a32d0 0x7f67200a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f673000abe0 tx=0x7f673000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 msgr2=0x7f6734198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 0x7f6734198a40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6728006010 tx=0x7f67280042f0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 shutdown_connections 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f67200a32d0 0x7f67200a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6734106f20 0x7f673419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f67341027a0 0x7f6734198a40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 --2- 172.21.15.1:0/2305129642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6734101df0 0x7f6734198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 >> 172.21.15.1:0/2305129642 conn(0x7f67340fd8b0 msgr2=0x7f67340feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 shutdown_connections 2024-09-19T09:02:56.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:56.675+0000 7f673b860640 1 -- 172.21.15.1:0/2305129642 wait complete. 2024-09-19T09:02:56.920 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:56 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1952170853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:02:56.920 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:56 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2305129642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:02:56.946 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247868 got 98784247871 for osd.3 2024-09-19T09:02:56.947 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:57.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:56 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1952170853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:02:57.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:56 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2305129642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:02:57.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:56 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1952170853' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:02:57.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:56 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2305129642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:02:57.379 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645332 got 309237645334 for osd.11 2024-09-19T09:02:57.379 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:57.839 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444098 got 73014444100 for osd.2 2024-09-19T09:02:57.839 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:57 smithi001 ceph-mon[30939]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:02:58.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:57 smithi064 ceph-mon[35179]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:02:58.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:57 smithi022 ceph-mon[35107]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:02:58.439 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874266 got 279172874268 for osd.10 2024-09-19T09:02:58.439 DEBUG:teuthology.parallel:result is None 2024-09-19T09:02:58.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/1295695902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4106f10 msgr2=0x7f1ba410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/1295695902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4106f10 0x7f1ba410ea90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009ca0 tx=0x7f1b9c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/1295695902 shutdown_connections 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/1295695902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4106f10 0x7f1ba410ea90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/1295695902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ba4102790 0x7f1ba41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/1295695902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ba4101de0 0x7f1ba41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/1295695902 >> 172.21.15.1:0/1295695902 conn(0x7f1ba40fd8c0 msgr2=0x7f1ba40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/1295695902 shutdown_connections 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.934+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/1295695902 wait complete. 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba8a2d640 1 Processor -- start 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba8a2d640 1 -- start start 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba8a2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4101de0 0x7f1ba40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba8a2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ba4102790 0x7f1ba4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba8a2d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ba4106f10 0x7f1ba4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba8a2d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba4112090 con 0x7f1ba4101de0 2024-09-19T09:02:58.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba8a2d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba4111f10 con 0x7f1ba4102790 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba8a2d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba4112210 con 0x7f1ba4106f10 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4101de0 0x7f1ba40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4101de0 0x7f1ba40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54850/0 (socket says 172.21.15.1:54850) 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba259c640 1 -- 172.21.15.1:0/4121063398 learned_addr learned my addr 172.21.15.1:0/4121063398 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba1d9b640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ba4102790 0x7f1ba4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba2d9d640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ba4106f10 0x7f1ba4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba259c640 1 -- 172.21.15.1:0/4121063398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ba4106f10 msgr2=0x7f1ba4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba259c640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ba4106f10 0x7f1ba4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba259c640 1 -- 172.21.15.1:0/4121063398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ba4102790 msgr2=0x7f1ba4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.935+0000 7f1ba259c640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ba4102790 0x7f1ba4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.936+0000 7f1ba259c640 1 -- 172.21.15.1:0/4121063398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba41a68d0 con 0x7f1ba4101de0 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.936+0000 7f1ba259c640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4101de0 0x7f1ba40744f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400c920 tx=0x7f1b9400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.936+0000 7f1b9b7fe640 1 -- 172.21.15.1:0/4121063398 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94007c70 con 0x7f1ba4101de0 2024-09-19T09:02:58.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.936+0000 7f1b9b7fe640 1 -- 172.21.15.1:0/4121063398 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b94007e10 con 0x7f1ba4101de0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.936+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba41a6bc0 con 0x7f1ba4101de0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.936+0000 7f1b9b7fe640 1 -- 172.21.15.1:0/4121063398 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94018940 con 0x7f1ba4101de0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.936+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba41a7150 con 0x7f1ba4101de0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.937+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba41021c0 con 0x7f1ba4101de0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.938+0000 7f1b9b7fe640 1 -- 172.21.15.1:0/4121063398 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1b94018b00 con 0x7f1ba4101de0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.939+0000 7f1b9b7fe640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1b900a3350 0x7f1b900a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.939+0000 7f1b9b7fe640 1 -- 172.21.15.1:0/4121063398 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f1b940cfd70 con 0x7f1ba4101de0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.939+0000 7f1ba1d9b640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1b900a3350 0x7f1b900a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.940+0000 7f1ba1d9b640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1b900a3350 0x7f1b900a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4075f80 tx=0x7f1b8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:58.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:58.942+0000 7f1b9b7fe640 1 -- 172.21.15.1:0/4121063398 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b94014030 con 0x7f1ba4101de0 2024-09-19T09:02:59.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:58 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:59.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:58 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:59.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.129+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f1ba4075a20 con 0x7f1ba4101de0 2024-09-19T09:02:59.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.129+0000 7f1b9b7fe640 1 -- 172.21.15.1:0/4121063398 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1ba4075a20 con 0x7f1ba4101de0 2024-09-19T09:02:59.129 INFO:teuthology.orchestra.run.smithi001.stdout:227633266726 2024-09-19T09:02:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1b900a3350 msgr2=0x7f1b900a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1b900a3350 0x7f1b900a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4075f80 tx=0x7f1b8c005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:59.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4101de0 msgr2=0x7f1ba40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4101de0 0x7f1ba40744f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400c920 tx=0x7f1b9400cde0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 shutdown_connections 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1b900a3350 0x7f1b900a5810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ba4106f10 0x7f1ba4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ba4102790 0x7f1ba4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 --2- 172.21.15.1:0/4121063398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ba4101de0 0x7f1ba40744f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 >> 172.21.15.1:0/4121063398 conn(0x7f1ba40fd8c0 msgr2=0x7f1ba40ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.131+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 shutdown_connections 2024-09-19T09:02:59.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.132+0000 7f1ba8a2d640 1 -- 172.21.15.1:0/4121063398 wait complete. 2024-09-19T09:02:59.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:58 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:59.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3708431269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c103780 msgr2=0x7f4a2c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3708431269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c103780 0x7f4a2c107bc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009930 tx=0x7f4a1402a420 comp rx=0 tx=0).stop 2024-09-19T09:02:59.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3708431269 shutdown_connections 2024-09-19T09:02:59.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3708431269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a2c108300 0x7f4a2c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3708431269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c103780 0x7f4a2c107bc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3708431269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c102dd0 0x7f4a2c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3708431269 >> 172.21.15.1:0/3708431269 conn(0x7f4a2c0fc7d0 msgr2=0x7f4a2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3708431269 shutdown_connections 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.268+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3708431269 wait complete. 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a30d8d640 1 Processor -- start 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a30d8d640 1 -- start start 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a30d8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c102dd0 0x7f4a2c198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a30d8d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a2c103780 0x7f4a2c198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a30d8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c108300 0x7f4a2c19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a30d8d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c1121f0 con 0x7f4a2c102dd0 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a30d8d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c112070 con 0x7f4a2c108300 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a30d8d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c112370 con 0x7f4a2c103780 2024-09-19T09:02:59.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c102dd0 0x7f4a2c198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c102dd0 0x7f4a2c198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54878/0 (socket says 172.21.15.1:54878) 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 -- 172.21.15.1:0/3852068522 learned_addr learned my addr 172.21.15.1:0/3852068522 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a29d9b640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a2c103780 0x7f4a2c198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2ad9d640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c108300 0x7f4a2c19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 -- 172.21.15.1:0/3852068522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a2c103780 msgr2=0x7f4a2c198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a2c103780 0x7f4a2c198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 -- 172.21.15.1:0/3852068522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c108300 msgr2=0x7f4a2c19cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c108300 0x7f4a2c19cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 -- 172.21.15.1:0/3852068522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c19d610 con 0x7f4a2c102dd0 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.269+0000 7f4a2a59c640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c102dd0 0x7f4a2c198660 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400e9f0 tx=0x7f4a2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.270+0000 7f4a237fe640 1 -- 172.21.15.1:0/3852068522 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400cd80 con 0x7f4a2c102dd0 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.270+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c19d900 con 0x7f4a2c102dd0 2024-09-19T09:02:59.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.270+0000 7f4a237fe640 1 -- 172.21.15.1:0/3852068522 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4a24010930 con 0x7f4a2c102dd0 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.270+0000 7f4a237fe640 1 -- 172.21.15.1:0/3852068522 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24018b00 con 0x7f4a2c102dd0 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.270+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2c1a51e0 con 0x7f4a2c102dd0 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.271+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c06a7b0 con 0x7f4a2c102dd0 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.272+0000 7f4a237fe640 1 -- 172.21.15.1:0/3852068522 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4a24018ca0 con 0x7f4a2c102dd0 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.273+0000 7f4a237fe640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a180a32d0 0x7f4a180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.273+0000 7f4a29d9b640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a180a32d0 0x7f4a180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.273+0000 7f4a237fe640 1 -- 172.21.15.1:0/3852068522 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4a240cfea0 con 0x7f4a2c102dd0 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.273+0000 7f4a29d9b640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a180a32d0 0x7f4a180a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4a14005940 tx=0x7f4a140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:59.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.277+0000 7f4a237fe640 1 -- 172.21.15.1:0/3852068522 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a2409c390 con 0x7f4a2c102dd0 2024-09-19T09:02:59.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.460+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4a2c1999c0 con 0x7f4a2c102dd0 2024-09-19T09:02:59.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.461+0000 7f4a237fe640 1 -- 172.21.15.1:0/3852068522 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a240a0690 con 0x7f4a2c102dd0 2024-09-19T09:02:59.461 INFO:teuthology.orchestra.run.smithi001.stdout:51539607626 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.462+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a180a32d0 msgr2=0x7f4a180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.462+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a180a32d0 0x7f4a180a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4a14005940 tx=0x7f4a140058d0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.462+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c102dd0 msgr2=0x7f4a2c198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.462+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c102dd0 0x7f4a2c198660 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400e9f0 tx=0x7f4a2400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.463+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 shutdown_connections 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.463+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c108300 0x7f4a2c19cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.463+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a180a32d0 0x7f4a180a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.463+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a2c103780 0x7f4a2c198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.463+0000 7f4a30d8d640 1 --2- 172.21.15.1:0/3852068522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a2c102dd0 0x7f4a2c198660 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.463+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 >> 172.21.15.1:0/3852068522 conn(0x7f4a2c0fc7d0 msgr2=0x7f4a2c105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.463+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 shutdown_connections 2024-09-19T09:02:59.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:02:59.463+0000 7f4a30d8d640 1 -- 172.21.15.1:0/3852068522 wait complete. 2024-09-19T09:02:59.710 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626477 got 180388626480 for osd.6 2024-09-19T09:02:59.710 DEBUG:teuthology.parallel:result is None 2024-09-19T09:03:00.035 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:59 smithi001 ceph-mon[30939]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:00.035 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:59 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4121063398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:03:00.035 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:02:59 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3852068522' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:03:00.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:59 smithi064 ceph-mon[35179]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:00.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:59 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4121063398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:03:00.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:02:59 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3852068522' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:03:00.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:59 smithi022 ceph-mon[35107]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:00.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:59 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4121063398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:03:00.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:02:59 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3852068522' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:03:00.341 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:00.362 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607623 got 51539607626 for osd.1 2024-09-19T09:03:00.362 DEBUG:teuthology.parallel:result is None 2024-09-19T09:03:00.579 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:00.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266724 got 227633266726 for osd.8 2024-09-19T09:03:00.988 DEBUG:teuthology.parallel:result is None 2024-09-19T09:03:01.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:01 smithi001 ceph-mon[30939]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T09:03:01.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:01 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:01 smithi064 ceph-mon[35179]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T09:03:01.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:01 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:01 smithi022 ceph-mon[35107]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T09:03:01.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:01 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 -- 172.21.15.1:0/1683621648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9801082a0 msgr2=0x7fe98010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 --2- 172.21.15.1:0/1683621648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9801082a0 0x7fe98010ec40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe978009cd0 tx=0x7fe97802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 -- 172.21.15.1:0/1683621648 shutdown_connections 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 --2- 172.21.15.1:0/1683621648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe9801082a0 0x7fe98010ec40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 --2- 172.21.15.1:0/1683621648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9801036e0 0x7fe980107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 --2- 172.21.15.1:0/1683621648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe980102d30 0x7fe980103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 -- 172.21.15.1:0/1683621648 >> 172.21.15.1:0/1683621648 conn(0x7fe9800fc7d0 msgr2=0x7fe9800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 -- 172.21.15.1:0/1683621648 shutdown_connections 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 -- 172.21.15.1:0/1683621648 wait complete. 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.664+0000 7fe986239640 1 Processor -- start 2024-09-19T09:03:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe986239640 1 -- start start 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe986239640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe980102d30 0x7fe980198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe986239640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9801036e0 0x7fe980198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe986239640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9801082a0 0x7fe98019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe986239640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe9801121c0 con 0x7fe980102d30 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe986239640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe980112040 con 0x7fe9801082a0 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe986239640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe980112340 con 0x7fe9801036e0 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe980102d30 0x7fe980198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe980102d30 0x7fe980198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54886/0 (socket says 172.21.15.1:54886) 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97f7fe640 1 -- 172.21.15.1:0/3178091708 learned_addr learned my addr 172.21.15.1:0/3178091708 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97effd640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9801036e0 0x7fe980198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97f7fe640 1 -- 172.21.15.1:0/3178091708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9801036e0 msgr2=0x7fe980198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97f7fe640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9801036e0 0x7fe980198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97f7fe640 1 -- 172.21.15.1:0/3178091708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9801082a0 msgr2=0x7fe98019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97ffff640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9801082a0 0x7fe98019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97f7fe640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9801082a0 0x7fe98019ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.665+0000 7fe97f7fe640 1 -- 172.21.15.1:0/3178091708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98019d5b0 con 0x7fe980102d30 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.666+0000 7fe97f7fe640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe980102d30 0x7fe980198600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe97000d950 tx=0x7fe97000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.666+0000 7fe97cff9640 1 -- 172.21.15.1:0/3178091708 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970017070 con 0x7fe980102d30 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.666+0000 7fe97cff9640 1 -- 172.21.15.1:0/3178091708 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe970009c30 con 0x7fe980102d30 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.666+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98019d8a0 con 0x7fe980102d30 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.666+0000 7fe97cff9640 1 -- 172.21.15.1:0/3178091708 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97000f740 con 0x7fe980102d30 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.666+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9801a5180 con 0x7fe980102d30 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.667+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe980103110 con 0x7fe980102d30 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.668+0000 7fe97cff9640 1 -- 172.21.15.1:0/3178091708 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe970010a80 con 0x7fe980102d30 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.668+0000 7fe97cff9640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9680a3350 0x7fe9680a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.669+0000 7fe97effd640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9680a3350 0x7fe9680a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.669+0000 7fe97cff9640 1 -- 172.21.15.1:0/3178091708 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe9700cf750 con 0x7fe980102d30 2024-09-19T09:03:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.669+0000 7fe97effd640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9680a3350 0x7fe9680a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe974005e00 tx=0x7fe974005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.673+0000 7fe97cff9640 1 -- 172.21.15.1:0/3178091708 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe970009de0 con 0x7fe980102d30 2024-09-19T09:03:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.852+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe9801a5350 con 0x7fe980102d30 2024-09-19T09:03:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.852+0000 7fe97cff9640 1 -- 172.21.15.1:0/3178091708 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe97009c2f0 con 0x7fe980102d30 2024-09-19T09:03:01.852 INFO:teuthology.orchestra.run.smithi001.stdout:150323855414 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9680a3350 msgr2=0x7fe9680a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9680a3350 0x7fe9680a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe974005e00 tx=0x7fe974005c50 comp rx=0 tx=0).stop 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe980102d30 msgr2=0x7fe980198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe980102d30 0x7fe980198600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe97000d950 tx=0x7fe97000de10 comp rx=0 tx=0).stop 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 shutdown_connections 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9801082a0 0x7fe98019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9680a3350 0x7fe9680a5810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe9801036e0 0x7fe980198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 --2- 172.21.15.1:0/3178091708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe980102d30 0x7fe980198600 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 >> 172.21.15.1:0/3178091708 conn(0x7fe9800fc7d0 msgr2=0x7fe980105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 shutdown_connections 2024-09-19T09:03:01.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.855+0000 7fe986239640 1 -- 172.21.15.1:0/3178091708 wait complete. 2024-09-19T09:03:01.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 -- 172.21.15.1:0/911943249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc100e20 msgr2=0x7f58fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 --2- 172.21.15.1:0/911943249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc100e20 0x7f58fc101200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009900 tx=0x7f58f002a480 comp rx=0 tx=0).stop 2024-09-19T09:03:01.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 -- 172.21.15.1:0/911943249 shutdown_connections 2024-09-19T09:03:01.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 --2- 172.21.15.1:0/911943249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58fc102ef0 0x7f58fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 --2- 172.21.15.1:0/911943249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58fc102570 0x7f58fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 --2- 172.21.15.1:0/911943249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc100e20 0x7f58fc101200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 -- 172.21.15.1:0/911943249 >> 172.21.15.1:0/911943249 conn(0x7f58fc0fc7d0 msgr2=0x7f58fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 -- 172.21.15.1:0/911943249 shutdown_connections 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.897+0000 7f5902c04640 1 -- 172.21.15.1:0/911943249 wait complete. 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f5902c04640 1 Processor -- start 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f5902c04640 1 -- start start 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f5902c04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58fc100e20 0x7f58fc1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f5902c04640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58fc102570 0x7f58fc197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f5902c04640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc102ef0 0x7f58fc19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f5902c04640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc111070 con 0x7f58fc102ef0 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f5902c04640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc110ef0 con 0x7f58fc100e20 2024-09-19T09:03:01.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f5902c04640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1111f0 con 0x7f58fc102570 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f59011a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc102ef0 0x7f58fc19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f59011a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc102ef0 0x7f58fc19bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54904/0 (socket says 172.21.15.1:54904) 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f59011a1640 1 -- 172.21.15.1:0/1564710473 learned_addr learned my addr 172.21.15.1:0/1564710473 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.898+0000 7f59009a0640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58fc100e20 0x7f58fc1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f58fbfff640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58fc102570 0x7f58fc197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f59011a1640 1 -- 172.21.15.1:0/1564710473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58fc102570 msgr2=0x7f58fc197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f59011a1640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58fc102570 0x7f58fc197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f59011a1640 1 -- 172.21.15.1:0/1564710473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58fc100e20 msgr2=0x7f58fc1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f59011a1640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58fc100e20 0x7f58fc1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f59011a1640 1 -- 172.21.15.1:0/1564710473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc19c480 con 0x7f58fc102ef0 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f59009a0640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58fc100e20 0x7f58fc1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f59011a1640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc102ef0 0x7f58fc19bda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f58f4007c30 tx=0x7f58f400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f58f9ffb640 1 -- 172.21.15.1:0/1564710473 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4019020 con 0x7f58fc102ef0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f58f9ffb640 1 -- 172.21.15.1:0/1564710473 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f58f4007e40 con 0x7f58fc102ef0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f58f9ffb640 1 -- 172.21.15.1:0/1564710473 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4005690 con 0x7f58fc102ef0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58fc19c770 con 0x7f58fc102ef0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.899+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58fc069f70 con 0x7f58fc102ef0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.900+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58fc101200 con 0x7f58fc102ef0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.901+0000 7f58f9ffb640 1 -- 172.21.15.1:0/1564710473 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f58f4005850 con 0x7f58fc102ef0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.902+0000 7f58f9ffb640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58ec0a3350 0x7f58ec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.902+0000 7f59009a0640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58ec0a3350 0x7f58ec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.902+0000 7f58f9ffb640 1 -- 172.21.15.1:0/1564710473 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f58f40d13e0 con 0x7f58fc102ef0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.903+0000 7f59009a0640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58ec0a3350 0x7f58ec0a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58f0031580 tx=0x7f58f0032d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:01.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:01.906+0000 7f58f9ffb640 1 -- 172.21.15.1:0/1564710473 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58f4023020 con 0x7f58fc102ef0 2024-09-19T09:03:02.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.083+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f58fc06a1d0 con 0x7f58fc102ef0 2024-09-19T09:03:02.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.083+0000 7f58f9ffb640 1 -- 172.21.15.1:0/1564710473 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58f409e010 con 0x7f58fc102ef0 2024-09-19T09:03:02.084 INFO:teuthology.orchestra.run.smithi001.stdout:34359738448 2024-09-19T09:03:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58ec0a3350 msgr2=0x7f58ec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58ec0a3350 0x7f58ec0a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58f0031580 tx=0x7f58f0032d20 comp rx=0 tx=0).stop 2024-09-19T09:03:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc102ef0 msgr2=0x7f58fc19bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc102ef0 0x7f58fc19bda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f58f4007c30 tx=0x7f58f400e420 comp rx=0 tx=0).stop 2024-09-19T09:03:02.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 shutdown_connections 2024-09-19T09:03:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58fc102ef0 0x7f58fc19bda0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f58ec0a3350 0x7f58ec0a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58fc102570 0x7f58fc197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 --2- 172.21.15.1:0/1564710473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58fc100e20 0x7f58fc1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 >> 172.21.15.1:0/1564710473 conn(0x7f58fc0fc7d0 msgr2=0x7f58fc106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 shutdown_connections 2024-09-19T09:03:02.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:02.085+0000 7f5902c04640 1 -- 172.21.15.1:0/1564710473 wait complete. 2024-09-19T09:03:02.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:02 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3178091708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:03:02.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:02 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3178091708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:03:02.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:02 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3178091708' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:03:02.711 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738448 for osd.0 2024-09-19T09:03:02.711 DEBUG:teuthology.parallel:result is None 2024-09-19T09:03:03.122 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855411 got 150323855414 for osd.5 2024-09-19T09:03:03.122 DEBUG:teuthology.parallel:result is None 2024-09-19T09:03:03.123 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:03:03.123 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:03:03.355 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:03 smithi064 ceph-mon[35179]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-19T09:03:03.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:03 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1564710473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:03:03.427 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:03 smithi001 ceph-mon[30939]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-19T09:03:03.427 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:03 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1564710473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:03:03.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:03 smithi022 ceph-mon[35107]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-19T09:03:03.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:03 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1564710473' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:03:03.954 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:04.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.378+0000 7f346ee86640 1 -- 172.21.15.1:0/1971851787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468101de0 msgr2=0x7f34681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:04.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.378+0000 7f346ee86640 1 --2- 172.21.15.1:0/1971851787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468101de0 0x7f34681021c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f345c009900 tx=0x7f345c02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:04.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.378+0000 7f346ee86640 1 -- 172.21.15.1:0/1971851787 shutdown_connections 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.378+0000 7f346ee86640 1 --2- 172.21.15.1:0/1971851787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3468106f10 0x7f346810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.378+0000 7f346ee86640 1 --2- 172.21.15.1:0/1971851787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3468102790 0x7f34681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.378+0000 7f346ee86640 1 --2- 172.21.15.1:0/1971851787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468101de0 0x7f34681021c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.378+0000 7f346ee86640 1 -- 172.21.15.1:0/1971851787 >> 172.21.15.1:0/1971851787 conn(0x7f34680fd8c0 msgr2=0x7f34680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.379+0000 7f346ee86640 1 -- 172.21.15.1:0/1971851787 shutdown_connections 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.379+0000 7f346ee86640 1 -- 172.21.15.1:0/1971851787 wait complete. 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.379+0000 7f346ee86640 1 Processor -- start 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.379+0000 7f346ee86640 1 -- start start 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346ee86640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3468101de0 0x7f3468198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346ee86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468102790 0x7f3468198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346ee86640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3468106f10 0x7f346819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:04.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346ee86640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3468112090 con 0x7f3468102790 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346ee86640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3468111f10 con 0x7f3468101de0 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346ee86640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3468112210 con 0x7f3468106f10 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468102790 0x7f3468198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346cc22640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3468101de0 0x7f3468198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468102790 0x7f3468198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55838/0 (socket says 172.21.15.1:55838) 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346cc22640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3468101de0 0x7f3468198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46120/0 (socket says 172.21.15.1:46120) 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 -- 172.21.15.1:0/3323767346 learned_addr learned my addr 172.21.15.1:0/3323767346 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f346d423640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3468106f10 0x7f346819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 -- 172.21.15.1:0/3323767346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3468106f10 msgr2=0x7f346819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:04.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3468106f10 0x7f346819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 -- 172.21.15.1:0/3323767346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3468101de0 msgr2=0x7f3468198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3468101de0 0x7f3468198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 -- 172.21.15.1:0/3323767346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346819d4c0 con 0x7f3468102790 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.380+0000 7f3467fff640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468102790 0x7f3468198a50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f345400c970 tx=0x7f345400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.381+0000 7f3465ffb640 1 -- 172.21.15.1:0/3323767346 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454007bb0 con 0x7f3468102790 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.381+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346819d7b0 con 0x7f3468102790 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.381+0000 7f3465ffb640 1 -- 172.21.15.1:0/3323767346 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3454007d50 con 0x7f3468102790 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.381+0000 7f3465ffb640 1 -- 172.21.15.1:0/3323767346 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345400f4b0 con 0x7f3468102790 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.381+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34681a5090 con 0x7f3468102790 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.382+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34681021c0 con 0x7f3468102790 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.383+0000 7f3465ffb640 1 -- 172.21.15.1:0/3323767346 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f34540046c0 con 0x7f3468102790 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.383+0000 7f3465ffb640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f34580a32d0 0x7f34580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:04.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.384+0000 7f346cc22640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f34580a32d0 0x7f34580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:04.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.384+0000 7f3465ffb640 1 -- 172.21.15.1:0/3323767346 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f34540cf800 con 0x7f3468102790 2024-09-19T09:03:04.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.384+0000 7f346cc22640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f34580a32d0 0x7f34580a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f345c009230 tx=0x7f345c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:04.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.388+0000 7f3465ffb640 1 -- 172.21.15.1:0/3323767346 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3454014030 con 0x7f3468102790 2024-09-19T09:03:04.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.584+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f346810a150 con 0x7f34580a32d0 2024-09-19T09:03:04.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.591+0000 7f3465ffb640 1 -- 172.21.15.1:0/3323767346 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258718 (secure 0 0 0) 0x7f346810a150 con 0x7f34580a32d0 2024-09-19T09:03:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:04.597 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:03:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f34580a32d0 msgr2=0x7f34580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f34580a32d0 0x7f34580a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f345c009230 tx=0x7f345c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468102790 msgr2=0x7f3468198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468102790 0x7f3468198a50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f345400c970 tx=0x7f345400ce30 comp rx=0 tx=0).stop 2024-09-19T09:03:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 shutdown_connections 2024-09-19T09:03:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f34580a32d0 0x7f34580a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3468106f10 0x7f346819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468102790 0x7f3468198a50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 --2- 172.21.15.1:0/3323767346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3468101de0 0x7f3468198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:04.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 >> 172.21.15.1:0/3323767346 conn(0x7f34680fd8c0 msgr2=0x7f34680febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:04.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.595+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 shutdown_connections 2024-09-19T09:03:04.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:04.596+0000 7f346ee86640 1 -- 172.21.15.1:0/3323767346 wait complete. 2024-09-19T09:03:05.213 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-19T09:03:03.952197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656915,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":447,"num_read_kb":341,"num_write":346,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390792,"kb_used_data":12408,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551032,"statfs":{"total":1151940427776,"available":1151540256768,"internally_reserved":0,"allocated":12705792,"data_stored":7090425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":34,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002901"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684751+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:02:11.684751+0000","last_peered":"2024-09-19T09:02:11.684751+0000","last_clean":"2024-09-19T09:02:11.684751+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:02:11.684751+0000","last_undegraded":"2024-09-19T09:02:11.684751+0000","last_fullsized":"2024-09-19T09:02:11.684751+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685274+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:02:11.685274+0000","last_peered":"2024-09-19T09:02:11.685274+0000","last_clean":"2024-09-19T09:02:11.685274+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:02:11.685274+0000","last_undegraded":"2024-09-19T09:02:11.685274+0000","last_fullsized":"2024-09-19T09:02:11.685274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685391+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:02:11.685391+0000","last_peered":"2024-09-19T09:02:11.685391+0000","last_clean":"2024-09-19T09:02:11.685391+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:02:11.685391+0000","last_undegraded":"2024-09-19T09:02:11.685391+0000","last_fullsized":"2024-09-19T09:02:11.685391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697115+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:02:11.697115+0000","last_peered":"2024-09-19T09:02:11.697115+0000","last_clean":"2024-09-19T09:02:11.697115+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:02:11.697115+0000","last_undegraded":"2024-09-19T09:02:11.697115+0000","last_fullsized":"2024-09-19T09:02:11.697115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687096+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:02:11.687096+0000","last_peered":"2024-09-19T09:02:11.687096+0000","last_clean":"2024-09-19T09:02:11.687096+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:02:11.687096+0000","last_undegraded":"2024-09-19T09:02:11.687096+0000","last_fullsized":"2024-09-19T09:02:11.687096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683669+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:02:11.683669+0000","last_peered":"2024-09-19T09:02:11.683669+0000","last_clean":"2024-09-19T09:02:11.683669+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:02:11.683669+0000","last_undegraded":"2024-09-19T09:02:11.683669+0000","last_fullsized":"2024-09-19T09:02:11.683669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.722501+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:02:11.722501+0000","last_peered":"2024-09-19T09:02:11.722501+0000","last_clean":"2024-09-19T09:02:11.722501+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:02:11.722501+0000","last_undegraded":"2024-09-19T09:02:11.722501+0000","last_fullsized":"2024-09-19T09:02:11.722501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682881+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:02:11.682881+0000","last_peered":"2024-09-19T09:02:11.682881+0000","last_clean":"2024-09-19T09:02:11.682881+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:02:11.682881+0000","last_undegraded":"2024-09-19T09:02:11.682881+0000","last_fullsized":"2024-09-19T09:02:11.682881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.690180+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:02:11.690180+0000","last_peered":"2024-09-19T09:02:11.690180+0000","last_clean":"2024-09-19T09:02:11.690180+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:02:11.690180+0000","last_undegraded":"2024-09-19T09:02:11.690180+0000","last_fullsized":"2024-09-19T09:02:11.690180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684237+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:02:11.684237+0000","last_peered":"2024-09-19T09:02:11.684237+0000","last_clean":"2024-09-19T09:02:11.684237+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:02:11.684237+0000","last_undegraded":"2024-09-19T09:02:11.684237+0000","last_fullsized":"2024-09-19T09:02:11.684237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688749+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:02:11.688749+0000","last_peered":"2024-09-19T09:02:11.688749+0000","last_clean":"2024-09-19T09:02:11.688749+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:02:11.688749+0000","last_undegraded":"2024-09-19T09:02:11.688749+0000","last_fullsized":"2024-09-19T09:02:11.688749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697164+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:02:11.697164+0000","last_peered":"2024-09-19T09:02:11.697164+0000","last_clean":"2024-09-19T09:02:11.697164+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:02:11.697164+0000","last_undegraded":"2024-09-19T09:02:11.697164+0000","last_fullsized":"2024-09-19T09:02:11.697164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721263+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:02:11.721263+0000","last_peered":"2024-09-19T09:02:11.721263+0000","last_clean":"2024-09-19T09:02:11.721263+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:02:11.721263+0000","last_undegraded":"2024-09-19T09:02:11.721263+0000","last_fullsized":"2024-09-19T09:02:11.721263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685216+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:02:11.685216+0000","last_peered":"2024-09-19T09:02:11.685216+0000","last_clean":"2024-09-19T09:02:11.685216+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:02:11.685216+0000","last_undegraded":"2024-09-19T09:02:11.685216+0000","last_fullsized":"2024-09-19T09:02:11.685216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684970+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:02:11.684970+0000","last_peered":"2024-09-19T09:02:11.684970+0000","last_clean":"2024-09-19T09:02:11.684970+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:02:11.684970+0000","last_undegraded":"2024-09-19T09:02:11.684970+0000","last_fullsized":"2024-09-19T09:02:11.684970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689295+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:02:11.689295+0000","last_peered":"2024-09-19T09:02:11.689295+0000","last_clean":"2024-09-19T09:02:11.689295+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:02:11.689295+0000","last_undegraded":"2024-09-19T09:02:11.689295+0000","last_fullsized":"2024-09-19T09:02:11.689295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684879+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:02:11.684879+0000","last_peered":"2024-09-19T09:02:11.684879+0000","last_clean":"2024-09-19T09:02:11.684879+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:02:11.684879+0000","last_undegraded":"2024-09-19T09:02:11.684879+0000","last_fullsized":"2024-09-19T09:02:11.684879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685449+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:02:11.685449+0000","last_peered":"2024-09-19T09:02:11.685449+0000","last_clean":"2024-09-19T09:02:11.685449+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:02:11.685449+0000","last_undegraded":"2024-09-19T09:02:11.685449+0000","last_fullsized":"2024-09-19T09:02:11.685449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687074+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:02:11.687074+0000","last_peered":"2024-09-19T09:02:11.687074+0000","last_clean":"2024-09-19T09:02:11.687074+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:02:11.687074+0000","last_undegraded":"2024-09-19T09:02:11.687074+0000","last_fullsized":"2024-09-19T09:02:11.687074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684228+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:02:11.684228+0000","last_peered":"2024-09-19T09:02:11.684228+0000","last_clean":"2024-09-19T09:02:11.684228+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:02:11.684228+0000","last_undegraded":"2024-09-19T09:02:11.684228+0000","last_fullsized":"2024-09-19T09:02:11.684228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721356+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:02:11.721356+0000","last_peered":"2024-09-19T09:02:11.721356+0000","last_clean":"2024-09-19T09:02:11.721356+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:02:11.721356+0000","last_undegraded":"2024-09-19T09:02:11.721356+0000","last_fullsized":"2024-09-19T09:02:11.721356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689612+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:02:11.689612+0000","last_peered":"2024-09-19T09:02:11.689612+0000","last_clean":"2024-09-19T09:02:11.689612+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:02:11.689612+0000","last_undegraded":"2024-09-19T09:02:11.689612+0000","last_fullsized":"2024-09-19T09:02:11.689612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682914+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:02:11.682914+0000","last_peered":"2024-09-19T09:02:11.682914+0000","last_clean":"2024-09-19T09:02:11.682914+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:02:11.682914+0000","last_undegraded":"2024-09-19T09:02:11.682914+0000","last_fullsized":"2024-09-19T09:02:11.682914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685454+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:02:11.685454+0000","last_peered":"2024-09-19T09:02:11.685454+0000","last_clean":"2024-09-19T09:02:11.685454+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:02:11.685454+0000","last_undegraded":"2024-09-19T09:02:11.685454+0000","last_fullsized":"2024-09-19T09:02:11.685454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.698766+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:02:11.698766+0000","last_peered":"2024-09-19T09:02:11.698766+0000","last_clean":"2024-09-19T09:02:11.698766+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:02:11.698766+0000","last_undegraded":"2024-09-19T09:02:11.698766+0000","last_fullsized":"2024-09-19T09:02:11.698766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688189+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:02:11.688189+0000","last_peered":"2024-09-19T09:02:11.688189+0000","last_clean":"2024-09-19T09:02:11.688189+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:02:11.688189+0000","last_undegraded":"2024-09-19T09:02:11.688189+0000","last_fullsized":"2024-09-19T09:02:11.688189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684587+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:02:11.684587+0000","last_peered":"2024-09-19T09:02:11.684587+0000","last_clean":"2024-09-19T09:02:11.684587+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:02:11.684587+0000","last_undegraded":"2024-09-19T09:02:11.684587+0000","last_fullsized":"2024-09-19T09:02:11.684587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721255+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:02:11.721255+0000","last_peered":"2024-09-19T09:02:11.721255+0000","last_clean":"2024-09-19T09:02:11.721255+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:02:11.721255+0000","last_undegraded":"2024-09-19T09:02:11.721255+0000","last_fullsized":"2024-09-19T09:02:11.721255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685196+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:02:11.685196+0000","last_peered":"2024-09-19T09:02:11.685196+0000","last_clean":"2024-09-19T09:02:11.685196+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:02:11.685196+0000","last_undegraded":"2024-09-19T09:02:11.685196+0000","last_fullsized":"2024-09-19T09:02:11.685196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686706+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:02:11.686706+0000","last_peered":"2024-09-19T09:02:11.686706+0000","last_clean":"2024-09-19T09:02:11.686706+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:02:11.686706+0000","last_undegraded":"2024-09-19T09:02:11.686706+0000","last_fullsized":"2024-09-19T09:02:11.686706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686681+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:02:11.686681+0000","last_peered":"2024-09-19T09:02:11.686681+0000","last_clean":"2024-09-19T09:02:11.686681+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:02:11.686681+0000","last_undegraded":"2024-09-19T09:02:11.686681+0000","last_fullsized":"2024-09-19T09:02:11.686681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684044+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:02:11.684044+0000","last_peered":"2024-09-19T09:02:11.684044+0000","last_clean":"2024-09-19T09:02:11.684044+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:02:11.684044+0000","last_undegraded":"2024-09-19T09:02:11.684044+0000","last_fullsized":"2024-09-19T09:02:11.684044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.722540+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:02:11.722540+0000","last_peered":"2024-09-19T09:02:11.722540+0000","last_clean":"2024-09-19T09:02:11.722540+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:02:11.722540+0000","last_undegraded":"2024-09-19T09:02:11.722540+0000","last_fullsized":"2024-09-19T09:02:11.722540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:58.581631+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:02:58.581631+0000","last_peered":"2024-09-19T09:02:58.581631+0000","last_clean":"2024-09-19T09:02:58.581631+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:02:58.581631+0000","last_undegraded":"2024-09-19T09:02:58.581631+0000","last_fullsized":"2024-09-19T09:02:58.581631+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.692423+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:02:11.692423+0000","last_peered":"2024-09-19T09:02:11.692423+0000","last_clean":"2024-09-19T09:02:11.692423+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:02:11.692423+0000","last_undegraded":"2024-09-19T09:02:11.692423+0000","last_fullsized":"2024-09-19T09:02:11.692423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682939+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:02:11.682939+0000","last_peered":"2024-09-19T09:02:11.682939+0000","last_clean":"2024-09-19T09:02:11.682939+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:02:11.682939+0000","last_undegraded":"2024-09-19T09:02:11.682939+0000","last_fullsized":"2024-09-19T09:02:11.682939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685621+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:02:11.685621+0000","last_peered":"2024-09-19T09:02:11.685621+0000","last_clean":"2024-09-19T09:02:11.685621+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:02:11.685621+0000","last_undegraded":"2024-09-19T09:02:11.685621+0000","last_fullsized":"2024-09-19T09:02:11.685621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:57.579383+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:02:57.579383+0000","last_peered":"2024-09-19T09:02:57.579383+0000","last_clean":"2024-09-19T09:02:57.579383+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:02:57.579383+0000","last_undegraded":"2024-09-19T09:02:57.579383+0000","last_fullsized":"2024-09-19T09:02:57.579383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689854+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:02:11.689854+0000","last_peered":"2024-09-19T09:02:11.689854+0000","last_clean":"2024-09-19T09:02:11.689854+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:02:11.689854+0000","last_undegraded":"2024-09-19T09:02:11.689854+0000","last_fullsized":"2024-09-19T09:02:11.689854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686110+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:02:11.686110+0000","last_peered":"2024-09-19T09:02:11.686110+0000","last_clean":"2024-09-19T09:02:11.686110+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:02:11.686110+0000","last_undegraded":"2024-09-19T09:02:11.686110+0000","last_fullsized":"2024-09-19T09:02:11.686110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689850+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:02:11.689850+0000","last_peered":"2024-09-19T09:02:11.689850+0000","last_clean":"2024-09-19T09:02:11.689850+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:02:11.689850+0000","last_undegraded":"2024-09-19T09:02:11.689850+0000","last_fullsized":"2024-09-19T09:02:11.689850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'30","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:58.770111+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:02:58.770111+0000","last_peered":"2024-09-19T09:02:58.770111+0000","last_clean":"2024-09-19T09:02:58.770111+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:02:58.770111+0000","last_undegraded":"2024-09-19T09:02:58.770111+0000","last_fullsized":"2024-09-19T09:02:58.770111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":113,"num_write":31,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688985+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:02:11.688985+0000","last_peered":"2024-09-19T09:02:11.688985+0000","last_clean":"2024-09-19T09:02:11.688985+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:02:11.688985+0000","last_undegraded":"2024-09-19T09:02:11.688985+0000","last_fullsized":"2024-09-19T09:02:11.688985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721116+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:02:11.721116+0000","last_peered":"2024-09-19T09:02:11.721116+0000","last_clean":"2024-09-19T09:02:11.721116+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:02:11.721116+0000","last_undegraded":"2024-09-19T09:02:11.721116+0000","last_fullsized":"2024-09-19T09:02:11.721116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687577+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:02:11.687577+0000","last_peered":"2024-09-19T09:02:11.687577+0000","last_clean":"2024-09-19T09:02:11.687577+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:02:11.687577+0000","last_undegraded":"2024-09-19T09:02:11.687577+0000","last_fullsized":"2024-09-19T09:02:11.687577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:57.762763+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:02:57.762763+0000","last_peered":"2024-09-19T09:02:57.762763+0000","last_clean":"2024-09-19T09:02:57.762763+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:02:57.762763+0000","last_undegraded":"2024-09-19T09:02:57.762763+0000","last_fullsized":"2024-09-19T09:02:57.762763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687831+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:02:11.687831+0000","last_peered":"2024-09-19T09:02:11.687831+0000","last_clean":"2024-09-19T09:02:11.687831+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:02:11.687831+0000","last_undegraded":"2024-09-19T09:02:11.687831+0000","last_fullsized":"2024-09-19T09:02:11.687831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.691526+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:02:11.691526+0000","last_peered":"2024-09-19T09:02:11.691526+0000","last_clean":"2024-09-19T09:02:11.691526+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:02:11.691526+0000","last_undegraded":"2024-09-19T09:02:11.691526+0000","last_fullsized":"2024-09-19T09:02:11.691526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684279+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:02:11.684279+0000","last_peered":"2024-09-19T09:02:11.684279+0000","last_clean":"2024-09-19T09:02:11.684279+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:02:11.684279+0000","last_undegraded":"2024-09-19T09:02:11.684279+0000","last_fullsized":"2024-09-19T09:02:11.684279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688763+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:02:11.688763+0000","last_peered":"2024-09-19T09:02:11.688763+0000","last_clean":"2024-09-19T09:02:11.688763+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:02:11.688763+0000","last_undegraded":"2024-09-19T09:02:11.688763+0000","last_fullsized":"2024-09-19T09:02:11.688763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688709+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:02:11.688709+0000","last_peered":"2024-09-19T09:02:11.688709+0000","last_clean":"2024-09-19T09:02:11.688709+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:02:11.688709+0000","last_undegraded":"2024-09-19T09:02:11.688709+0000","last_fullsized":"2024-09-19T09:02:11.688709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688932+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:02:11.688932+0000","last_peered":"2024-09-19T09:02:11.688932+0000","last_clean":"2024-09-19T09:02:11.688932+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:02:11.688932+0000","last_undegraded":"2024-09-19T09:02:11.688932+0000","last_fullsized":"2024-09-19T09:02:11.688932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688217+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688217+0000","last_peered":"2024-09-19T09:02:11.688217+0000","last_clean":"2024-09-19T09:02:11.688217+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688217+0000","last_undegraded":"2024-09-19T09:02:11.688217+0000","last_fullsized":"2024-09-19T09:02:11.688217+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683138+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:02:11.683138+0000","last_peered":"2024-09-19T09:02:11.683138+0000","last_clean":"2024-09-19T09:02:11.683138+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:02:11.683138+0000","last_undegraded":"2024-09-19T09:02:11.683138+0000","last_fullsized":"2024-09-19T09:02:11.683138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721097+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:02:11.721097+0000","last_peered":"2024-09-19T09:02:11.721097+0000","last_clean":"2024-09-19T09:02:11.721097+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:02:11.721097+0000","last_undegraded":"2024-09-19T09:02:11.721097+0000","last_fullsized":"2024-09-19T09:02:11.721097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:01.767340+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:03:01.767340+0000","last_peered":"2024-09-19T09:03:01.767340+0000","last_clean":"2024-09-19T09:03:01.767340+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:03:01.767340+0000","last_undegraded":"2024-09-19T09:03:01.767340+0000","last_fullsized":"2024-09-19T09:03:01.767340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685572+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:02:11.685572+0000","last_peered":"2024-09-19T09:02:11.685572+0000","last_clean":"2024-09-19T09:02:11.685572+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:02:11.685572+0000","last_undegraded":"2024-09-19T09:02:11.685572+0000","last_fullsized":"2024-09-19T09:02:11.685572+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688006+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:02:11.688006+0000","last_peered":"2024-09-19T09:02:11.688006+0000","last_clean":"2024-09-19T09:02:11.688006+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:02:11.688006+0000","last_undegraded":"2024-09-19T09:02:11.688006+0000","last_fullsized":"2024-09-19T09:02:11.688006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684207+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:02:11.684207+0000","last_peered":"2024-09-19T09:02:11.684207+0000","last_clean":"2024-09-19T09:02:11.684207+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:02:11.684207+0000","last_undegraded":"2024-09-19T09:02:11.684207+0000","last_fullsized":"2024-09-19T09:02:11.684207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721294+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:02:11.721294+0000","last_peered":"2024-09-19T09:02:11.721294+0000","last_clean":"2024-09-19T09:02:11.721294+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:02:11.721294+0000","last_undegraded":"2024-09-19T09:02:11.721294+0000","last_fullsized":"2024-09-19T09:02:11.721294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:25.663670+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:02:25.663670+0000","last_peered":"2024-09-19T09:02:25.663670+0000","last_clean":"2024-09-19T09:02:25.663670+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:02:25.663670+0000","last_undegraded":"2024-09-19T09:02:25.663670+0000","last_fullsized":"2024-09-19T09:02:25.663670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683397+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:02:11.683397+0000","last_peered":"2024-09-19T09:02:11.683397+0000","last_clean":"2024-09-19T09:02:11.683397+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:02:11.683397+0000","last_undegraded":"2024-09-19T09:02:11.683397+0000","last_fullsized":"2024-09-19T09:02:11.683397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.690071+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:02:11.690071+0000","last_peered":"2024-09-19T09:02:11.690071+0000","last_clean":"2024-09-19T09:02:11.690071+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:02:11.690071+0000","last_undegraded":"2024-09-19T09:02:11.690071+0000","last_fullsized":"2024-09-19T09:02:11.690071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686769+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:02:11.686769+0000","last_peered":"2024-09-19T09:02:11.686769+0000","last_clean":"2024-09-19T09:02:11.686769+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:02:11.686769+0000","last_undegraded":"2024-09-19T09:02:11.686769+0000","last_fullsized":"2024-09-19T09:02:11.686769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684129+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:02:11.684129+0000","last_peered":"2024-09-19T09:02:11.684129+0000","last_clean":"2024-09-19T09:02:11.684129+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:02:11.684129+0000","last_undegraded":"2024-09-19T09:02:11.684129+0000","last_fullsized":"2024-09-19T09:02:11.684129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686861+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686861+0000","last_peered":"2024-09-19T09:02:11.686861+0000","last_clean":"2024-09-19T09:02:11.686861+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686861+0000","last_undegraded":"2024-09-19T09:02:11.686861+0000","last_fullsized":"2024-09-19T09:02:11.686861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683078+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:02:11.683078+0000","last_peered":"2024-09-19T09:02:11.683078+0000","last_clean":"2024-09-19T09:02:11.683078+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:02:11.683078+0000","last_undegraded":"2024-09-19T09:02:11.683078+0000","last_fullsized":"2024-09-19T09:02:11.683078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687647+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:02:11.687647+0000","last_peered":"2024-09-19T09:02:11.687647+0000","last_clean":"2024-09-19T09:02:11.687647+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:02:11.687647+0000","last_undegraded":"2024-09-19T09:02:11.687647+0000","last_fullsized":"2024-09-19T09:02:11.687647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687408+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:02:11.687408+0000","last_peered":"2024-09-19T09:02:11.687408+0000","last_clean":"2024-09-19T09:02:11.687408+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:02:11.687408+0000","last_undegraded":"2024-09-19T09:02:11.687408+0000","last_fullsized":"2024-09-19T09:02:11.687408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689665+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:02:11.689665+0000","last_peered":"2024-09-19T09:02:11.689665+0000","last_clean":"2024-09-19T09:02:11.689665+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:02:11.689665+0000","last_undegraded":"2024-09-19T09:02:11.689665+0000","last_fullsized":"2024-09-19T09:02:11.689665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685951+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:02:11.685951+0000","last_peered":"2024-09-19T09:02:11.685951+0000","last_clean":"2024-09-19T09:02:11.685951+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:02:11.685951+0000","last_undegraded":"2024-09-19T09:02:11.685951+0000","last_fullsized":"2024-09-19T09:02:11.685951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.691477+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:02:11.691477+0000","last_peered":"2024-09-19T09:02:11.691477+0000","last_clean":"2024-09-19T09:02:11.691477+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:02:11.691477+0000","last_undegraded":"2024-09-19T09:02:11.691477+0000","last_fullsized":"2024-09-19T09:02:11.691477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686208+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.686208+0000","last_peered":"2024-09-19T09:02:11.686208+0000","last_clean":"2024-09-19T09:02:11.686208+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.686208+0000","last_undegraded":"2024-09-19T09:02:11.686208+0000","last_fullsized":"2024-09-19T09:02:11.686208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66313,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":321,"num_read_kb":232,"num_write":163,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":198939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645337,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874270,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1081013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495661,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36796,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708356,"statfs":{"total":95995035648,"available":95957356544,"internally_reserved":0,"allocated":1486848,"data_stored":1019310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1018994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":490659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":488950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":63888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:03:05.218 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:03:05.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:05 smithi064 ceph-mon[35179]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T09:03:05.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:05 smithi064 ceph-mon[35179]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:05.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:05 smithi022 ceph-mon[35107]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T09:03:05.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:05 smithi022 ceph-mon[35107]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:05.483 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:05.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:05 smithi001 ceph-mon[30939]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T09:03:05.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:05 smithi001 ceph-mon[30939]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 -- 172.21.15.1:0/1849810444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20102a50 msgr2=0x7ffb20102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 --2- 172.21.15.1:0/1849810444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20102a50 0x7ffb20102e30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009900 tx=0x7ffb1002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 -- 172.21.15.1:0/1849810444 shutdown_connections 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 --2- 172.21.15.1:0/1849810444 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb20100c80 0x7ffb20110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 --2- 172.21.15.1:0/1849810444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb20100100 0x7ffb20100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 --2- 172.21.15.1:0/1849810444 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20102a50 0x7ffb20102e30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 -- 172.21.15.1:0/1849810444 >> 172.21.15.1:0/1849810444 conn(0x7ffb20077230 msgr2=0x7ffb200fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 -- 172.21.15.1:0/1849810444 shutdown_connections 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 -- 172.21.15.1:0/1849810444 wait complete. 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.911+0000 7ffb25937640 1 Processor -- start 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb25937640 1 -- start start 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb25937640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb20100100 0x7ffb2019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb25937640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20100c80 0x7ffb2019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb25937640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb20102a50 0x7ffb2019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb25937640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20114270 con 0x7ffb20100c80 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb25937640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201140f0 con 0x7ffb20102a50 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb25937640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201143f0 con 0x7ffb20100100 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb1e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20100c80 0x7ffb2019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb1e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20100c80 0x7ffb2019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55858/0 (socket says 172.21.15.1:55858) 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb1e7fc640 1 -- 172.21.15.1:0/2157631663 learned_addr learned my addr 172.21.15.1:0/2157631663 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb1effd640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb20100100 0x7ffb2019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.912+0000 7ffb1f7fe640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb20102a50 0x7ffb2019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb1e7fc640 1 -- 172.21.15.1:0/2157631663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb20100100 msgr2=0x7ffb2019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb1e7fc640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb20100100 0x7ffb2019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb1e7fc640 1 -- 172.21.15.1:0/2157631663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb20102a50 msgr2=0x7ffb2019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb1e7fc640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb20102a50 0x7ffb2019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb1e7fc640 1 -- 172.21.15.1:0/2157631663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2019f6e0 con 0x7ffb20100c80 2024-09-19T09:03:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb1e7fc640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20100c80 0x7ffb2019ac70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400e9f0 tx=0x7ffb1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb24935640 1 -- 172.21.15.1:0/2157631663 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400cd80 con 0x7ffb20100c80 2024-09-19T09:03:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb24935640 1 -- 172.21.15.1:0/2157631663 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb14010930 con 0x7ffb20100c80 2024-09-19T09:03:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb24935640 1 -- 172.21.15.1:0/2157631663 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14018b00 con 0x7ffb20100c80 2024-09-19T09:03:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2019f9d0 con 0x7ffb20100c80 2024-09-19T09:03:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.913+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb201a72b0 con 0x7ffb20100c80 2024-09-19T09:03:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.915+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb20100520 con 0x7ffb20100c80 2024-09-19T09:03:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.915+0000 7ffb24935640 1 -- 172.21.15.1:0/2157631663 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ffb14018ca0 con 0x7ffb20100c80 2024-09-19T09:03:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.916+0000 7ffb24935640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb080a3350 0x7ffb080a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.916+0000 7ffb1effd640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb080a3350 0x7ffb080a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.916+0000 7ffb24935640 1 -- 172.21.15.1:0/2157631663 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ffb140cfde0 con 0x7ffb20100c80 2024-09-19T09:03:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.917+0000 7ffb1effd640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb080a3350 0x7ffb080a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009230 tx=0x7ffb100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:05.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:05.920+0000 7ffb24935640 1 -- 172.21.15.1:0/2157631663 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb1409c330 con 0x7ffb20100c80 2024-09-19T09:03:06.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.100+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb20062630 con 0x7ffb080a3350 2024-09-19T09:03:06.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.106+0000 7ffb24935640 1 -- 172.21.15.1:0/2157631663 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258718 (secure 0 0 0) 0x7ffb20062630 con 0x7ffb080a3350 2024-09-19T09:03:06.109 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:06.110 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:03:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb080a3350 msgr2=0x7ffb080a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb080a3350 0x7ffb080a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009230 tx=0x7ffb100058d0 comp rx=0 tx=0).stop 2024-09-19T09:03:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20100c80 msgr2=0x7ffb2019ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:06.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20100c80 0x7ffb2019ac70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400e9f0 tx=0x7ffb1400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:03:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 shutdown_connections 2024-09-19T09:03:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb20102a50 0x7ffb2019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb20100c80 0x7ffb2019ac70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb080a3350 0x7ffb080a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 --2- 172.21.15.1:0/2157631663 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb20100100 0x7ffb2019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 >> 172.21.15.1:0/2157631663 conn(0x7ffb20077230 msgr2=0x7ffb200fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 shutdown_connections 2024-09-19T09:03:06.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:06.109+0000 7ffb25937640 1 -- 172.21.15.1:0/2157631663 wait complete. 2024-09-19T09:03:06.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:06.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:06.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:06.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:06.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:06.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:06.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:03:06.730 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-19T09:03:05.952652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656915,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":472,"num_read_kb":351,"num_write":346,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390792,"kb_used_data":12408,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551032,"statfs":{"total":1151940427776,"available":1151540256768,"internally_reserved":0,"allocated":12705792,"data_stored":7090425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":39,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003006"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684751+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:02:11.684751+0000","last_peered":"2024-09-19T09:02:11.684751+0000","last_clean":"2024-09-19T09:02:11.684751+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:02:11.684751+0000","last_undegraded":"2024-09-19T09:02:11.684751+0000","last_fullsized":"2024-09-19T09:02:11.684751+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685274+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:02:11.685274+0000","last_peered":"2024-09-19T09:02:11.685274+0000","last_clean":"2024-09-19T09:02:11.685274+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:02:11.685274+0000","last_undegraded":"2024-09-19T09:02:11.685274+0000","last_fullsized":"2024-09-19T09:02:11.685274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685391+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:02:11.685391+0000","last_peered":"2024-09-19T09:02:11.685391+0000","last_clean":"2024-09-19T09:02:11.685391+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:02:11.685391+0000","last_undegraded":"2024-09-19T09:02:11.685391+0000","last_fullsized":"2024-09-19T09:02:11.685391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697115+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:02:11.697115+0000","last_peered":"2024-09-19T09:02:11.697115+0000","last_clean":"2024-09-19T09:02:11.697115+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:02:11.697115+0000","last_undegraded":"2024-09-19T09:02:11.697115+0000","last_fullsized":"2024-09-19T09:02:11.697115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687096+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:02:11.687096+0000","last_peered":"2024-09-19T09:02:11.687096+0000","last_clean":"2024-09-19T09:02:11.687096+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:02:11.687096+0000","last_undegraded":"2024-09-19T09:02:11.687096+0000","last_fullsized":"2024-09-19T09:02:11.687096+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683669+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:02:11.683669+0000","last_peered":"2024-09-19T09:02:11.683669+0000","last_clean":"2024-09-19T09:02:11.683669+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:02:11.683669+0000","last_undegraded":"2024-09-19T09:02:11.683669+0000","last_fullsized":"2024-09-19T09:02:11.683669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.722501+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:02:11.722501+0000","last_peered":"2024-09-19T09:02:11.722501+0000","last_clean":"2024-09-19T09:02:11.722501+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:02:11.722501+0000","last_undegraded":"2024-09-19T09:02:11.722501+0000","last_fullsized":"2024-09-19T09:02:11.722501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682881+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:02:11.682881+0000","last_peered":"2024-09-19T09:02:11.682881+0000","last_clean":"2024-09-19T09:02:11.682881+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:02:11.682881+0000","last_undegraded":"2024-09-19T09:02:11.682881+0000","last_fullsized":"2024-09-19T09:02:11.682881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.690180+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:02:11.690180+0000","last_peered":"2024-09-19T09:02:11.690180+0000","last_clean":"2024-09-19T09:02:11.690180+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:02:11.690180+0000","last_undegraded":"2024-09-19T09:02:11.690180+0000","last_fullsized":"2024-09-19T09:02:11.690180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684237+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:02:11.684237+0000","last_peered":"2024-09-19T09:02:11.684237+0000","last_clean":"2024-09-19T09:02:11.684237+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:02:11.684237+0000","last_undegraded":"2024-09-19T09:02:11.684237+0000","last_fullsized":"2024-09-19T09:02:11.684237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688749+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:02:11.688749+0000","last_peered":"2024-09-19T09:02:11.688749+0000","last_clean":"2024-09-19T09:02:11.688749+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:02:11.688749+0000","last_undegraded":"2024-09-19T09:02:11.688749+0000","last_fullsized":"2024-09-19T09:02:11.688749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697164+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:02:11.697164+0000","last_peered":"2024-09-19T09:02:11.697164+0000","last_clean":"2024-09-19T09:02:11.697164+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:02:11.697164+0000","last_undegraded":"2024-09-19T09:02:11.697164+0000","last_fullsized":"2024-09-19T09:02:11.697164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721263+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:02:11.721263+0000","last_peered":"2024-09-19T09:02:11.721263+0000","last_clean":"2024-09-19T09:02:11.721263+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:02:11.721263+0000","last_undegraded":"2024-09-19T09:02:11.721263+0000","last_fullsized":"2024-09-19T09:02:11.721263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685216+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:02:11.685216+0000","last_peered":"2024-09-19T09:02:11.685216+0000","last_clean":"2024-09-19T09:02:11.685216+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:02:11.685216+0000","last_undegraded":"2024-09-19T09:02:11.685216+0000","last_fullsized":"2024-09-19T09:02:11.685216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684970+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:02:11.684970+0000","last_peered":"2024-09-19T09:02:11.684970+0000","last_clean":"2024-09-19T09:02:11.684970+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:02:11.684970+0000","last_undegraded":"2024-09-19T09:02:11.684970+0000","last_fullsized":"2024-09-19T09:02:11.684970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689295+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:02:11.689295+0000","last_peered":"2024-09-19T09:02:11.689295+0000","last_clean":"2024-09-19T09:02:11.689295+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:02:11.689295+0000","last_undegraded":"2024-09-19T09:02:11.689295+0000","last_fullsized":"2024-09-19T09:02:11.689295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684879+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:02:11.684879+0000","last_peered":"2024-09-19T09:02:11.684879+0000","last_clean":"2024-09-19T09:02:11.684879+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:02:11.684879+0000","last_undegraded":"2024-09-19T09:02:11.684879+0000","last_fullsized":"2024-09-19T09:02:11.684879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685449+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:02:11.685449+0000","last_peered":"2024-09-19T09:02:11.685449+0000","last_clean":"2024-09-19T09:02:11.685449+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:02:11.685449+0000","last_undegraded":"2024-09-19T09:02:11.685449+0000","last_fullsized":"2024-09-19T09:02:11.685449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687074+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:02:11.687074+0000","last_peered":"2024-09-19T09:02:11.687074+0000","last_clean":"2024-09-19T09:02:11.687074+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:02:11.687074+0000","last_undegraded":"2024-09-19T09:02:11.687074+0000","last_fullsized":"2024-09-19T09:02:11.687074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684228+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:02:11.684228+0000","last_peered":"2024-09-19T09:02:11.684228+0000","last_clean":"2024-09-19T09:02:11.684228+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:02:11.684228+0000","last_undegraded":"2024-09-19T09:02:11.684228+0000","last_fullsized":"2024-09-19T09:02:11.684228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721356+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:02:11.721356+0000","last_peered":"2024-09-19T09:02:11.721356+0000","last_clean":"2024-09-19T09:02:11.721356+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:02:11.721356+0000","last_undegraded":"2024-09-19T09:02:11.721356+0000","last_fullsized":"2024-09-19T09:02:11.721356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689612+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:02:11.689612+0000","last_peered":"2024-09-19T09:02:11.689612+0000","last_clean":"2024-09-19T09:02:11.689612+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:02:11.689612+0000","last_undegraded":"2024-09-19T09:02:11.689612+0000","last_fullsized":"2024-09-19T09:02:11.689612+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682914+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:02:11.682914+0000","last_peered":"2024-09-19T09:02:11.682914+0000","last_clean":"2024-09-19T09:02:11.682914+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:02:11.682914+0000","last_undegraded":"2024-09-19T09:02:11.682914+0000","last_fullsized":"2024-09-19T09:02:11.682914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685454+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:02:11.685454+0000","last_peered":"2024-09-19T09:02:11.685454+0000","last_clean":"2024-09-19T09:02:11.685454+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:02:11.685454+0000","last_undegraded":"2024-09-19T09:02:11.685454+0000","last_fullsized":"2024-09-19T09:02:11.685454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.698766+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:02:11.698766+0000","last_peered":"2024-09-19T09:02:11.698766+0000","last_clean":"2024-09-19T09:02:11.698766+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:02:11.698766+0000","last_undegraded":"2024-09-19T09:02:11.698766+0000","last_fullsized":"2024-09-19T09:02:11.698766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688189+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:02:11.688189+0000","last_peered":"2024-09-19T09:02:11.688189+0000","last_clean":"2024-09-19T09:02:11.688189+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:02:11.688189+0000","last_undegraded":"2024-09-19T09:02:11.688189+0000","last_fullsized":"2024-09-19T09:02:11.688189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684587+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:02:11.684587+0000","last_peered":"2024-09-19T09:02:11.684587+0000","last_clean":"2024-09-19T09:02:11.684587+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:02:11.684587+0000","last_undegraded":"2024-09-19T09:02:11.684587+0000","last_fullsized":"2024-09-19T09:02:11.684587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721255+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:02:11.721255+0000","last_peered":"2024-09-19T09:02:11.721255+0000","last_clean":"2024-09-19T09:02:11.721255+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:02:11.721255+0000","last_undegraded":"2024-09-19T09:02:11.721255+0000","last_fullsized":"2024-09-19T09:02:11.721255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685196+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:02:11.685196+0000","last_peered":"2024-09-19T09:02:11.685196+0000","last_clean":"2024-09-19T09:02:11.685196+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:02:11.685196+0000","last_undegraded":"2024-09-19T09:02:11.685196+0000","last_fullsized":"2024-09-19T09:02:11.685196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686706+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:02:11.686706+0000","last_peered":"2024-09-19T09:02:11.686706+0000","last_clean":"2024-09-19T09:02:11.686706+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:02:11.686706+0000","last_undegraded":"2024-09-19T09:02:11.686706+0000","last_fullsized":"2024-09-19T09:02:11.686706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686681+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:02:11.686681+0000","last_peered":"2024-09-19T09:02:11.686681+0000","last_clean":"2024-09-19T09:02:11.686681+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:02:11.686681+0000","last_undegraded":"2024-09-19T09:02:11.686681+0000","last_fullsized":"2024-09-19T09:02:11.686681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684044+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:02:11.684044+0000","last_peered":"2024-09-19T09:02:11.684044+0000","last_clean":"2024-09-19T09:02:11.684044+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:02:11.684044+0000","last_undegraded":"2024-09-19T09:02:11.684044+0000","last_fullsized":"2024-09-19T09:02:11.684044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.722540+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:02:11.722540+0000","last_peered":"2024-09-19T09:02:11.722540+0000","last_clean":"2024-09-19T09:02:11.722540+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:02:11.722540+0000","last_undegraded":"2024-09-19T09:02:11.722540+0000","last_fullsized":"2024-09-19T09:02:11.722540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:03.589289+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:03:03.589289+0000","last_peered":"2024-09-19T09:03:03.589289+0000","last_clean":"2024-09-19T09:03:03.589289+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:03:03.589289+0000","last_undegraded":"2024-09-19T09:03:03.589289+0000","last_fullsized":"2024-09-19T09:03:03.589289+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.692423+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:02:11.692423+0000","last_peered":"2024-09-19T09:02:11.692423+0000","last_clean":"2024-09-19T09:02:11.692423+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:02:11.692423+0000","last_undegraded":"2024-09-19T09:02:11.692423+0000","last_fullsized":"2024-09-19T09:02:11.692423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.682939+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:02:11.682939+0000","last_peered":"2024-09-19T09:02:11.682939+0000","last_clean":"2024-09-19T09:02:11.682939+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:02:11.682939+0000","last_undegraded":"2024-09-19T09:02:11.682939+0000","last_fullsized":"2024-09-19T09:02:11.682939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685621+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:02:11.685621+0000","last_peered":"2024-09-19T09:02:11.685621+0000","last_clean":"2024-09-19T09:02:11.685621+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:02:11.685621+0000","last_undegraded":"2024-09-19T09:02:11.685621+0000","last_fullsized":"2024-09-19T09:02:11.685621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:02.587134+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:03:02.587134+0000","last_peered":"2024-09-19T09:03:02.587134+0000","last_clean":"2024-09-19T09:03:02.587134+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:03:02.587134+0000","last_undegraded":"2024-09-19T09:03:02.587134+0000","last_fullsized":"2024-09-19T09:03:02.587134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689854+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:02:11.689854+0000","last_peered":"2024-09-19T09:02:11.689854+0000","last_clean":"2024-09-19T09:02:11.689854+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:02:11.689854+0000","last_undegraded":"2024-09-19T09:02:11.689854+0000","last_fullsized":"2024-09-19T09:02:11.689854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686110+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:02:11.686110+0000","last_peered":"2024-09-19T09:02:11.686110+0000","last_clean":"2024-09-19T09:02:11.686110+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:02:11.686110+0000","last_undegraded":"2024-09-19T09:02:11.686110+0000","last_fullsized":"2024-09-19T09:02:11.686110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689850+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:02:11.689850+0000","last_peered":"2024-09-19T09:02:11.689850+0000","last_clean":"2024-09-19T09:02:11.689850+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:02:11.689850+0000","last_undegraded":"2024-09-19T09:02:11.689850+0000","last_fullsized":"2024-09-19T09:02:11.689850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'30","reported_seq":167,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:03.776832+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:03:03.776832+0000","last_peered":"2024-09-19T09:03:03.776832+0000","last_clean":"2024-09-19T09:03:03.776832+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:03:03.776832+0000","last_undegraded":"2024-09-19T09:03:03.776832+0000","last_fullsized":"2024-09-19T09:03:03.776832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":118,"num_write":31,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688985+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:02:11.688985+0000","last_peered":"2024-09-19T09:02:11.688985+0000","last_clean":"2024-09-19T09:02:11.688985+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:02:11.688985+0000","last_undegraded":"2024-09-19T09:02:11.688985+0000","last_fullsized":"2024-09-19T09:02:11.688985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721116+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:02:11.721116+0000","last_peered":"2024-09-19T09:02:11.721116+0000","last_clean":"2024-09-19T09:02:11.721116+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:02:11.721116+0000","last_undegraded":"2024-09-19T09:02:11.721116+0000","last_fullsized":"2024-09-19T09:02:11.721116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687577+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:02:11.687577+0000","last_peered":"2024-09-19T09:02:11.687577+0000","last_clean":"2024-09-19T09:02:11.687577+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:02:11.687577+0000","last_undegraded":"2024-09-19T09:02:11.687577+0000","last_fullsized":"2024-09-19T09:02:11.687577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:02.769311+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:03:02.769311+0000","last_peered":"2024-09-19T09:03:02.769311+0000","last_clean":"2024-09-19T09:03:02.769311+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:03:02.769311+0000","last_undegraded":"2024-09-19T09:03:02.769311+0000","last_fullsized":"2024-09-19T09:03:02.769311+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687831+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:02:11.687831+0000","last_peered":"2024-09-19T09:02:11.687831+0000","last_clean":"2024-09-19T09:02:11.687831+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:02:11.687831+0000","last_undegraded":"2024-09-19T09:02:11.687831+0000","last_fullsized":"2024-09-19T09:02:11.687831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.691526+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:02:11.691526+0000","last_peered":"2024-09-19T09:02:11.691526+0000","last_clean":"2024-09-19T09:02:11.691526+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:02:11.691526+0000","last_undegraded":"2024-09-19T09:02:11.691526+0000","last_fullsized":"2024-09-19T09:02:11.691526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684279+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:02:11.684279+0000","last_peered":"2024-09-19T09:02:11.684279+0000","last_clean":"2024-09-19T09:02:11.684279+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:02:11.684279+0000","last_undegraded":"2024-09-19T09:02:11.684279+0000","last_fullsized":"2024-09-19T09:02:11.684279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688763+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:02:11.688763+0000","last_peered":"2024-09-19T09:02:11.688763+0000","last_clean":"2024-09-19T09:02:11.688763+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:02:11.688763+0000","last_undegraded":"2024-09-19T09:02:11.688763+0000","last_fullsized":"2024-09-19T09:02:11.688763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688709+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:02:11.688709+0000","last_peered":"2024-09-19T09:02:11.688709+0000","last_clean":"2024-09-19T09:02:11.688709+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:02:11.688709+0000","last_undegraded":"2024-09-19T09:02:11.688709+0000","last_fullsized":"2024-09-19T09:02:11.688709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688932+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:02:11.688932+0000","last_peered":"2024-09-19T09:02:11.688932+0000","last_clean":"2024-09-19T09:02:11.688932+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:02:11.688932+0000","last_undegraded":"2024-09-19T09:02:11.688932+0000","last_fullsized":"2024-09-19T09:02:11.688932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688217+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688217+0000","last_peered":"2024-09-19T09:02:11.688217+0000","last_clean":"2024-09-19T09:02:11.688217+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688217+0000","last_undegraded":"2024-09-19T09:02:11.688217+0000","last_fullsized":"2024-09-19T09:02:11.688217+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683138+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:02:11.683138+0000","last_peered":"2024-09-19T09:02:11.683138+0000","last_clean":"2024-09-19T09:02:11.683138+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:02:11.683138+0000","last_undegraded":"2024-09-19T09:02:11.683138+0000","last_fullsized":"2024-09-19T09:02:11.683138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721097+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:02:11.721097+0000","last_peered":"2024-09-19T09:02:11.721097+0000","last_clean":"2024-09-19T09:02:11.721097+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:02:11.721097+0000","last_undegraded":"2024-09-19T09:02:11.721097+0000","last_fullsized":"2024-09-19T09:02:11.721097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:01.767340+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:03:01.767340+0000","last_peered":"2024-09-19T09:03:01.767340+0000","last_clean":"2024-09-19T09:03:01.767340+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:03:01.767340+0000","last_undegraded":"2024-09-19T09:03:01.767340+0000","last_fullsized":"2024-09-19T09:03:01.767340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685572+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:02:11.685572+0000","last_peered":"2024-09-19T09:02:11.685572+0000","last_clean":"2024-09-19T09:02:11.685572+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:02:11.685572+0000","last_undegraded":"2024-09-19T09:02:11.685572+0000","last_fullsized":"2024-09-19T09:02:11.685572+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688006+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:02:11.688006+0000","last_peered":"2024-09-19T09:02:11.688006+0000","last_clean":"2024-09-19T09:02:11.688006+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:02:11.688006+0000","last_undegraded":"2024-09-19T09:02:11.688006+0000","last_fullsized":"2024-09-19T09:02:11.688006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684207+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:02:11.684207+0000","last_peered":"2024-09-19T09:02:11.684207+0000","last_clean":"2024-09-19T09:02:11.684207+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:02:11.684207+0000","last_undegraded":"2024-09-19T09:02:11.684207+0000","last_fullsized":"2024-09-19T09:02:11.684207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721294+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:02:11.721294+0000","last_peered":"2024-09-19T09:02:11.721294+0000","last_clean":"2024-09-19T09:02:11.721294+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:02:11.721294+0000","last_undegraded":"2024-09-19T09:02:11.721294+0000","last_fullsized":"2024-09-19T09:02:11.721294+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:25.663670+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:02:25.663670+0000","last_peered":"2024-09-19T09:02:25.663670+0000","last_clean":"2024-09-19T09:02:25.663670+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:02:25.663670+0000","last_undegraded":"2024-09-19T09:02:25.663670+0000","last_fullsized":"2024-09-19T09:02:25.663670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683397+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:02:11.683397+0000","last_peered":"2024-09-19T09:02:11.683397+0000","last_clean":"2024-09-19T09:02:11.683397+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:02:11.683397+0000","last_undegraded":"2024-09-19T09:02:11.683397+0000","last_fullsized":"2024-09-19T09:02:11.683397+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.690071+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:02:11.690071+0000","last_peered":"2024-09-19T09:02:11.690071+0000","last_clean":"2024-09-19T09:02:11.690071+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:02:11.690071+0000","last_undegraded":"2024-09-19T09:02:11.690071+0000","last_fullsized":"2024-09-19T09:02:11.690071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686769+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:02:11.686769+0000","last_peered":"2024-09-19T09:02:11.686769+0000","last_clean":"2024-09-19T09:02:11.686769+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:02:11.686769+0000","last_undegraded":"2024-09-19T09:02:11.686769+0000","last_fullsized":"2024-09-19T09:02:11.686769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.684129+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:02:11.684129+0000","last_peered":"2024-09-19T09:02:11.684129+0000","last_clean":"2024-09-19T09:02:11.684129+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:02:11.684129+0000","last_undegraded":"2024-09-19T09:02:11.684129+0000","last_fullsized":"2024-09-19T09:02:11.684129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686861+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686861+0000","last_peered":"2024-09-19T09:02:11.686861+0000","last_clean":"2024-09-19T09:02:11.686861+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686861+0000","last_undegraded":"2024-09-19T09:02:11.686861+0000","last_fullsized":"2024-09-19T09:02:11.686861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683078+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:02:11.683078+0000","last_peered":"2024-09-19T09:02:11.683078+0000","last_clean":"2024-09-19T09:02:11.683078+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:02:11.683078+0000","last_undegraded":"2024-09-19T09:02:11.683078+0000","last_fullsized":"2024-09-19T09:02:11.683078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687647+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:02:11.687647+0000","last_peered":"2024-09-19T09:02:11.687647+0000","last_clean":"2024-09-19T09:02:11.687647+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:02:11.687647+0000","last_undegraded":"2024-09-19T09:02:11.687647+0000","last_fullsized":"2024-09-19T09:02:11.687647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687408+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:02:11.687408+0000","last_peered":"2024-09-19T09:02:11.687408+0000","last_clean":"2024-09-19T09:02:11.687408+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:02:11.687408+0000","last_undegraded":"2024-09-19T09:02:11.687408+0000","last_fullsized":"2024-09-19T09:02:11.687408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689665+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:02:11.689665+0000","last_peered":"2024-09-19T09:02:11.689665+0000","last_clean":"2024-09-19T09:02:11.689665+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:02:11.689665+0000","last_undegraded":"2024-09-19T09:02:11.689665+0000","last_fullsized":"2024-09-19T09:02:11.689665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685951+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:02:11.685951+0000","last_peered":"2024-09-19T09:02:11.685951+0000","last_clean":"2024-09-19T09:02:11.685951+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:02:11.685951+0000","last_undegraded":"2024-09-19T09:02:11.685951+0000","last_fullsized":"2024-09-19T09:02:11.685951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.691477+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:02:11.691477+0000","last_peered":"2024-09-19T09:02:11.691477+0000","last_clean":"2024-09-19T09:02:11.691477+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:02:11.691477+0000","last_undegraded":"2024-09-19T09:02:11.691477+0000","last_fullsized":"2024-09-19T09:02:11.691477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686208+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.686208+0000","last_peered":"2024-09-19T09:02:11.686208+0000","last_clean":"2024-09-19T09:02:11.686208+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.686208+0000","last_undegraded":"2024-09-19T09:02:11.686208+0000","last_fullsized":"2024-09-19T09:02:11.686208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66313,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":346,"num_read_kb":242,"num_write":163,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":198939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645337,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874271,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1081013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005092,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495661,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36796,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708356,"statfs":{"total":95995035648,"available":95957356544,"internally_reserved":0,"allocated":1486848,"data_stored":1019310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855416,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1018994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":490659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":488950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":63888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:03:06.734 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:03:06.734 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:03:06.735 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:03:06.735 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T09:03:06.990 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:07.421 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:07 smithi001 ceph-mon[30939]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T09:03:07.422 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:07 smithi001 ceph-mon[30939]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.436+0000 7fe703498640 1 -- 172.21.15.1:0/3302457840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc112b90 msgr2=0x7fe6fc114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.436+0000 7fe703498640 1 --2- 172.21.15.1:0/3302457840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc112b90 0x7fe6fc114f80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009ca0 tx=0x7fe6f402a950 comp rx=0 tx=0).stop 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.436+0000 7fe703498640 1 -- 172.21.15.1:0/3302457840 shutdown_connections 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.437+0000 7fe703498640 1 --2- 172.21.15.1:0/3302457840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc112b90 0x7fe6fc114f80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.437+0000 7fe703498640 1 --2- 172.21.15.1:0/3302457840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6fc074eb0 0x7fe6fc112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.437+0000 7fe703498640 1 --2- 172.21.15.1:0/3302457840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6fc074590 0x7fe6fc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.437+0000 7fe703498640 1 -- 172.21.15.1:0/3302457840 >> 172.21.15.1:0/3302457840 conn(0x7fe6fc0fd8c0 msgr2=0x7fe6fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.437+0000 7fe703498640 1 -- 172.21.15.1:0/3302457840 shutdown_connections 2024-09-19T09:03:07.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.437+0000 7fe703498640 1 -- 172.21.15.1:0/3302457840 wait complete. 2024-09-19T09:03:07.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.437+0000 7fe703498640 1 Processor -- start 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.437+0000 7fe703498640 1 -- start start 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe703498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6fc074590 0x7fe6fc1a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe703498640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc074eb0 0x7fe6fc1a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe703498640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6fc112b90 0x7fe6fc19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe703498640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc1186b0 con 0x7fe6fc074eb0 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe703498640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc118530 con 0x7fe6fc074590 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe703498640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc118830 con 0x7fe6fc112b90 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc074eb0 0x7fe6fc1a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc074eb0 0x7fe6fc1a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55862/0 (socket says 172.21.15.1:55862) 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 -- 172.21.15.1:0/298561089 learned_addr learned my addr 172.21.15.1:0/298561089 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe701234640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6fc074590 0x7fe6fc1a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe701a35640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6fc112b90 0x7fe6fc19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 -- 172.21.15.1:0/298561089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6fc112b90 msgr2=0x7fe6fc19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6fc112b90 0x7fe6fc19e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 -- 172.21.15.1:0/298561089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6fc074590 msgr2=0x7fe6fc1a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6fc074590 0x7fe6fc1a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 -- 172.21.15.1:0/298561089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc19f050 con 0x7fe6fc074eb0 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.438+0000 7fe700a33640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc074eb0 0x7fe6fc1a4ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00d950 tx=0x7fe6ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.439+0000 7fe6f27fc640 1 -- 172.21.15.1:0/298561089 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec017070 con 0x7fe6fc074eb0 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.439+0000 7fe6f27fc640 1 -- 172.21.15.1:0/298561089 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6ec009c30 con 0x7fe6fc074eb0 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.439+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc19f340 con 0x7fe6fc074eb0 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.439+0000 7fe6f27fc640 1 -- 172.21.15.1:0/298561089 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00f740 con 0x7fe6fc074eb0 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.439+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc1ab630 con 0x7fe6fc074eb0 2024-09-19T09:03:07.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.440+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc074970 con 0x7fe6fc074eb0 2024-09-19T09:03:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.441+0000 7fe6f27fc640 1 -- 172.21.15.1:0/298561089 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe6ec010a80 con 0x7fe6fc074eb0 2024-09-19T09:03:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.442+0000 7fe6f27fc640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe6e80a32d0 0x7fe6e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.442+0000 7fe701234640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe6e80a32d0 0x7fe6e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.442+0000 7fe6f27fc640 1 -- 172.21.15.1:0/298561089 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe6ec0cf780 con 0x7fe6fc074eb0 2024-09-19T09:03:07.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.442+0000 7fe701234640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe6e80a32d0 0x7fe6e80a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc19fa60 tx=0x7fe6f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.445+0000 7fe6f27fc640 1 -- 172.21.15.1:0/298561089 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6ec009de0 con 0x7fe6fc074eb0 2024-09-19T09:03:07.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:07 smithi064 ceph-mon[35179]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T09:03:07.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:07 smithi064 ceph-mon[35179]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:07.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.658+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe6fc19fe50 con 0x7fe6fc074eb0 2024-09-19T09:03:07.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.659+0000 7fe6f27fc640 1 -- 172.21.15.1:0/298561089 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe6fc19fe50 con 0x7fe6fc074eb0 2024-09-19T09:03:07.659 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:07.659 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:03:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe6e80a32d0 msgr2=0x7fe6e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe6e80a32d0 0x7fe6e80a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc19fa60 tx=0x7fe6f8005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc074eb0 msgr2=0x7fe6fc1a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc074eb0 0x7fe6fc1a4ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00d950 tx=0x7fe6ec00de10 comp rx=0 tx=0).stop 2024-09-19T09:03:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 shutdown_connections 2024-09-19T09:03:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe6e80a32d0 0x7fe6e80a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6fc112b90 0x7fe6fc19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe6fc074eb0 0x7fe6fc1a4ca0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 --2- 172.21.15.1:0/298561089 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6fc074590 0x7fe6fc1a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 >> 172.21.15.1:0/298561089 conn(0x7fe6fc0fd8c0 msgr2=0x7fe6fc0fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 shutdown_connections 2024-09-19T09:03:07.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:07.661+0000 7fe703498640 1 -- 172.21.15.1:0/298561089 wait complete. 2024-09-19T09:03:07.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:07 smithi022 ceph-mon[35107]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T09:03:07.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:07 smithi022 ceph-mon[35107]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:08.306 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:03:08.306 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:08.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:08 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/298561089' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:03:08.564 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:08.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:08 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/298561089' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:03:08.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:08 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/298561089' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:03:09.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 -- 172.21.15.1:0/866283343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd260102d30 msgr2=0x7fd260103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:09.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 --2- 172.21.15.1:0/866283343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd260102d30 0x7fd260103110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd258009930 tx=0x7fd25802a420 comp rx=0 tx=0).stop 2024-09-19T09:03:09.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 -- 172.21.15.1:0/866283343 shutdown_connections 2024-09-19T09:03:09.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 --2- 172.21.15.1:0/866283343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2601082a0 0x7fd26010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 --2- 172.21.15.1:0/866283343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2601036e0 0x7fd260107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 --2- 172.21.15.1:0/866283343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd260102d30 0x7fd260103110 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 -- 172.21.15.1:0/866283343 >> 172.21.15.1:0/866283343 conn(0x7fd2600fc7d0 msgr2=0x7fd2600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 -- 172.21.15.1:0/866283343 shutdown_connections 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 -- 172.21.15.1:0/866283343 wait complete. 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 Processor -- start 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.002+0000 7fd267716640 1 -- start start 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd267716640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd260102d30 0x7fd2601a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd267716640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2601036e0 0x7fd2601a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd267716640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2601082a0 0x7fd26019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:09.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd267716640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd2601121c0 con 0x7fd2601036e0 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd267716640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd260112040 con 0x7fd2601082a0 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd267716640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd260112340 con 0x7fd260102d30 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2601036e0 0x7fd2601a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2601036e0 0x7fd2601a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55890/0 (socket says 172.21.15.1:55890) 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 -- 172.21.15.1:0/4080948496 learned_addr learned my addr 172.21.15.1:0/4080948496 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd2654b2640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd260102d30 0x7fd2601a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd265cb3640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2601082a0 0x7fd26019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 -- 172.21.15.1:0/4080948496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd260102d30 msgr2=0x7fd2601a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd260102d30 0x7fd2601a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 -- 172.21.15.1:0/4080948496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2601082a0 msgr2=0x7fd26019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2601082a0 0x7fd26019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 -- 172.21.15.1:0/4080948496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26019af20 con 0x7fd2601036e0 2024-09-19T09:03:09.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.003+0000 7fd264cb1640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2601036e0 0x7fd2601a0b20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c970 tx=0x7fd25400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.004+0000 7fd25e7fc640 1 -- 172.21.15.1:0/4080948496 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254007bb0 con 0x7fd2601036e0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.004+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26019b210 con 0x7fd2601036e0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.004+0000 7fd25e7fc640 1 -- 172.21.15.1:0/4080948496 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd254007d50 con 0x7fd2601036e0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.004+0000 7fd25e7fc640 1 -- 172.21.15.1:0/4080948496 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25400f450 con 0x7fd2601036e0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.004+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2601a7560 con 0x7fd2601036e0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.005+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26006a850 con 0x7fd2601036e0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.006+0000 7fd25e7fc640 1 -- 172.21.15.1:0/4080948496 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd254005000 con 0x7fd2601036e0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.006+0000 7fd25e7fc640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd2480a32d0 0x7fd2480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.007+0000 7fd2654b2640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd2480a32d0 0x7fd2480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.007+0000 7fd25e7fc640 1 -- 172.21.15.1:0/4080948496 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd2540cfd00 con 0x7fd2601036e0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.007+0000 7fd2654b2640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd2480a32d0 0x7fd2480a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd258000c00 tx=0x7fd258005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:09.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.010+0000 7fd25e7fc640 1 -- 172.21.15.1:0/4080948496 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd254014030 con 0x7fd2601036e0 2024-09-19T09:03:09.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.222+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd26019bbe0 con 0x7fd2601036e0 2024-09-19T09:03:09.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.223+0000 7fd25e7fc640 1 -- 172.21.15.1:0/4080948496 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11878 (secure 0 0 0) 0x7fd25409c8a0 con 0x7fd2601036e0 2024-09-19T09:03:09.223 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:09.223 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"btime":"2024-09-19T09:02:13:694219+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:02:13.157593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:03:09.223 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2024-09-19T09:03:09.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd2480a32d0 msgr2=0x7fd2480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:09.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd2480a32d0 0x7fd2480a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd258000c00 tx=0x7fd258005a20 comp rx=0 tx=0).stop 2024-09-19T09:03:09.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2601036e0 msgr2=0x7fd2601a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:09.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2601036e0 0x7fd2601a0b20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c970 tx=0x7fd25400ce30 comp rx=0 tx=0).stop 2024-09-19T09:03:09.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 shutdown_connections 2024-09-19T09:03:09.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2601082a0 0x7fd26019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2601036e0 0x7fd2601a0b20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd2480a32d0 0x7fd2480a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 --2- 172.21.15.1:0/4080948496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd260102d30 0x7fd2601a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:09.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 >> 172.21.15.1:0/4080948496 conn(0x7fd2600fc7d0 msgr2=0x7fd2600fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:09.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 shutdown_connections 2024-09-19T09:03:09.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:09.225+0000 7fd267716640 1 -- 172.21.15.1:0/4080948496 wait complete. 2024-09-19T09:03:09.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:09 smithi001 ceph-mon[30939]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:03:09.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:09 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4080948496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:09.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:09 smithi064 ceph-mon[35179]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:03:09.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:09 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4080948496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:09.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:09 smithi022 ceph-mon[35107]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T09:03:09.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:09 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4080948496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:09.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:10.166 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:10.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 -- 172.21.15.1:0/3822315308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc990106f50 msgr2=0x7fc99010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:10.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3822315308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc990106f50 0x7fc99010eaf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc988009cd0 tx=0x7fc98802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 -- 172.21.15.1:0/3822315308 shutdown_connections 2024-09-19T09:03:10.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3822315308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc990106f50 0x7fc99010eaf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3822315308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990100ca0 0x7fc990106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3822315308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9901002f0 0x7fc9901006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 -- 172.21.15.1:0/3822315308 >> 172.21.15.1:0/3822315308 conn(0x7fc990077210 msgr2=0x7fc9900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 -- 172.21.15.1:0/3822315308 shutdown_connections 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 -- 172.21.15.1:0/3822315308 wait complete. 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 Processor -- start 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.719+0000 7fc996cf6640 1 -- start start 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc996cf6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9901002f0 0x7fc990101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc996cf6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990100ca0 0x7fc9901017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc996cf6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc990106f50 0x7fc990101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc996cf6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9901120c0 con 0x7fc9901002f0 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc996cf6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc990111f40 con 0x7fc990106f50 2024-09-19T09:03:10.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc996cf6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc990112240 con 0x7fc990100ca0 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9901002f0 0x7fc990101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9901002f0 0x7fc990101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55904/0 (socket says 172.21.15.1:55904) 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 -- 172.21.15.1:0/3217505678 learned_addr learned my addr 172.21.15.1:0/3217505678 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc98ffff640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990100ca0 0x7fc9901017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc995293640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc990106f50 0x7fc990101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 -- 172.21.15.1:0/3217505678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990100ca0 msgr2=0x7fc9901017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990100ca0 0x7fc9901017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 -- 172.21.15.1:0/3217505678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc990106f50 msgr2=0x7fc990101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc990106f50 0x7fc990101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 -- 172.21.15.1:0/3217505678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9901a6970 con 0x7fc9901002f0 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc98ffff640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990100ca0 0x7fc9901017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.720+0000 7fc994a92640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9901002f0 0x7fc990101270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc98000d950 tx=0x7fc98000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:10.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.721+0000 7fc98dffb640 1 -- 172.21.15.1:0/3217505678 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980017070 con 0x7fc9901002f0 2024-09-19T09:03:10.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.721+0000 7fc98dffb640 1 -- 172.21.15.1:0/3217505678 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc980009c30 con 0x7fc9901002f0 2024-09-19T09:03:10.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.721+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9901a6c60 con 0x7fc9901002f0 2024-09-19T09:03:10.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.721+0000 7fc98dffb640 1 -- 172.21.15.1:0/3217505678 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98000f740 con 0x7fc9901002f0 2024-09-19T09:03:10.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.721+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9901a71a0 con 0x7fc9901002f0 2024-09-19T09:03:10.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.722+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9901006d0 con 0x7fc9901002f0 2024-09-19T09:03:10.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.723+0000 7fc98dffb640 1 -- 172.21.15.1:0/3217505678 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc980010a80 con 0x7fc9901002f0 2024-09-19T09:03:10.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.723+0000 7fc98dffb640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9780a32d0 0x7fc9780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:10.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.724+0000 7fc98ffff640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9780a32d0 0x7fc9780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:10.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.724+0000 7fc98dffb640 1 -- 172.21.15.1:0/3217505678 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc9800cf860 con 0x7fc9901002f0 2024-09-19T09:03:10.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.724+0000 7fc98ffff640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9780a32d0 0x7fc9780a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc984005e10 tx=0x7fc984005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:10.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.728+0000 7fc98dffb640 1 -- 172.21.15.1:0/3217505678 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc980009de0 con 0x7fc9901002f0 2024-09-19T09:03:10.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.939+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9901027a0 con 0x7fc9901002f0 2024-09-19T09:03:10.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.940+0000 7fc98dffb640 1 -- 172.21.15.1:0/3217505678 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11878 (secure 0 0 0) 0x7fc98009c3a0 con 0x7fc9901002f0 2024-09-19T09:03:10.940 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:10.941 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"btime":"2024-09-19T09:02:13:694219+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:02:13.157593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:03:10.941 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2024-09-19T09:03:10.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9780a32d0 msgr2=0x7fc9780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:10.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9780a32d0 0x7fc9780a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc984005e10 tx=0x7fc984005da0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9901002f0 msgr2=0x7fc990101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:10.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9901002f0 0x7fc990101270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc98000d950 tx=0x7fc98000de10 comp rx=0 tx=0).stop 2024-09-19T09:03:10.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 shutdown_connections 2024-09-19T09:03:10.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc990106f50 0x7fc990101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9780a32d0 0x7fc9780a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990100ca0 0x7fc9901017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 --2- 172.21.15.1:0/3217505678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9901002f0 0x7fc990101270 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:10.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 >> 172.21.15.1:0/3217505678 conn(0x7fc990077210 msgr2=0x7fc990105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:10.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.942+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 shutdown_connections 2024-09-19T09:03:10.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:10.943+0000 7fc996cf6640 1 -- 172.21.15.1:0/3217505678 wait complete. 2024-09-19T09:03:11.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:11 smithi001 ceph-mon[30939]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T09:03:11.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:11 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3217505678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:11.530 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:03:11.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:11 smithi064 ceph-mon[35179]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T09:03:11.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:11 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3217505678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:11.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:11 smithi022 ceph-mon[35107]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-19T09:03:11.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:11 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3217505678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:11.804 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:12.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 -- 172.21.15.1:0/615552614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74102570 msgr2=0x7f9a741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 --2- 172.21.15.1:0/615552614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74102570 0x7f9a741029b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009900 tx=0x7f9a6402a480 comp rx=0 tx=0).stop 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 -- 172.21.15.1:0/615552614 shutdown_connections 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 --2- 172.21.15.1:0/615552614 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a74102ef0 0x7f9a7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 --2- 172.21.15.1:0/615552614 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74102570 0x7f9a741029b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 --2- 172.21.15.1:0/615552614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a74100e20 0x7f9a74101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 -- 172.21.15.1:0/615552614 >> 172.21.15.1:0/615552614 conn(0x7f9a740fc7d0 msgr2=0x7f9a740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 -- 172.21.15.1:0/615552614 shutdown_connections 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.262+0000 7f9a79533640 1 -- 172.21.15.1:0/615552614 wait complete. 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a79533640 1 Processor -- start 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a79533640 1 -- start start 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a79533640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74100e20 0x7f9a741a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a79533640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a74102570 0x7f9a741a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a79533640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a74102ef0 0x7f9a7419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a79533640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9a741110a0 con 0x7f9a74100e20 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a79533640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74110f20 con 0x7f9a74102570 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a79533640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74111220 con 0x7f9a74102ef0 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a72ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74100e20 0x7f9a741a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a72ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74100e20 0x7f9a741a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55912/0 (socket says 172.21.15.1:55912) 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a72ffd640 1 -- 172.21.15.1:0/3105295587 learned_addr learned my addr 172.21.15.1:0/3105295587 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a727fc640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a74102570 0x7f9a741a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.263+0000 7f9a737fe640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a74102ef0 0x7f9a7419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a72ffd640 1 -- 172.21.15.1:0/3105295587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a74102ef0 msgr2=0x7f9a7419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a72ffd640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a74102ef0 0x7f9a7419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a72ffd640 1 -- 172.21.15.1:0/3105295587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a74102570 msgr2=0x7f9a741a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a72ffd640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a74102570 0x7f9a741a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a72ffd640 1 -- 172.21.15.1:0/3105295587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7419aef0 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a72ffd640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74100e20 0x7f9a741a05b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00cce0 tx=0x7f9a5c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a6bfff640 1 -- 172.21.15.1:0/3105295587 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c004b20 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7419b1e0 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a6bfff640 1 -- 172.21.15.1:0/3105295587 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a5c004cc0 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a6bfff640 1 -- 172.21.15.1:0/3105295587 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c00f870 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.264+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a741a7530 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.265+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a741021b0 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.266+0000 7f9a6bfff640 1 -- 172.21.15.1:0/3105295587 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9a5c00fa10 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.268+0000 7f9a6bfff640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9a600a32d0 0x7f9a600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.268+0000 7f9a727fc640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9a600a32d0 0x7f9a600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.268+0000 7f9a6bfff640 1 -- 172.21.15.1:0/3105295587 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9a5c0cfbd0 con 0x7f9a74100e20 2024-09-19T09:03:12.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.268+0000 7f9a727fc640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9a600a32d0 0x7f9a600a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9a64006010 tx=0x7f9a64000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:12.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.272+0000 7f9a6bfff640 1 -- 172.21.15.1:0/3105295587 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a5c014030 con 0x7f9a74100e20 2024-09-19T09:03:12.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.455+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a7419bbe0 con 0x7f9a74100e20 2024-09-19T09:03:12.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.457+0000 7f9a6bfff640 1 -- 172.21.15.1:0/3105295587 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7f9a7419bbe0 con 0x7f9a74100e20 2024-09-19T09:03:12.458 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:12.458 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:03:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9a600a32d0 msgr2=0x7f9a600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9a600a32d0 0x7f9a600a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9a64006010 tx=0x7f9a64000bc0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74100e20 msgr2=0x7f9a741a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74100e20 0x7f9a741a05b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00cce0 tx=0x7f9a5c00a620 comp rx=0 tx=0).stop 2024-09-19T09:03:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 shutdown_connections 2024-09-19T09:03:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9a600a32d0 0x7f9a600a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a74102ef0 0x7f9a7419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a74102570 0x7f9a741a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 --2- 172.21.15.1:0/3105295587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a74100e20 0x7f9a741a05b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 >> 172.21.15.1:0/3105295587 conn(0x7f9a740fc7d0 msgr2=0x7f9a74069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:12.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 shutdown_connections 2024-09-19T09:03:12.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:12.460+0000 7f9a79533640 1 -- 172.21.15.1:0/3105295587 wait complete. 2024-09-19T09:03:13.135 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:13.394 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:13.515 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:13 smithi001 ceph-mon[30939]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:13.516 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:13 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3105295587' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:13.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:13 smithi064 ceph-mon[35179]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:13.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:13 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3105295587' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:13.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:13 smithi022 ceph-mon[35107]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:13.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:13 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3105295587' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3580448866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50101de0 msgr2=0x7f4a501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3580448866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50101de0 0x7f4a501021c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009900 tx=0x7f4a4c02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3580448866 shutdown_connections 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3580448866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a50106f10 0x7f4a5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3580448866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a50102790 0x7f4a501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3580448866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50101de0 0x7f4a501021c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3580448866 >> 172.21.15.1:0/3580448866 conn(0x7f4a500fd8c0 msgr2=0x7f4a500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3580448866 shutdown_connections 2024-09-19T09:03:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.860+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3580448866 wait complete. 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a57bfa640 1 Processor -- start 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a57bfa640 1 -- start start 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a57bfa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a50101de0 0x7f4a501a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a57bfa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a50102790 0x7f4a501a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a57bfa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50106f10 0x7f4a5019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a57bfa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a501120d0 con 0x7f4a50106f10 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a57bfa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4a50111f50 con 0x7f4a50102790 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a57bfa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4a50112250 con 0x7f4a50101de0 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a56197640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50106f10 0x7f4a5019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a56197640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50106f10 0x7f4a5019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34908/0 (socket says 172.21.15.1:34908) 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a56197640 1 -- 172.21.15.1:0/3666901547 learned_addr learned my addr 172.21.15.1:0/3666901547 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.861+0000 7f4a55996640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a50101de0 0x7f4a501a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:13.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a55195640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a50102790 0x7f4a501a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a56197640 1 -- 172.21.15.1:0/3666901547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a50101de0 msgr2=0x7f4a501a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a56197640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a50101de0 0x7f4a501a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a56197640 1 -- 172.21.15.1:0/3666901547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a50102790 msgr2=0x7f4a501a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a56197640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a50102790 0x7f4a501a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a56197640 1 -- 172.21.15.1:0/3666901547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5019aed0 con 0x7f4a50106f10 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a56197640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50106f10 0x7f4a5019a660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800b970 tx=0x7f4a4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a46ffd640 1 -- 172.21.15.1:0/3666901547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48019070 con 0x7f4a50106f10 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a46ffd640 1 -- 172.21.15.1:0/3666901547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4a4800cb40 con 0x7f4a50106f10 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5019b1c0 con 0x7f4a50106f10 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a46ffd640 1 -- 172.21.15.1:0/3666901547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48007700 con 0x7f4a50106f10 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.862+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a501a7510 con 0x7f4a50106f10 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.863+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a501032c0 con 0x7f4a50106f10 2024-09-19T09:03:13.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.865+0000 7f4a46ffd640 1 -- 172.21.15.1:0/3666901547 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4a4801c070 con 0x7f4a50106f10 2024-09-19T09:03:13.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.866+0000 7f4a46ffd640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a3c0a3350 0x7f4a3c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:13.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.866+0000 7f4a55996640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a3c0a3350 0x7f4a3c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:13.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.866+0000 7f4a46ffd640 1 -- 172.21.15.1:0/3666901547 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4a480cf350 con 0x7f4a50106f10 2024-09-19T09:03:13.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.866+0000 7f4a55996640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a3c0a3350 0x7f4a3c0a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009230 tx=0x7f4a4c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:13.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:13.869+0000 7f4a46ffd640 1 -- 172.21.15.1:0/3666901547 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a4809b9b0 con 0x7f4a50106f10 2024-09-19T09:03:14.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.084+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a501a76e0 con 0x7f4a50106f10 2024-09-19T09:03:14.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.085+0000 7f4a46ffd640 1 -- 172.21.15.1:0/3666901547 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11878 (secure 0 0 0) 0x7f4a480afe20 con 0x7f4a50106f10 2024-09-19T09:03:14.085 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:14.086 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"btime":"2024-09-19T09:02:13:694219+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:02:13.157593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:03:14.086 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a3c0a3350 msgr2=0x7f4a3c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a3c0a3350 0x7f4a3c0a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009230 tx=0x7f4a4c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50106f10 msgr2=0x7f4a5019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50106f10 0x7f4a5019a660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800b970 tx=0x7f4a4800be30 comp rx=0 tx=0).stop 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 shutdown_connections 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a50106f10 0x7f4a5019a660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a50102790 0x7f4a501a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4a3c0a3350 0x7f4a3c0a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 --2- 172.21.15.1:0/3666901547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a50101de0 0x7f4a501a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.087+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 >> 172.21.15.1:0/3666901547 conn(0x7f4a500fd8c0 msgr2=0x7f4a500febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:14.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.088+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 shutdown_connections 2024-09-19T09:03:14.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:14.088+0000 7f4a57bfa640 1 -- 172.21.15.1:0/3666901547 wait complete. 2024-09-19T09:03:14.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:14 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3666901547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:14.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:14 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3666901547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:14.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:14 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3666901547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:14.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:02:02.334504+0000', 'modified': '2024-09-19T09:02:13.157593+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24500, 'mds_1': 24493, 'mds_2': 24482}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6835/728335709', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6834', 'nonce': 728335709}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 728335709}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6835/1194065600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 1194065600}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 1194065600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6837/1600726820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6836', 'nonce': 1600726820}, {'type': 'v1', 'addr': '172.21.15.64:6837', 'nonce': 1600726820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.22:6837/866445696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6836', 'nonce': 866445696}, {'type': 'v1', 'addr': '172.21.15.22:6837', 'nonce': 866445696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.64:6839/2311666322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6838', 'nonce': 2311666322}, {'type': 'v1', 'addr': '172.21.15.64:6839', 'nonce': 2311666322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6839/1767594317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 1767594317}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 1767594317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24500, 'qdb_cluster': [24482, 24493, 24500]} 2024-09-19T09:03:14.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T09:03:14.818 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:03:15.082 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:15.492 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:15 smithi001 ceph-mon[30939]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:15.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 -- 172.21.15.1:0/4153242651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 msgr2=0x7f056410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 --2- 172.21.15.1:0/4153242651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 0x7f056410e610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f055c009ca0 tx=0x7f055c02a950 comp rx=0 tx=0).stop 2024-09-19T09:03:15.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 -- 172.21.15.1:0/4153242651 shutdown_connections 2024-09-19T09:03:15.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 --2- 172.21.15.1:0/4153242651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 0x7f056410e610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 --2- 172.21.15.1:0/4153242651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0564103660 0x7f056410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 --2- 172.21.15.1:0/4153242651 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0564102d40 0x7f0564103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 -- 172.21.15.1:0/4153242651 >> 172.21.15.1:0/4153242651 conn(0x7f05640fc7a0 msgr2=0x7f05640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 -- 172.21.15.1:0/4153242651 shutdown_connections 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.574+0000 7f056c5b5640 1 -- 172.21.15.1:0/4153242651 wait complete. 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.575+0000 7f056c5b5640 1 Processor -- start 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.575+0000 7f056c5b5640 1 -- start start 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.575+0000 7f056c5b5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0564102d40 0x7f0564198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.575+0000 7f056c5b5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0564103660 0x7f05641989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.575+0000 7f056c5b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 0x7f056419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.575+0000 7f056c5b5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0564112090 con 0x7f056410c170 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.575+0000 7f056c5b5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0564111f10 con 0x7f0564103660 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.575+0000 7f056c5b5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0564112210 con 0x7f0564102d40 2024-09-19T09:03:15.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 0x7f056419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 0x7f056419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34922/0 (socket says 172.21.15.1:34922) 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 -- 172.21.15.1:0/325022501 learned_addr learned my addr 172.21.15.1:0/325022501 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f0569b50640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0564103660 0x7f05641989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056a351640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0564102d40 0x7f0564198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 -- 172.21.15.1:0/325022501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0564102d40 msgr2=0x7f0564198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0564102d40 0x7f0564198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 -- 172.21.15.1:0/325022501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0564103660 msgr2=0x7f05641989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0564103660 0x7f05641989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 -- 172.21.15.1:0/325022501 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056419d440 con 0x7f056410c170 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056a351640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0564102d40 0x7f0564198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f0569b50640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0564103660 0x7f05641989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056ab52640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 0x7f056419cd60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f055c005cc0 tx=0x7f055c02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f055b7fe640 1 -- 172.21.15.1:0/325022501 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c034040 con 0x7f056410c170 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f055b7fe640 1 -- 172.21.15.1:0/325022501 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f055c030940 con 0x7f056410c170 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056c5b5640 1 -- 172.21.15.1:0/325022501 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056419d6d0 con 0x7f056410c170 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f055b7fe640 1 -- 172.21.15.1:0/325022501 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0456e0 con 0x7f056410c170 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.576+0000 7f056c5b5640 1 -- 172.21.15.1:0/325022501 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05641a5010 con 0x7f056410c170 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f055b7fe640 1 -- 172.21.15.1:0/325022501 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f055c037020 con 0x7f056410c170 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056e98e740 1 Processor -- start 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056e98e740 1 -- start start 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056e98e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 0x55a5f515bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056e98e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f5166670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056e98e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5168fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056e98e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a5f50c2090 con 0x55a5f515c2f0 2024-09-19T09:03:15.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056e98e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a5f5069a70 con 0x55a5f515b9d0 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056e98e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a5f50be050 con 0x55a5f5166bb0 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056a351640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f5166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056a351640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f5166670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34930/0 (socket says 172.21.15.1:34930) 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.579+0000 7f056a351640 1 -- 172.21.15.1:0/913242382 learned_addr learned my addr 172.21.15.1:0/913242382 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f055b7fe640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f05500a3350 0x7f05500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f0569b50640 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5168fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f056a351640 1 -- 172.21.15.1:0/913242382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 msgr2=0x55a5f5168fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f056ab52640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f05500a3350 0x7f05500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f056a351640 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5168fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f056a351640 1 -- 172.21.15.1:0/913242382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 msgr2=0x55a5f515bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f056a351640 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 0x55a5f515bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f056a351640 1 -- 172.21.15.1:0/913242382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f5076130 con 0x55a5f515c2f0 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f0569b50640 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5168fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f055b7fe640 1 -- 172.21.15.1:0/325022501 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f055c0f0a30 con 0x7f056410c170 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f056a351640 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f5166670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f056000bd40 tx=0x7f056000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df46535c87002566 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f056ab52640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f05500a3350 0x7f05500a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f055c08b670 tx=0x7f055c0e4040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f0558ff9640 1 -- 172.21.15.1:0/913242382 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560015070 con 0x55a5f515c2f0 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f0558ff9640 1 -- 172.21.15.1:0/913242382 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f056000be30 con 0x55a5f515c2f0 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.580+0000 7f0558ff9640 1 -- 172.21.15.1:0/913242382 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560011ae0 con 0x55a5f515c2f0 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 -- 172.21.15.1:0/913242382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 msgr2=0x55a5f5166670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f5166670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f056000bd40 tx=0x7f056000f730 comp rx=0 tx=0).stop 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 -- 172.21.15.1:0/913242382 shutdown_connections 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5168fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f5166670 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 --2- 172.21.15.1:0/913242382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 0x55a5f515bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 -- 172.21.15.1:0/913242382 >> 172.21.15.1:0/913242382 conn(0x55a5f5157f60 msgr2=0x55a5f5158340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 -- 172.21.15.1:0/913242382 shutdown_connections 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 -- 172.21.15.1:0/913242382 wait complete. 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.581+0000 7f056e98e740 1 -- start start 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056e98e740 1 Processor -- start 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056e98e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f5166470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056e98e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 0x55a5f51637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056e98e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5163d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056e98e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a5f5169780 con 0x55a5f515b9d0 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056e98e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a5f507cf20 con 0x55a5f515c2f0 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056e98e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a5f5169900 con 0x55a5f5166bb0 2024-09-19T09:03:15.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056e98e740 10 client.0 _ll_register_callbacks cb 0x55a5f5046030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f5166470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f5166470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34936/0 (socket says 172.21.15.1:34936) 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 -- 172.21.15.1:0/1010177221 learned_addr learned my addr 172.21.15.1:0/1010177221 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 -- 172.21.15.1:0/1010177221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 msgr2=0x55a5f5163d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5163d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 -- 172.21.15.1:0/1010177221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 msgr2=0x55a5f51637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f056a351640 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 0x55a5f51637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 0x55a5f51637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 -- 172.21.15.1:0/1010177221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f4e332b0 con 0x55a5f515b9d0 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f0569b50640 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f5166470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f055400bf60 tx=0x7f055400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8aa0ef7e6d4064c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.582+0000 7f054dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f054dffb640 1 -- 172.21.15.1:0/1010177221 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554004220 con 0x55a5f515b9d0 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f054dffb640 1 -- 172.21.15.1:0/1010177221 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f05540043c0 con 0x55a5f515b9d0 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 1 -- 172.21.15.1:0/1010177221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f056000be30 con 0x55a5f515b9d0 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f054dffb640 1 -- 172.21.15.1:0/1010177221 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f055400e650 con 0x55a5f515b9d0 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 10 client.14976 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 1 -- 172.21.15.1:0/1010177221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a5f51750a0 con 0x55a5f515b9d0 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f054dffb640 1 -- 172.21.15.1:0/1010177221 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f056000be30 con 0x55a5f515b9d0 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f054dffb640 1 -- 172.21.15.1:0/1010177221 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0554003b40 con 0x55a5f515b9d0 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 10 client.14976 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 10 client.14976 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 20 client.14976 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:15.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a5f5177730 0x55a5f5178ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 4 client.14976 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.583+0000 7f056e98e740 1 -- 172.21.15.1:0/1010177221 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5f50cf600 con 0x55a5f5177730 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.584+0000 7f056a351640 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a5f5177730 0x55a5f5178ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.584+0000 7f056a351640 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a5f5177730 0x55a5f5178ba0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4665a8a6deb1426f server_cookie=a135128641d49f48 in_seq=0 out_seq=0 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.584+0000 7f054dffb640 10 client.14976 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f054dffb640 1 -- 172.21.15.1:0/1010177221 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5f50cf600 con 0x55a5f5177730 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f054dffb640 10 client.14976 handle_command_reply: tid=0 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 client.14976 shutdown 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 -- 172.21.15.1:0/1010177221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 msgr2=0x55a5f5166470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f5166470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f055400bf60 tx=0x7f055400bf90 comp rx=0 tx=0).stop 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 -- 172.21.15.1:0/1010177221 shutdown_connections 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a5f5177730 0x55a5f5178ba0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5163d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 0x55a5f51637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f054dffb640 0 client.14976 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:03:15.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 --2- 172.21.15.1:0/1010177221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f5166470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 -- 172.21.15.1:0/1010177221 >> 172.21.15.1:0/1010177221 conn(0x55a5f5157f60 msgr2=0x55a5f515dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 -- 172.21.15.1:0/1010177221 shutdown_connections 2024-09-19T09:03:15.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 1 -- 172.21.15.1:0/1010177221 wait complete. 2024-09-19T09:03:15.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.585+0000 7f056e98e740 20 client.14976 trim_cache size 0 max 16384 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056e98e740 1 Processor -- start 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056e98e740 1 -- start start 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056e98e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 0x55a5f5177060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056e98e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f51784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056e98e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5180e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056e98e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a5f5176ee0 con 0x55a5f515c2f0 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056e98e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a5f51775b0 con 0x55a5f515b9d0 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056e98e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a5f5177c80 con 0x55a5f5166bb0 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056a351640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f51784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056a351640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f51784d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34940/0 (socket says 172.21.15.1:34940) 2024-09-19T09:03:15.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056a351640 1 -- 172.21.15.1:0/2226033535 learned_addr learned my addr 172.21.15.1:0/2226033535 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f0569b50640 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 0x55a5f5177060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f0569b50640 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5180e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056a351640 1 -- 172.21.15.1:0/2226033535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 msgr2=0x55a5f5180e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056a351640 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5180e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056a351640 1 -- 172.21.15.1:0/2226033535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 msgr2=0x55a5f5177060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056a351640 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 0x55a5f5177060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f056a351640 1 -- 172.21.15.1:0/2226033535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f51667e0 con 0x55a5f515c2f0 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.604+0000 7f0569b50640 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5180e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.605+0000 7f056a351640 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f51784d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f05600116d0 tx=0x7f0560011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8268429b8c3b24c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.605+0000 7f054ffff640 1 -- 172.21.15.1:0/2226033535 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056002e070 con 0x55a5f515c2f0 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.605+0000 7f054ffff640 1 -- 172.21.15.1:0/2226033535 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0560005540 con 0x55a5f515c2f0 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.605+0000 7f054ffff640 1 -- 172.21.15.1:0/2226033535 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560015070 con 0x55a5f515c2f0 2024-09-19T09:03:15.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.605+0000 7f056e98e740 1 -- 172.21.15.1:0/2226033535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 msgr2=0x55a5f51784d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.605+0000 7f056e98e740 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f51784d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f05600116d0 tx=0x7f0560011440 comp rx=0 tx=0).stop 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 -- 172.21.15.1:0/2226033535 shutdown_connections 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f5180e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515c2f0 0x55a5f51784d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 --2- 172.21.15.1:0/2226033535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515b9d0 0x55a5f5177060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 -- 172.21.15.1:0/2226033535 >> 172.21.15.1:0/2226033535 conn(0x55a5f5157f60 msgr2=0x55a5f5162090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 -- 172.21.15.1:0/2226033535 shutdown_connections 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 -- 172.21.15.1:0/2226033535 wait complete. 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 -- start start 2024-09-19T09:03:15.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 Processor -- start 2024-09-19T09:03:15.609 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:15 smithi064 ceph-mon[35179]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f517c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 0x55a5f517c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f51dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a5f5178a20 con 0x55a5f515b9d0 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a5f5178350 con 0x55a5f515c2f0 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a5f51790f0 con 0x55a5f5166bb0 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f056e98e740 10 client.0 _ll_register_callbacks cb 0x7f056406b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.606+0000 7f0569b50640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f517c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f517c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34944/0 (socket says 172.21.15.1:34944) 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 -- 172.21.15.1:0/4121908319 learned_addr learned my addr 172.21.15.1:0/4121908319 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f056a351640 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 0x55a5f517c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f51dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 -- 172.21.15.1:0/4121908319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 msgr2=0x55a5f51dfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f51dfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 -- 172.21.15.1:0/4121908319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 msgr2=0x55a5f517c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 0x55a5f517c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 -- 172.21.15.1:0/4121908319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f51e0370 con 0x55a5f515b9d0 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f0569b50640 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f517c2b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0554003f10 tx=0x7f055400b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800a6abf57a4e717 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f054dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f054dffb640 1 -- 172.21.15.1:0/4121908319 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554004260 con 0x55a5f515b9d0 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f054dffb640 1 -- 172.21.15.1:0/4121908319 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0554004400 con 0x55a5f515b9d0 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f056e98e740 1 -- 172.21.15.1:0/4121908319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0560005540 con 0x55a5f515b9d0 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f054dffb640 1 -- 172.21.15.1:0/4121908319 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f055401b920 con 0x55a5f515b9d0 2024-09-19T09:03:15.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f056e98e740 10 client.14982 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.607+0000 7f056e98e740 1 -- 172.21.15.1:0/4121908319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a5f51e1620 con 0x55a5f515b9d0 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f054dffb640 1 -- 172.21.15.1:0/4121908319 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0560005540 con 0x55a5f515b9d0 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f054dffb640 1 -- 172.21.15.1:0/4121908319 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0554003660 con 0x55a5f515b9d0 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f056e98e740 10 client.14982 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f056e98e740 10 client.14982 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f056e98e740 20 client.14982 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f056e98e740 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a5f51e6250 0x55a5f51e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f056e98e740 4 client.14982 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f056e98e740 1 -- 172.21.15.1:0/4121908319 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "status"}) -- 0x55a5f50c9b10 con 0x55a5f51e6250 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f056a351640 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a5f51e6250 0x55a5f51e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f056a351640 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a5f51e6250 0x55a5f51e4f60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a773c91ea76f779 server_cookie=5780df59bd8cfe5f in_seq=0 out_seq=0 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.608+0000 7f054dffb640 10 client.14982 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:03:15.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f054dffb640 1 -- 172.21.15.1:0/4121908319 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a5f50c9b10 con 0x55a5f51e6250 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f054dffb640 10 client.14982 handle_command_reply: tid=0 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 client.14982 shutdown 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 -- 172.21.15.1:0/4121908319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 msgr2=0x55a5f517c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f517c2b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0554003f10 tx=0x7f055400b5e0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 -- 172.21.15.1:0/4121908319 shutdown_connections 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a5f51e6250 0x55a5f51e4f60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a5f5166bb0 0x55a5f51dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a5f515c2f0 0x55a5f517c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f054dffb640 0 client.14982 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 --2- 172.21.15.1:0/4121908319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a5f515b9d0 0x55a5f517c2b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 -- 172.21.15.1:0/4121908319 >> 172.21.15.1:0/4121908319 conn(0x55a5f5157f60 msgr2=0x55a5f51567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 -- 172.21.15.1:0/4121908319 shutdown_connections 2024-09-19T09:03:15.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 1 -- 172.21.15.1:0/4121908319 wait complete. 2024-09-19T09:03:15.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.609+0000 7f056e98e740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T09:03:15.616 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:03:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:03:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-19T09:03:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24482, 2024-09-19T09:03:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:03:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:03:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:03:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 65.116787095000007, 2024-09-19T09:03:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 23, 2024-09-19T09:03:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:03:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:03:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 94.187405436999995 2024-09-19T09:03:15.617 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:03:15.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 -- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f05500a3350 msgr2=0x7f05500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f05500a3350 0x7f05500a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f055c08b670 tx=0x7f055c0e4040 comp rx=0 tx=0).stop 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 -- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 msgr2=0x7f056419cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 0x7f056419cd60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f055c005cc0 tx=0x7f055c02f790 comp rx=0 tx=0).stop 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 -- 172.21.15.1:0/325022501 shutdown_connections 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f056410c170 0x7f056419cd60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0564103660 0x7f05641989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f05500a3350 0x7f05500a5810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 --2- 172.21.15.1:0/325022501 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0564102d40 0x7f0564198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 -- 172.21.15.1:0/325022501 >> 172.21.15.1:0/325022501 conn(0x7f05640fc7a0 msgr2=0x7f05640fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 -- 172.21.15.1:0/325022501 shutdown_connections 2024-09-19T09:03:15.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:15.610+0000 7f056c5b5640 1 -- 172.21.15.1:0/325022501 wait complete. 2024-09-19T09:03:15.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:15 smithi022 ceph-mon[35107]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:16.278 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:03:16.538 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3458350741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102d40 msgr2=0x7fcb38103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3458350741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102d40 0x7fcb38103120 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009900 tx=0x7fcb2802a480 comp rx=0 tx=0).stop 2024-09-19T09:03:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3458350741 shutdown_connections 2024-09-19T09:03:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3458350741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb3810c170 0x7fcb3810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3458350741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb38103660 0x7fcb3810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3458350741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102d40 0x7fcb38103120 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3458350741 >> 172.21.15.1:0/3458350741 conn(0x7fcb380fc7a0 msgr2=0x7fcb380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3458350741 shutdown_connections 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.973+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3458350741 wait complete. 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.974+0000 7fcb3d15c640 1 Processor -- start 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3d15c640 1 -- start start 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3d15c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb38102d40 0x7fcb381a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3d15c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38103660 0x7fcb381a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3d15c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb3810c170 0x7fcb3810ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3d15c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38112110 con 0x7fcb38103660 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3d15c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38111f90 con 0x7fcb3810c170 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3d15c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38112290 con 0x7fcb38102d40 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38103660 0x7fcb381a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb3810c170 0x7fcb3810ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb3810c170 0x7fcb3810ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:48584/0 (socket says 172.21.15.1:48584) 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38103660 0x7fcb381a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34972/0 (socket says 172.21.15.1:34972) 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.975+0000 7fcb3759e640 1 -- 172.21.15.1:0/3543178254 learned_addr learned my addr 172.21.15.1:0/3543178254 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb38102d40 0x7fcb381a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb3759e640 1 -- 172.21.15.1:0/3543178254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb38102d40 msgr2=0x7fcb381a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb3759e640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb38102d40 0x7fcb381a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb3759e640 1 -- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38103660 msgr2=0x7fcb381a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb3759e640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38103660 0x7fcb381a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb3759e640 1 -- 172.21.15.1:0/3543178254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3810b3a0 con 0x7fcb3810c170 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb3659c640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38103660 0x7fcb381a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:16.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb3759e640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb3810c170 0x7fcb3810ac70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000eaa0 tx=0x7fcb3000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.976+0000 7fcb1ffff640 1 -- 172.21.15.1:0/3543178254 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000cdb0 con 0x7fcb3810c170 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.977+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3543178254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3810b690 con 0x7fcb3810c170 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.977+0000 7fcb1ffff640 1 -- 172.21.15.1:0/3543178254 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb30004b20 con 0x7fcb3810c170 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.977+0000 7fcb1ffff640 1 -- 172.21.15.1:0/3543178254 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb30011760 con 0x7fcb3810c170 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.977+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3543178254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3806bc10 con 0x7fcb3810c170 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.979+0000 7fcb1ffff640 1 -- 172.21.15.1:0/3543178254 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcb30011900 con 0x7fcb3810c170 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.979+0000 7fcb3f535740 1 Processor -- start 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.979+0000 7fcb3f535740 1 -- start start 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300205db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 0x560300210670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 0x560300212fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3f535740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56030016c090 con 0x5603002059d0 2024-09-19T09:03:16.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3f535740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560300113a70 con 0x5603002062f0 2024-09-19T09:03:16.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3f535740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560300168050 con 0x560300210bb0 2024-09-19T09:03:16.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300205db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb1ffff640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcb200a32d0 0x7fcb200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300205db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34988/0 (socket says 172.21.15.1:34988) 2024-09-19T09:03:16.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 -- 172.21.15.1:0/500909818 learned_addr learned my addr 172.21.15.1:0/500909818 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3759e640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcb200a32d0 0x7fcb200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 --2- 172.21.15.1:0/500909818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 0x560300212fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb1ffff640 1 -- 172.21.15.1:0/3543178254 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fcb300cfcc0 con 0x7fcb3810c170 2024-09-19T09:03:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 -- 172.21.15.1:0/500909818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 msgr2=0x560300212fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 --2- 172.21.15.1:0/500909818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 0x560300212fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 -- 172.21.15.1:0/500909818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 msgr2=0x560300210670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 --2- 172.21.15.1:0/500909818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 0x560300210670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 -- 172.21.15.1:0/500909818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560300120130 con 0x5603002059d0 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.980+0000 7fcb3659c640 1 --2- 172.21.15.1:0/500909818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300205db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009280 tx=0x7fcb2c009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f13c4b9d96cd01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb3759e640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcb200a32d0 0x7fcb200a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcb3009beb0 tx=0x7fcb30000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb1d7fa640 1 -- 172.21.15.1:0/500909818 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0107c0 con 0x5603002059d0 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb1d7fa640 1 -- 172.21.15.1:0/500909818 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb2c01c070 con 0x5603002059d0 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb1d7fa640 1 -- 172.21.15.1:0/500909818 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c016370 con 0x5603002059d0 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb3f535740 1 -- 172.21.15.1:0/500909818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 msgr2=0x560300205db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb3f535740 1 --2- 172.21.15.1:0/500909818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300205db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009280 tx=0x7fcb2c009950 comp rx=0 tx=0).stop 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb3f535740 1 -- 172.21.15.1:0/500909818 shutdown_connections 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb3f535740 1 --2- 172.21.15.1:0/500909818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 0x560300212fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb3f535740 1 --2- 172.21.15.1:0/500909818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 0x560300210670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb3f535740 1 --2- 172.21.15.1:0/500909818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300205db0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.981+0000 7fcb3f535740 1 -- 172.21.15.1:0/500909818 >> 172.21.15.1:0/500909818 conn(0x560300201f60 msgr2=0x560300202340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 -- 172.21.15.1:0/500909818 shutdown_connections 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 -- 172.21.15.1:0/500909818 wait complete. 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 -- start start 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 Processor -- start 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300210430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002062f0 0x56030020d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 0x56030020dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560300213780 con 0x5603002059d0 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560300126f20 con 0x560300210bb0 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560300213900 con 0x5603002062f0 2024-09-19T09:03:16.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3f535740 10 client.0 _ll_register_callbacks cb 0x5603000f0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.982+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300210430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300210430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35004/0 (socket says 172.21.15.1:35004) 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb36d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002062f0 0x56030020d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 -- 172.21.15.1:0/1283500021 learned_addr learned my addr 172.21.15.1:0/1283500021 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 0x56030020dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 -- 172.21.15.1:0/1283500021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002062f0 msgr2=0x56030020d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002062f0 0x56030020d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 -- 172.21.15.1:0/1283500021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 msgr2=0x56030020dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 0x56030020dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 -- 172.21.15.1:0/1283500021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ffedd2b0 con 0x5603002059d0 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3659c640 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300210430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c018ca0 tx=0x7fcb2c017a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75db04dea4cf04f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:16.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb1aff5640 1 -- 172.21.15.1:0/1283500021 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c02c060 con 0x5603002059d0 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb1aff5640 1 -- 172.21.15.1:0/1283500021 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fcb2c0107c0 con 0x5603002059d0 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3f535740 1 -- 172.21.15.1:0/1283500021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb2c01c070 con 0x5603002059d0 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb1aff5640 1 -- 172.21.15.1:0/1283500021 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcb2c0109c0 con 0x5603002059d0 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3f535740 10 client.14994 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.983+0000 7fcb3f535740 1 -- 172.21.15.1:0/1283500021 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56030021f090 con 0x5603002059d0 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb1aff5640 1 -- 172.21.15.1:0/1283500021 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb2c01c070 con 0x5603002059d0 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb1aff5640 1 -- 172.21.15.1:0/1283500021 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fcb2c024430 con 0x5603002059d0 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb3f535740 10 client.14994 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb3f535740 10 client.14994 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb3f535740 20 client.14994 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb3f535740 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x560300220550 0x560300222700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb3f535740 4 client.14994 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:16.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb3f535740 1 -- 172.21.15.1:0/1283500021 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560300179600 con 0x560300220550 2024-09-19T09:03:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.984+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x560300220550 0x560300222700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.985+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x560300220550 0x560300222700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe35d94409c2b232 server_cookie=be66a1f78e8f8a2f in_seq=0 out_seq=0 2024-09-19T09:03:16.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.985+0000 7fcb1aff5640 10 client.14994 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:03:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.985+0000 7fcb1aff5640 1 -- 172.21.15.1:0/1283500021 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560300179600 con 0x560300220550 2024-09-19T09:03:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.985+0000 7fcb1aff5640 10 client.14994 handle_command_reply: tid=0 2024-09-19T09:03:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 client.14994 shutdown 2024-09-19T09:03:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 -- 172.21.15.1:0/1283500021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 msgr2=0x560300210430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300210430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c018ca0 tx=0x7fcb2c017a70 comp rx=0 tx=0).stop 2024-09-19T09:03:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 -- 172.21.15.1:0/1283500021 shutdown_connections 2024-09-19T09:03:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x560300220550 0x560300222700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 0x56030020dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002062f0 0x56030020d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 --2- 172.21.15.1:0/1283500021 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300210430 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 -- 172.21.15.1:0/1283500021 >> 172.21.15.1:0/1283500021 conn(0x560300201f60 msgr2=0x560300207c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb1aff5640 0 client.14994 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:03:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 -- 172.21.15.1:0/1283500021 shutdown_connections 2024-09-19T09:03:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 1 -- 172.21.15.1:0/1283500021 wait complete. 2024-09-19T09:03:16.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:16.986+0000 7fcb3f535740 20 client.14994 trim_cache size 0 max 16384 2024-09-19T09:03:17.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3f535740 1 Processor -- start 2024-09-19T09:03:17.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3f535740 1 -- start start 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300220bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 0x560300221960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 0x56030020c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3f535740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560300220a40 con 0x5603002059d0 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3f535740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560300221110 con 0x5603002062f0 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3f535740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5603002217e0 con 0x560300210bb0 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300220bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300220bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35016/0 (socket says 172.21.15.1:35016) 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 -- 172.21.15.1:0/2035577969 learned_addr learned my addr 172.21.15.1:0/2035577969 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 -- 172.21.15.1:0/2035577969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 msgr2=0x56030020c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/2035577969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 0x560300221960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 --2- 172.21.15.1:0/2035577969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 0x56030020c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 -- 172.21.15.1:0/2035577969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 msgr2=0x560300221960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 --2- 172.21.15.1:0/2035577969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 0x560300221960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 -- 172.21.15.1:0/2035577969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603002019e0 con 0x5603002059d0 2024-09-19T09:03:17.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.004+0000 7fcb3659c640 1 --2- 172.21.15.1:0/2035577969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300220bc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c017a40 tx=0x7fcb2c015f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a857a2898184121d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:17.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb1cff9640 1 -- 172.21.15.1:0/2035577969 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c036070 con 0x5603002059d0 2024-09-19T09:03:17.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb1cff9640 1 -- 172.21.15.1:0/2035577969 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb2c024e50 con 0x5603002059d0 2024-09-19T09:03:17.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb1cff9640 1 -- 172.21.15.1:0/2035577969 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c02c040 con 0x5603002059d0 2024-09-19T09:03:17.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 -- 172.21.15.1:0/2035577969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 msgr2=0x560300220bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2035577969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300220bc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c017a40 tx=0x7fcb2c015f30 comp rx=0 tx=0).stop 2024-09-19T09:03:17.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 -- 172.21.15.1:0/2035577969 shutdown_connections 2024-09-19T09:03:17.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2035577969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560300210bb0 0x56030020c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2035577969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603002062f0 0x560300221960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2035577969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002059d0 0x560300220bc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 -- 172.21.15.1:0/2035577969 >> 172.21.15.1:0/2035577969 conn(0x560300201f60 msgr2=0x56030020d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 -- 172.21.15.1:0/2035577969 shutdown_connections 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.005+0000 7fcb3f535740 1 -- 172.21.15.1:0/2035577969 wait complete. 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 1 -- start start 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 1 Processor -- start 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002059d0 0x56030022b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002062f0 0x560300225530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 0x560300225b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560300222580 con 0x5603002062f0 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560300221eb0 con 0x560300210bb0 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560300222c50 con 0x5603002059d0 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3f535740 10 client.0 _ll_register_callbacks cb 0x7fcb2c0155b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb36d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002062f0 0x560300225530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb36d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002062f0 0x560300225530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35026/0 (socket says 172.21.15.1:35026) 2024-09-19T09:03:17.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb36d9d640 1 -- 172.21.15.1:0/2370825263 learned_addr learned my addr 172.21.15.1:0/2370825263 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3659c640 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002059d0 0x56030022b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3659c640 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 0x560300225b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb36d9d640 1 -- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002059d0 msgr2=0x56030022b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002059d0 0x56030022b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb36d9d640 1 -- 172.21.15.1:0/2370825263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 msgr2=0x560300225b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 0x560300225b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb36d9d640 1 -- 172.21.15.1:0/2370825263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560300289990 con 0x5603002062f0 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.006+0000 7fcb3659c640 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002059d0 0x56030022b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002062f0 0x560300225530 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009900 tx=0x7fcb28032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c802a5ad2bb3b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb1aff5640 1 -- 172.21.15.1:0/2370825263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28048030 con 0x5603002062f0 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb1aff5640 1 -- 172.21.15.1:0/2370825263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fcb28004250 con 0x5603002062f0 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb3f535740 1 -- 172.21.15.1:0/2370825263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb2c024e50 con 0x5603002062f0 2024-09-19T09:03:17.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb1aff5640 1 -- 172.21.15.1:0/2370825263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcb28035040 con 0x5603002062f0 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb3f535740 10 client.15000 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb3f535740 1 -- 172.21.15.1:0/2370825263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56030028ab20 con 0x5603002062f0 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb1aff5640 1 -- 172.21.15.1:0/2370825263 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb2c024e50 con 0x5603002062f0 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb1aff5640 1 -- 172.21.15.1:0/2370825263 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fcb280038f0 con 0x5603002062f0 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb3f535740 10 client.15000 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb3f535740 10 client.15000 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.007+0000 7fcb3f535740 20 client.15000 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x56030028f730 0x56030028e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3f535740 4 client.15000 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:03:17.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3f535740 1 -- 172.21.15.1:0/2370825263 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "status"}) -- 0x560300173b10 con 0x56030028f730 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3659c640 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x56030028f730 0x56030028e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3659c640 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x56030028f730 0x56030028e440 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95d9a675311aa3b8 server_cookie=34d6cff0b281282a in_seq=0 out_seq=0 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb1aff5640 10 client.15000 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb1aff5640 1 -- 172.21.15.1:0/2370825263 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560300173b10 con 0x56030028f730 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb1aff5640 10 client.15000 handle_command_reply: tid=0 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3f535740 1 client.15000 shutdown 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3f535740 1 -- 172.21.15.1:0/2370825263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002062f0 msgr2=0x560300225530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002062f0 0x560300225530 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009900 tx=0x7fcb28032e40 comp rx=0 tx=0).stop 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3f535740 1 -- 172.21.15.1:0/2370825263 shutdown_connections 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.008+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x56030028f730 0x56030028e440 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560300210bb0 0x560300225b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5603002062f0 0x560300225530 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb1aff5640 0 client.15000 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3f535740 1 --2- 172.21.15.1:0/2370825263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5603002059d0 0x56030022b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3f535740 1 -- 172.21.15.1:0/2370825263 >> 172.21.15.1:0/2370825263 conn(0x560300201f60 msgr2=0x56030020bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3f535740 1 -- 172.21.15.1:0/2370825263 shutdown_connections 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3f535740 1 -- 172.21.15.1:0/2370825263 wait complete. 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3f535740 20 client.15000 trim_cache size 0 max 16384 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24493, 2024-09-19T09:03:17.015 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:03:17.016 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:03:17.016 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:03:17.016 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 67.522249813000002, 2024-09-19T09:03:17.016 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 23, 2024-09-19T09:03:17.016 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:03:17.016 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:03:17.016 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 93.034318257999999 2024-09-19T09:03:17.016 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:03:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcb200a32d0 msgr2=0x7fcb200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcb200a32d0 0x7fcb200a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcb3009beb0 tx=0x7fcb30000f40 comp rx=0 tx=0).stop 2024-09-19T09:03:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3543178254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb3810c170 msgr2=0x7fcb3810ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.009+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb3810c170 0x7fcb3810ac70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000eaa0 tx=0x7fcb3000ef60 comp rx=0 tx=0).stop 2024-09-19T09:03:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.010+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3543178254 shutdown_connections 2024-09-19T09:03:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.010+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb3810c170 0x7fcb3810ac70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.010+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38103660 0x7fcb381a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.010+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcb200a32d0 0x7fcb200a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.010+0000 7fcb3d15c640 1 --2- 172.21.15.1:0/3543178254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb38102d40 0x7fcb381a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.010+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3543178254 >> 172.21.15.1:0/3543178254 conn(0x7fcb380fc7a0 msgr2=0x7fcb380fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.010+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3543178254 shutdown_connections 2024-09-19T09:03:17.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:17.010+0000 7fcb3d15c640 1 -- 172.21.15.1:0/3543178254 wait complete. 2024-09-19T09:03:17.587 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:17 smithi001 ceph-mon[30939]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:17.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:17 smithi064 ceph-mon[35179]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:17.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:03:17.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:17 smithi022 ceph-mon[35107]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:17.872 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:18.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 -- 172.21.15.1:0/1000366845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981019d0 msgr2=0x7f7498101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 --2- 172.21.15.1:0/1000366845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981019d0 0x7f7498101e30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7488009cd0 tx=0x7f748802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 -- 172.21.15.1:0/1000366845 shutdown_connections 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 --2- 172.21.15.1:0/1000366845 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7498102370 0x7f749810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 --2- 172.21.15.1:0/1000366845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981019d0 0x7f7498101e30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 --2- 172.21.15.1:0/1000366845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74981079d0 0x7f7498107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 -- 172.21.15.1:0/1000366845 >> 172.21.15.1:0/1000366845 conn(0x7f74980fd710 msgr2=0x7f74980ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 -- 172.21.15.1:0/1000366845 shutdown_connections 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 -- 172.21.15.1:0/1000366845 wait complete. 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 Processor -- start 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.333+0000 7f749dba1640 1 -- start start 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749dba1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74981019d0 0x7f74981983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749dba1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7498102370 0x7f74981988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749dba1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981079d0 0x7f749819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749dba1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7498111ef0 con 0x7f74981079d0 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749dba1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7498111d70 con 0x7f7498102370 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749dba1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7498112070 con 0x7f74981019d0 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981079d0 0x7f749819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981079d0 0x7f749819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35048/0 (socket says 172.21.15.1:35048) 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 -- 172.21.15.1:0/1017582004 learned_addr learned my addr 172.21.15.1:0/1017582004 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f7497fff640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7498102370 0x7f74981988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749cb9f640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74981019d0 0x7f74981983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 -- 172.21.15.1:0/1017582004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74981019d0 msgr2=0x7f74981983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74981019d0 0x7f74981983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 -- 172.21.15.1:0/1017582004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7498102370 msgr2=0x7f74981988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7498102370 0x7f74981988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 -- 172.21.15.1:0/1017582004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749819d360 con 0x7f74981079d0 2024-09-19T09:03:18.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981079d0 0x7f749819cc80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f748000c970 tx=0x7f748000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f7495ffb640 1 -- 172.21.15.1:0/1017582004 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480007bb0 con 0x7f74981079d0 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f749dba1640 1 -- 172.21.15.1:0/1017582004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749819d650 con 0x7f74981079d0 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f7495ffb640 1 -- 172.21.15.1:0/1017582004 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7480007d50 con 0x7f74981079d0 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.334+0000 7f7495ffb640 1 -- 172.21.15.1:0/1017582004 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748000f450 con 0x7f74981079d0 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.335+0000 7f749dba1640 1 -- 172.21.15.1:0/1017582004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74981a4f30 con 0x7f74981079d0 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f7495ffb640 1 -- 172.21.15.1:0/1017582004 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7480005020 con 0x7f74981079d0 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f74a11dc740 1 Processor -- start 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f74a11dc740 1 -- start start 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f7495ffb640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74840a32d0 0x7f74840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4d6db0 0x564ffa4d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f74a11dc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564ffa432090 con 0x564ffa4cc4f0 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f74a11dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564ffa3d9a70 con 0x564ffa4cbbd0 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f74a11dc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564ffa42e050 con 0x564ffa4d6db0 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f7497fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f7495ffb640 1 -- 172.21.15.1:0/1017582004 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f74800cf6e0 con 0x7f74981079d0 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.337+0000 7f7497fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35062/0 (socket says 172.21.15.1:35062) 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 -- 172.21.15.1:0/21684575 learned_addr learned my addr 172.21.15.1:0/21684575 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74840a32d0 0x7f74840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f749cb9f640 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f749d3a0640 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4d6db0 0x564ffa4d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 -- 172.21.15.1:0/21684575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4d6db0 msgr2=0x564ffa4d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4d6db0 0x564ffa4d91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 -- 172.21.15.1:0/21684575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 msgr2=0x564ffa4cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:18.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 -- 172.21.15.1:0/21684575 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ffa3e6130 con 0x564ffa4cc4f0 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d6870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7488005fe0 tx=0x7f7488003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a22bf3c761590f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f7497fff640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74840a32d0 0x7f74840a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f748802ae00 tx=0x7f748803c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f748effd640 1 -- 172.21.15.1:0/21684575 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488004610 con 0x564ffa4cc4f0 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f748effd640 1 -- 172.21.15.1:0/21684575 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7488036040 con 0x564ffa4cc4f0 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.338+0000 7f748effd640 1 -- 172.21.15.1:0/21684575 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488049400 con 0x564ffa4cc4f0 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 -- 172.21.15.1:0/21684575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cc4f0 msgr2=0x564ffa4d6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d6870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7488005fe0 tx=0x7f7488003d90 comp rx=0 tx=0).stop 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 -- 172.21.15.1:0/21684575 shutdown_connections 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4d6db0 0x564ffa4d91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d6870 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 --2- 172.21.15.1:0/21684575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 -- 172.21.15.1:0/21684575 >> 172.21.15.1:0/21684575 conn(0x564ffa4c8160 msgr2=0x564ffa4c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 -- 172.21.15.1:0/21684575 shutdown_connections 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 -- 172.21.15.1:0/21684575 wait complete. 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.339+0000 7f74a11dc740 1 -- start start 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f74a11dc740 1 Processor -- start 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cbbd0 0x564ffa4d66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4d6db0 0x564ffa4d3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f74a11dc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564ffa4d9980 con 0x564ffa4cbbd0 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f74a11dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564ffa3ecf20 con 0x564ffa4d6db0 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f74a11dc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564ffa4d9b00 con 0x564ffa4cc4f0 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f74a11dc740 10 client.0 _ll_register_callbacks cb 0x564ffa3b6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749cb9f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cbbd0 0x564ffa4d66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749cb9f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cbbd0 0x564ffa4d66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35076/0 (socket says 172.21.15.1:35076) 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749cb9f640 1 -- 172.21.15.1:0/2258449542 learned_addr learned my addr 172.21.15.1:0/2258449542 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749d3a0640 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4d6db0 0x564ffa4d3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f7497fff640 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749cb9f640 1 -- 172.21.15.1:0/2258449542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 msgr2=0x564ffa4d39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749cb9f640 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749cb9f640 1 -- 172.21.15.1:0/2258449542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4d6db0 msgr2=0x564ffa4d3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749cb9f640 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4d6db0 0x564ffa4d3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f749cb9f640 1 -- 172.21.15.1:0/2258449542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ffa1a32b0 con 0x564ffa4cbbd0 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.340+0000 7f7497fff640 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f749cb9f640 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cbbd0 0x564ffa4d66a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f749000b940 tx=0x7f749000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73ebf77f420796e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f7477fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:18.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f7477fff640 1 -- 172.21.15.1:0/2258449542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749001b440 con 0x564ffa4cbbd0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f7477fff640 1 -- 172.21.15.1:0/2258449542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f749001b5e0 con 0x564ffa4cbbd0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 1 -- 172.21.15.1:0/2258449542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7488036040 con 0x564ffa4cbbd0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f7477fff640 1 -- 172.21.15.1:0/2258449542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f749001b7e0 con 0x564ffa4cbbd0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 10 client.15012 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 1 -- 172.21.15.1:0/2258449542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x564ffa4e5350 con 0x564ffa4cbbd0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f7477fff640 1 -- 172.21.15.1:0/2258449542 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7488036040 con 0x564ffa4cbbd0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f7477fff640 1 -- 172.21.15.1:0/2258449542 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f7490019020 con 0x564ffa4cbbd0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 10 client.15012 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 10 client.15012 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 20 client.15012 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564ffa4e79c0 0x564ffa4e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 4 client.15012 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.341+0000 7f74a11dc740 1 -- 172.21.15.1:0/2258449542 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ffa43f600 con 0x564ffa4e79c0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.342+0000 7f7497fff640 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564ffa4e79c0 0x564ffa4e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.342+0000 7f7497fff640 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564ffa4e79c0 0x564ffa4e8e30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d4998abe066e7e2 server_cookie=d80acb75793f5e8f in_seq=0 out_seq=0 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.342+0000 7f7477fff640 10 client.15012 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f7477fff640 1 -- 172.21.15.1:0/2258449542 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ffa43f600 con 0x564ffa4e79c0 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f7477fff640 10 client.15012 handle_command_reply: tid=0 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 client.15012 shutdown 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 -- 172.21.15.1:0/2258449542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cbbd0 msgr2=0x564ffa4d66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cbbd0 0x564ffa4d66a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f749000b940 tx=0x7f749000be00 comp rx=0 tx=0).stop 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 -- 172.21.15.1:0/2258449542 shutdown_connections 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564ffa4e79c0 0x564ffa4e8e30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4d6db0 0x564ffa4d3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 0x564ffa4d39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f7477fff640 0 client.15012 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 --2- 172.21.15.1:0/2258449542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4cbbd0 0x564ffa4d66a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 -- 172.21.15.1:0/2258449542 >> 172.21.15.1:0/2258449542 conn(0x564ffa4c8160 msgr2=0x564ffa4cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 -- 172.21.15.1:0/2258449542 shutdown_connections 2024-09-19T09:03:18.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 1 -- 172.21.15.1:0/2258449542 wait complete. 2024-09-19T09:03:18.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.343+0000 7f74a11dc740 20 client.15012 trim_cache size 0 max 16384 2024-09-19T09:03:18.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f74a11dc740 1 Processor -- start 2024-09-19T09:03:18.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f74a11dc740 1 -- start start 2024-09-19T09:03:18.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4e72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 0x564ffa4e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4d5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f74a11dc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564ffa4e7170 con 0x564ffa4d6db0 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f74a11dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564ffa4e7840 con 0x564ffa4cbbd0 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f74a11dc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564ffa4e7f10 con 0x564ffa4cc4f0 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f749d3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f749d3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4d5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35090/0 (socket says 172.21.15.1:35090) 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f749d3a0640 1 -- 172.21.15.1:0/1095335632 learned_addr learned my addr 172.21.15.1:0/1095335632 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.361+0000 7f749cb9f640 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4e72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f749d3a0640 1 -- 172.21.15.1:0/1095335632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 msgr2=0x564ffa4e8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 0x564ffa4e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f749d3a0640 1 -- 172.21.15.1:0/1095335632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 msgr2=0x564ffa4e72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4e72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f749d3a0640 1 -- 172.21.15.1:0/1095335632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ffa4cba00 con 0x564ffa4d6db0 2024-09-19T09:03:18.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f749cb9f640 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4e72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:18.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4d5850 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7480098600 tx=0x7f7480086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d713a70d3fa7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:18.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f748e7fc640 1 -- 172.21.15.1:0/1095335632 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748001d040 con 0x564ffa4d6db0 2024-09-19T09:03:18.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f748e7fc640 1 -- 172.21.15.1:0/1095335632 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f748009ff30 con 0x564ffa4d6db0 2024-09-19T09:03:18.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.362+0000 7f748e7fc640 1 -- 172.21.15.1:0/1095335632 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748009b080 con 0x564ffa4d6db0 2024-09-19T09:03:18.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 -- 172.21.15.1:0/1095335632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 msgr2=0x564ffa4d5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4d5850 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7480098600 tx=0x7f7480086040 comp rx=0 tx=0).stop 2024-09-19T09:03:18.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 -- 172.21.15.1:0/1095335632 shutdown_connections 2024-09-19T09:03:18.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4d5850 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cc4f0 0x564ffa4e8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1095335632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cbbd0 0x564ffa4e72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 -- 172.21.15.1:0/1095335632 >> 172.21.15.1:0/1095335632 conn(0x564ffa4c8160 msgr2=0x564ffa4d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:18.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 -- 172.21.15.1:0/1095335632 shutdown_connections 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 -- 172.21.15.1:0/1095335632 wait complete. 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 -- start start 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 Processor -- start 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cbbd0 0x564ffa54ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cc4f0 0x564ffa54ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.363+0000 7f74a11dc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564ffa4e8cb0 con 0x564ffa4d6db0 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f74a11dc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564ffa4e85e0 con 0x564ffa4cc4f0 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f74a11dc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564ffa4e9380 con 0x564ffa4cbbd0 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f74a11dc740 10 client.0 _ll_register_callbacks cb 0x7f74900040e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35098/0 (socket says 172.21.15.1:35098) 2024-09-19T09:03:18.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 -- 172.21.15.1:0/1707207664 learned_addr learned my addr 172.21.15.1:0/1707207664 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749cb9f640 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cbbd0 0x564ffa54ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f7497fff640 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cc4f0 0x564ffa54ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 -- 172.21.15.1:0/1707207664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cbbd0 msgr2=0x564ffa54ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cbbd0 0x564ffa54ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 -- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cc4f0 msgr2=0x564ffa54ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cc4f0 0x564ffa54ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 -- 172.21.15.1:0/1707207664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ffa4f14c0 con 0x564ffa4d6db0 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f7497fff640 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cc4f0 0x564ffa54ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f749d3a0640 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4f0d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f74800cd0f0 tx=0x7f748009bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b62657ea4636c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f7477fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f7477fff640 1 -- 172.21.15.1:0/1707207664 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74800ba050 con 0x564ffa4d6db0 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f7477fff640 1 -- 172.21.15.1:0/1707207664 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f74800cd2c0 con 0x564ffa4d6db0 2024-09-19T09:03:18.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f74a11dc740 1 -- 172.21.15.1:0/1707207664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f748009ff30 con 0x564ffa4d6db0 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f7477fff640 1 -- 172.21.15.1:0/1707207664 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f748001d040 con 0x564ffa4d6db0 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f74a11dc740 10 client.15018 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.364+0000 7f74a11dc740 1 -- 172.21.15.1:0/1707207664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x564ffa556290 con 0x564ffa4d6db0 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f7477fff640 1 -- 172.21.15.1:0/1707207664 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f748009ff30 con 0x564ffa4d6db0 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f7477fff640 1 -- 172.21.15.1:0/1707207664 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f74800ba1f0 con 0x564ffa4d6db0 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f74a11dc740 10 client.15018 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f74a11dc740 10 client.15018 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f74a11dc740 20 client.15018 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564ffa55a8f0 0x564ffa559600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f74a11dc740 4 client.15018 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f74a11dc740 1 -- 172.21.15.1:0/1707207664 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "status"}) -- 0x564ffa439b10 con 0x564ffa55a8f0 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.365+0000 7f749cb9f640 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564ffa55a8f0 0x564ffa559600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:18.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f749cb9f640 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564ffa55a8f0 0x564ffa559600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4872c4feabfc7dfa server_cookie=e9ac649843529dc3 in_seq=0 out_seq=0 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f7477fff640 10 client.15018 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f7477fff640 1 -- 172.21.15.1:0/1707207664 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x564ffa439b10 con 0x564ffa55a8f0 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f7477fff640 10 client.15018 handle_command_reply: tid=0 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 client.15018 shutdown 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 -- 172.21.15.1:0/1707207664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 msgr2=0x564ffa4f0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4f0d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f74800cd0f0 tx=0x7f748009bdb0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 -- 172.21.15.1:0/1707207664 shutdown_connections 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564ffa55a8f0 0x564ffa559600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564ffa4d6db0 0x564ffa4f0d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564ffa4cc4f0 0x564ffa54ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 --2- 172.21.15.1:0/1707207664 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564ffa4cbbd0 0x564ffa54ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f7477fff640 0 client.15018 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:18.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 -- 172.21.15.1:0/1707207664 >> 172.21.15.1:0/1707207664 conn(0x564ffa4c8160 msgr2=0x564ffa4c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 -- 172.21.15.1:0/1707207664 shutdown_connections 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 1 -- 172.21.15.1:0/1707207664 wait complete. 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.366+0000 7f74a11dc740 20 client.15018 trim_cache size 0 max 16384 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24500, 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:03:18.373 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:03:18.374 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 75.711557502999995, 2024-09-19T09:03:18.374 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 23, 2024-09-19T09:03:18.374 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:03:18.374 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:03:18.374 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 85.780977553 2024-09-19T09:03:18.374 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:03:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 -- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74840a32d0 msgr2=0x7f74840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74840a32d0 0x7f74840a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f748802ae00 tx=0x7f748803c000 comp rx=0 tx=0).stop 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 -- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981079d0 msgr2=0x7f749819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981079d0 0x7f749819cc80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f748000c970 tx=0x7f748000ce30 comp rx=0 tx=0).stop 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 -- 172.21.15.1:0/1017582004 shutdown_connections 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74981079d0 0x7f749819cc80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7498102370 0x7f74981988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74840a32d0 0x7f74840a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 --2- 172.21.15.1:0/1017582004 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74981019d0 0x7f74981983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 -- 172.21.15.1:0/1017582004 >> 172.21.15.1:0/1017582004 conn(0x7f74980fd710 msgr2=0x7f74980fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 -- 172.21.15.1:0/1017582004 shutdown_connections 2024-09-19T09:03:18.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:18.367+0000 7f749dba1640 1 -- 172.21.15.1:0/1017582004 wait complete. 2024-09-19T09:03:18.985 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T09:03:18.985 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:03:18.996 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:03:18.996 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T09:03:19.257 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:19.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:19 smithi064 ceph-mon[35179]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:19.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:19 smithi001 ceph-mon[30939]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:19.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:19 smithi022 ceph-mon[35107]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.739+0000 7f44a8e64640 1 -- 172.21.15.1:0/3908773194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 msgr2=0x7f44a4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.739+0000 7f44a8e64640 1 --2- 172.21.15.1:0/3908773194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 0x7f44a4102000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4494009900 tx=0x7f449402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 -- 172.21.15.1:0/3908773194 shutdown_connections 2024-09-19T09:03:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 --2- 172.21.15.1:0/3908773194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a41037c0 0x7f44a410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 --2- 172.21.15.1:0/3908773194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a4102e00 0x7f44a4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 --2- 172.21.15.1:0/3908773194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 0x7f44a4102000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 -- 172.21.15.1:0/3908773194 >> 172.21.15.1:0/3908773194 conn(0x7f44a40fd390 msgr2=0x7f44a40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 -- 172.21.15.1:0/3908773194 shutdown_connections 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 -- 172.21.15.1:0/3908773194 wait complete. 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 Processor -- start 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.740+0000 7f44a8e64640 1 -- start start 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a8e64640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 0x7f44a4197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a8e64640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a4102e00 0x7f44a41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a8e64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a41037c0 0x7f44a419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a8e64640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f44a410d9b0 con 0x7f44a4101c00 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a8e64640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f44a410d830 con 0x7f44a41037c0 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a8e64640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f44a410db30 con 0x7f44a4102e00 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 0x7f44a4197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 0x7f44a4197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35124/0 (socket says 172.21.15.1:35124) 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 -- 172.21.15.1:0/2958548219 learned_addr learned my addr 172.21.15.1:0/2958548219 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a1d9b640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a4102e00 0x7f44a41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a2d9d640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a41037c0 0x7f44a419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 -- 172.21.15.1:0/2958548219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a4102e00 msgr2=0x7f44a41984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a4102e00 0x7f44a41984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 -- 172.21.15.1:0/2958548219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a41037c0 msgr2=0x7f44a419f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a41037c0 0x7f44a419f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 -- 172.21.15.1:0/2958548219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a419fbe0 con 0x7f44a4101c00 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a259c640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 0x7f44a4197fb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4494005ab0 tx=0x7f44940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44937fe640 1 -- 172.21.15.1:0/2958548219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449403f030 con 0x7f44a4101c00 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44937fe640 1 -- 172.21.15.1:0/2958548219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4494003d00 con 0x7f44a4101c00 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.741+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a419fe70 con 0x7f44a4101c00 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.742+0000 7f44937fe640 1 -- 172.21.15.1:0/2958548219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494035070 con 0x7f44a4101c00 2024-09-19T09:03:19.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.742+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a41a0270 con 0x7f44a4101c00 2024-09-19T09:03:19.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.743+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a4108fb0 con 0x7f44a4101c00 2024-09-19T09:03:19.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.744+0000 7f44937fe640 1 -- 172.21.15.1:0/2958548219 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4494042030 con 0x7f44a4101c00 2024-09-19T09:03:19.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.744+0000 7f44937fe640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f448c0a3300 0x7f448c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.744+0000 7f44a1d9b640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f448c0a3300 0x7f448c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.745+0000 7f44937fe640 1 -- 172.21.15.1:0/2958548219 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f44940efc90 con 0x7f44a4101c00 2024-09-19T09:03:19.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.745+0000 7f44a1d9b640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f448c0a3300 0x7f448c0a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f44a41994d0 tx=0x7f449800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:19.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.749+0000 7f44937fe640 1 -- 172.21.15.1:0/2958548219 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f44940f5020 con 0x7f44a4101c00 2024-09-19T09:03:19.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.943+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f44a4062630 con 0x7f448c0a3300 2024-09-19T09:03:19.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.944+0000 7f44937fe640 1 -- 172.21.15.1:0/2958548219 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f44a4062630 con 0x7f448c0a3300 2024-09-19T09:03:19.944 INFO:teuthology.orchestra.run.smithi001.stdout:Backend: cephadm 2024-09-19T09:03:19.944 INFO:teuthology.orchestra.run.smithi001.stdout:Available: Yes 2024-09-19T09:03:19.944 INFO:teuthology.orchestra.run.smithi001.stdout:Paused: No 2024-09-19T09:03:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f448c0a3300 msgr2=0x7f448c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f448c0a3300 0x7f448c0a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f44a41994d0 tx=0x7f449800b390 comp rx=0 tx=0).stop 2024-09-19T09:03:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 msgr2=0x7f44a4197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 0x7f44a4197fb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4494005ab0 tx=0x7f44940042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 shutdown_connections 2024-09-19T09:03:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44a41037c0 0x7f44a419f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f448c0a3300 0x7f448c0a57c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a4102e00 0x7f44a41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 --2- 172.21.15.1:0/2958548219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4101c00 0x7f44a4197fb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.946+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 >> 172.21.15.1:0/2958548219 conn(0x7f44a40fd390 msgr2=0x7f44a4106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.947+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 shutdown_connections 2024-09-19T09:03:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:19.947+0000 7f44a8e64640 1 -- 172.21.15.1:0/2958548219 wait complete. 2024-09-19T09:03:20.611 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T09:03:20.873 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 -- 172.21.15.1:0/917363384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac101d10 msgr2=0x7fa1ac102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 --2- 172.21.15.1:0/917363384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac101d10 0x7fa1ac102190 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009900 tx=0x7fa1a002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 -- 172.21.15.1:0/917363384 shutdown_connections 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 --2- 172.21.15.1:0/917363384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ac1026d0 0x7fa1ac108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 --2- 172.21.15.1:0/917363384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac101d10 0x7fa1ac102190 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 --2- 172.21.15.1:0/917363384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ac100b10 0x7fa1ac100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 -- 172.21.15.1:0/917363384 >> 172.21.15.1:0/917363384 conn(0x7fa1ac0fc2a0 msgr2=0x7fa1ac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 -- 172.21.15.1:0/917363384 shutdown_connections 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.321+0000 7fa1b1730640 1 -- 172.21.15.1:0/917363384 wait complete. 2024-09-19T09:03:21.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1b1730640 1 Processor -- start 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1b1730640 1 -- start start 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1b1730640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ac100b10 0x7fa1ac197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1b1730640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ac101d10 0x7fa1ac198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1b1730640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac1026d0 0x7fa1ac19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1b1730640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac10c8d0 con 0x7fa1ac1026d0 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1b1730640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac10c750 con 0x7fa1ac100b10 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1b1730640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac10ca50 con 0x7fa1ac101d10 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac1026d0 0x7fa1ac19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac1026d0 0x7fa1ac19f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35132/0 (socket says 172.21.15.1:35132) 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1ab7fe640 1 -- 172.21.15.1:0/3300248774 learned_addr learned my addr 172.21.15.1:0/3300248774 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1aaffd640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ac100b10 0x7fa1ac197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1aa7fc640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ac101d10 0x7fa1ac198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1ab7fe640 1 -- 172.21.15.1:0/3300248774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ac101d10 msgr2=0x7fa1ac198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1ab7fe640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ac101d10 0x7fa1ac198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1ab7fe640 1 -- 172.21.15.1:0/3300248774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ac100b10 msgr2=0x7fa1ac197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1ab7fe640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ac100b10 0x7fa1ac197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.322+0000 7fa1ab7fe640 1 -- 172.21.15.1:0/3300248774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac19fc20 con 0x7fa1ac1026d0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.323+0000 7fa1ab7fe640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac1026d0 0x7fa1ac19f5b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400cad0 tx=0x7fa1a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.323+0000 7fa193fff640 1 -- 172.21.15.1:0/3300248774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400ae20 con 0x7fa1ac1026d0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.323+0000 7fa193fff640 1 -- 172.21.15.1:0/3300248774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa1a4004b20 con 0x7fa1ac1026d0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.323+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ac19ff10 con 0x7fa1ac1026d0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.323+0000 7fa193fff640 1 -- 172.21.15.1:0/3300248774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400f780 con 0x7fa1ac1026d0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.323+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ac1a0370 con 0x7fa1ac1026d0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.324+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ac1a0600 con 0x7fa1ac1026d0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.325+0000 7fa193fff640 1 -- 172.21.15.1:0/3300248774 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa1a400f920 con 0x7fa1ac1026d0 2024-09-19T09:03:21.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.326+0000 7fa193fff640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa1940a3300 0x7fa1940a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.326+0000 7fa1aaffd640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa1940a3300 0x7fa1940a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.326+0000 7fa193fff640 1 -- 172.21.15.1:0/3300248774 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa1a40cfe70 con 0x7fa1ac1026d0 2024-09-19T09:03:21.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.326+0000 7fa1aaffd640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa1940a3300 0x7fa1940a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0058c0 tx=0x7fa19c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.329+0000 7fa193fff640 1 -- 172.21.15.1:0/3300248774 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa1a4014030 con 0x7fa1ac1026d0 2024-09-19T09:03:21.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.511+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa1ac1a07d0 con 0x7fa1940a3300 2024-09-19T09:03:21.512 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:21 smithi001 ceph-mon[30939]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:21.512 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:21 smithi001 ceph-mon[30939]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.526+0000 7fa193fff640 1 -- 172.21.15.1:0/3300248774 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fa1ac1a07d0 con 0x7fa1940a3300 2024-09-19T09:03:21.527 INFO:teuthology.orchestra.run.smithi001.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:03:21.527 INFO:teuthology.orchestra.run.smithi001.stdout:mds.a smithi001 running (92s) 16s ago 91s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 a08cf576aab4 2024-09-19T09:03:21.527 INFO:teuthology.orchestra.run.smithi001.stdout:mds.b smithi022 running (89s) 21s ago 88s 25.5M - 19.1.1-361-g2f599a46 d2baa855c067 55ef0bebea88 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.c smithi064 running (103s) 21s ago 102s 19.4M - 19.1.1-361-g2f599a46 d2baa855c067 740a25227230 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.d smithi001 running (111s) 16s ago 110s 13.3M - 19.1.1-361-g2f599a46 d2baa855c067 c077c2b11d19 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.e smithi022 running (108s) 21s ago 107s 17.0M - 19.1.1-361-g2f599a46 d2baa855c067 e57a036e09ac 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.f smithi064 running (105s) 21s ago 105s 19.1M - 19.1.1-361-g2f599a46 d2baa855c067 b1c4be031aae 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.g smithi001 running (94s) 16s ago 94s 13.6M - 19.1.1-361-g2f599a46 d2baa855c067 3e67f9be480e 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.h smithi022 running (100s) 21s ago 100s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 58faa7fcb97e 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.i smithi064 running (97s) 21s ago 97s 19.5M - 19.1.1-361-g2f599a46 d2baa855c067 a9713fa7beca 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.j smithi001 running (114s) 16s ago 113s 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 d466a458bcb3 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.k smithi022 running (117s) 21s ago 117s 13.3M - 19.1.1-361-g2f599a46 d2baa855c067 1678cd433e7b 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mds.l smithi064 running (2m) 21s ago 119s 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 913a9f622878 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.x smithi001 *:9283,8765 running (8m) 16s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 f135ae2e02ea 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.y smithi022 *:8443,8765 running (7m) 21s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 0f323c73707c 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.z smithi064 *:8443,8765 running (7m) 21s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 f015fea63ea3 2024-09-19T09:03:21.528 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a smithi001 running (8m) 16s ago 8m 49.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ba7e58f53a96 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b smithi022 running (7m) 21s ago 7m 39.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 d3e4a5cd071f 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c smithi064 running (7m) 21s ago 7m 40.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 0a168ca63fbc 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 smithi001 running (6m) 16s ago 6m 57.9M 4273M 19.1.1-361-g2f599a46 d2baa855c067 0249f937fd21 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 smithi022 running (6m) 21s ago 6m 49.3M 4273M 19.1.1-361-g2f599a46 d2baa855c067 3b66a4d79e4c 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 smithi064 running (6m) 21s ago 6m 56.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 fbe9f247307f 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 smithi001 running (5m) 16s ago 5m 53.6M 4273M 19.1.1-361-g2f599a46 d2baa855c067 1797dae368b2 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 smithi022 running (5m) 21s ago 5m 45.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 6486936d3e1a 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 smithi064 running (4m) 21s ago 4m 56.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 96574175536b 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 smithi001 running (4m) 16s ago 4m 53.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 c7fddde2e61a 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 smithi022 running (3m) 21s ago 3m 52.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 46a4a53d0d49 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 smithi064 running (3m) 21s ago 3m 46.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 0d240d6a09a1 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 smithi001 running (3m) 16s ago 3m 50.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 b28d4f365577 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 smithi022 running (2m) 21s ago 2m 46.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 4cc56287e6d8 2024-09-19T09:03:21.529 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 smithi064 running (2m) 21s ago 2m 46.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 433c17062e1c 2024-09-19T09:03:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa1940a3300 msgr2=0x7fa1940a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa1940a3300 0x7fa1940a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0058c0 tx=0x7fa19c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac1026d0 msgr2=0x7fa1ac19f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac1026d0 0x7fa1ac19f5b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400cad0 tx=0x7fa1a400cf90 comp rx=0 tx=0).stop 2024-09-19T09:03:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 shutdown_connections 2024-09-19T09:03:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1ac1026d0 0x7fa1ac19f5b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa1940a3300 0x7fa1940a57c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ac101d10 0x7fa1ac198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 --2- 172.21.15.1:0/3300248774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ac100b10 0x7fa1ac197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 >> 172.21.15.1:0/3300248774 conn(0x7fa1ac0fc2a0 msgr2=0x7fa1ac06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 shutdown_connections 2024-09-19T09:03:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:21.528+0000 7fa1b1730640 1 -- 172.21.15.1:0/3300248774 wait complete. 2024-09-19T09:03:21.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:21 smithi064 ceph-mon[35179]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:21.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:21 smithi064 ceph-mon[35179]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:21.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:21 smithi022 ceph-mon[35107]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:21.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:21 smithi022 ceph-mon[35107]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:22.138 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T09:03:22.394 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:22.494 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:22 smithi001 ceph-mon[30939]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:22.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:22 smithi064 ceph-mon[35179]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:22.610 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:22 smithi022 ceph-mon[35107]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 -- 172.21.15.1:0/1636130454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e01037c0 msgr2=0x7fb8e010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 --2- 172.21.15.1:0/1636130454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e01037c0 0x7fb8e010a050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009ca0 tx=0x7fb8d802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 -- 172.21.15.1:0/1636130454 shutdown_connections 2024-09-19T09:03:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 --2- 172.21.15.1:0/1636130454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e01037c0 0x7fb8e010a050 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 --2- 172.21.15.1:0/1636130454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e0102e00 0x7fb8e0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 --2- 172.21.15.1:0/1636130454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e0101c00 0x7fb8e0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 -- 172.21.15.1:0/1636130454 >> 172.21.15.1:0/1636130454 conn(0x7fb8e00fd390 msgr2=0x7fb8e00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 -- 172.21.15.1:0/1636130454 shutdown_connections 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.871+0000 7fb8e609e640 1 -- 172.21.15.1:0/1636130454 wait complete. 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8e609e640 1 Processor -- start 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8e609e640 1 -- start start 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8e609e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e0101c00 0x7fb8e019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8e609e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e0102e00 0x7fb8e019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8e609e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e01037c0 0x7fb8e01a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8e609e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e010d9b0 con 0x7fb8e0102e00 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8e609e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e010d830 con 0x7fb8e0101c00 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8e609e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e010db30 con 0x7fb8e01037c0 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e0102e00 0x7fb8e019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8df7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e0101c00 0x7fb8e019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e0102e00 0x7fb8e019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59364/0 (socket says 172.21.15.1:59364) 2024-09-19T09:03:22.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8df7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e0101c00 0x7fb8e019a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:55924/0 (socket says 172.21.15.1:55924) 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.872+0000 7fb8deffd640 1 -- 172.21.15.1:0/3250637747 learned_addr learned my addr 172.21.15.1:0/3250637747 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8dffff640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e01037c0 0x7fb8e01a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8df7fe640 1 -- 172.21.15.1:0/3250637747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e01037c0 msgr2=0x7fb8e01a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8df7fe640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e01037c0 0x7fb8e01a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8df7fe640 1 -- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e0102e00 msgr2=0x7fb8e019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8df7fe640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e0102e00 0x7fb8e019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8df7fe640 1 -- 172.21.15.1:0/3250637747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e01a1d90 con 0x7fb8e0101c00 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8deffd640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e0102e00 0x7fb8e019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8df7fe640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e0101c00 0x7fb8e019a160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000e9c0 tx=0x7fb8d000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8dcff9640 1 -- 172.21.15.1:0/3250637747 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000ccc0 con 0x7fb8e0101c00 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e01a2080 con 0x7fb8e0101c00 2024-09-19T09:03:22.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8dcff9640 1 -- 172.21.15.1:0/3250637747 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb8d00035f0 con 0x7fb8e0101c00 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8dcff9640 1 -- 172.21.15.1:0/3250637747 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000ce60 con 0x7fb8e0101c00 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.873+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e01a2610 con 0x7fb8e0101c00 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.874+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e01a2930 con 0x7fb8e0101c00 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.876+0000 7fb8dcff9640 1 -- 172.21.15.1:0/3250637747 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb8d00037a0 con 0x7fb8e0101c00 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.876+0000 7fb8dcff9640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8cc0a3300 0x7fb8cc0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.877+0000 7fb8deffd640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8cc0a3300 0x7fb8cc0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.877+0000 7fb8dcff9640 1 -- 172.21.15.1:0/3250637747 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb8d00d0070 con 0x7fb8e0101c00 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.877+0000 7fb8deffd640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8cc0a3300 0x7fb8cc0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8e019b680 tx=0x7fb8c800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:22.884+0000 7fb8dcff9640 1 -- 172.21.15.1:0/3250637747 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8d009cc40 con 0x7fb8e0101c00 2024-09-19T09:03:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.068+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fb8e0075b40 con 0x7fb8cc0a3300 2024-09-19T09:03:23.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.074+0000 7fb8dcff9640 1 -- 172.21.15.1:0/3250637747 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fb8e0075b40 con 0x7fb8cc0a3300 2024-09-19T09:03:23.074 INFO:teuthology.orchestra.run.smithi001.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T09:03:23.075 INFO:teuthology.orchestra.run.smithi001.stdout:mds.all 12/12 23s ago 2m smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi064=c;smithi064=f;smithi064=i;smithi064=l;count:12 2024-09-19T09:03:23.075 INFO:teuthology.orchestra.run.smithi001.stdout:mgr 3/3 23s ago 7m smithi001=x;smithi022=y;smithi064=z;count:3 2024-09-19T09:03:23.075 INFO:teuthology.orchestra.run.smithi001.stdout:mon 3/3 23s ago 7m smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi064:172.21.15.64=c;count:3 2024-09-19T09:03:23.075 INFO:teuthology.orchestra.run.smithi001.stdout:osd 12 23s ago - 2024-09-19T09:03:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8cc0a3300 msgr2=0x7fb8cc0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8cc0a3300 0x7fb8cc0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8e019b680 tx=0x7fb8c800b480 comp rx=0 tx=0).stop 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e0101c00 msgr2=0x7fb8e019a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e0101c00 0x7fb8e019a160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000e9c0 tx=0x7fb8d000ee80 comp rx=0 tx=0).stop 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 shutdown_connections 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb8cc0a3300 0x7fb8cc0a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e01037c0 0x7fb8e01a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8e0102e00 0x7fb8e019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 --2- 172.21.15.1:0/3250637747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e0101c00 0x7fb8e019a160 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 >> 172.21.15.1:0/3250637747 conn(0x7fb8e00fd390 msgr2=0x7fb8e0074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 shutdown_connections 2024-09-19T09:03:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:23.076+0000 7fb8e609e640 1 -- 172.21.15.1:0/3250637747 wait complete. 2024-09-19T09:03:23.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:23 smithi001 ceph-mon[30939]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:23.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:23 smithi064 ceph-mon[35179]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:23.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:23 smithi022 ceph-mon[35107]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:23.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T09:03:24.069 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:24.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:24 smithi001 ceph-mon[30939]: from='client.24785 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.521+0000 7f075e91f640 1 -- 172.21.15.1:0/2894359971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0758104fd0 msgr2=0x7f07581073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.521+0000 7f075e91f640 1 --2- 172.21.15.1:0/2894359971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0758104fd0 0x7f07581073c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f074c009900 tx=0x7f074c02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 -- 172.21.15.1:0/2894359971 shutdown_connections 2024-09-19T09:03:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 --2- 172.21.15.1:0/2894359971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0758107900 0x7f0758109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 --2- 172.21.15.1:0/2894359971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0758104fd0 0x7f07581073c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 --2- 172.21.15.1:0/2894359971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07581026a0 0x7f0758104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 -- 172.21.15.1:0/2894359971 >> 172.21.15.1:0/2894359971 conn(0x7f07580fc2a0 msgr2=0x7f07580fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 -- 172.21.15.1:0/2894359971 shutdown_connections 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 -- 172.21.15.1:0/2894359971 wait complete. 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 Processor -- start 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 -- start start 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.522+0000 7f075e91f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07581026a0 0x7f0758102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f075e91f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0758104fd0 0x7f0758100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f075e91f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0758107900 0x7f0758100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f075e91f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f075810d9b0 con 0x7f07581026a0 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f075e91f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f075810d830 con 0x7f0758104fd0 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f075e91f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f075810db30 con 0x7f0758107900 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07581026a0 0x7f0758102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07581026a0 0x7f0758102000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59380/0 (socket says 172.21.15.1:59380) 2024-09-19T09:03:24.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 -- 172.21.15.1:0/2510507314 learned_addr learned my addr 172.21.15.1:0/2510507314 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f075cebc640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0758107900 0x7f0758100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f07577fe640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0758104fd0 0x7f0758100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 -- 172.21.15.1:0/2510507314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0758107900 msgr2=0x7f0758100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0758107900 0x7f0758100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 -- 172.21.15.1:0/2510507314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0758104fd0 msgr2=0x7f0758100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0758104fd0 0x7f0758100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 -- 172.21.15.1:0/2510507314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0758101450 con 0x7f07581026a0 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f07577fe640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0758104fd0 0x7f0758100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f0757fff640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07581026a0 0x7f0758102000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f074800c920 tx=0x7f074800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f07557fa640 1 -- 172.21.15.1:0/2510507314 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748007c70 con 0x7f07581026a0 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07581a20e0 con 0x7f07581026a0 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f07557fa640 1 -- 172.21.15.1:0/2510507314 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0748007e10 con 0x7f07581026a0 2024-09-19T09:03:24.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f07557fa640 1 -- 172.21.15.1:0/2510507314 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748018940 con 0x7f07581026a0 2024-09-19T09:03:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.523+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07581a2640 con 0x7f07581026a0 2024-09-19T09:03:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.524+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07580fdd90 con 0x7f07581026a0 2024-09-19T09:03:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.525+0000 7f07557fa640 1 -- 172.21.15.1:0/2510507314 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0748018b20 con 0x7f07581026a0 2024-09-19T09:03:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.526+0000 7f07557fa640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f07400a32d0 0x7f07400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.526+0000 7f07577fe640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f07400a32d0 0x7f07400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.526+0000 7f07557fa640 1 -- 172.21.15.1:0/2510507314 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f07480cfc90 con 0x7f07581026a0 2024-09-19T09:03:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.527+0000 7f07577fe640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f07400a32d0 0x7f07400a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f074c000c00 tx=0x7f074c009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.530+0000 7f07557fa640 1 -- 172.21.15.1:0/2510507314 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0748014030 con 0x7f07581026a0 2024-09-19T09:03:24.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:24 smithi064 ceph-mon[35179]: from='client.24785 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:24.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:24 smithi022 ceph-mon[35107]: from='client.24785 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:24.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.712+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f0758062630 con 0x7f07400a32d0 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.713+0000 7f07557fa640 1 -- 172.21.15.1:0/2510507314 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f0758062630 con 0x7f07400a32d0 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi001.stdout:HOST ADDR LABELS STATUS 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 172.21.15.1 2024-09-19T09:03:24.713 INFO:teuthology.orchestra.run.smithi001.stdout:smithi022 172.21.15.22 2024-09-19T09:03:24.714 INFO:teuthology.orchestra.run.smithi001.stdout:smithi064 172.21.15.64 2024-09-19T09:03:24.714 INFO:teuthology.orchestra.run.smithi001.stdout:3 hosts in cluster 2024-09-19T09:03:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f07400a32d0 msgr2=0x7f07400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f07400a32d0 0x7f07400a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f074c000c00 tx=0x7f074c009560 comp rx=0 tx=0).stop 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07581026a0 msgr2=0x7f0758102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07581026a0 0x7f0758102000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f074800c920 tx=0x7f074800cde0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 shutdown_connections 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f07400a32d0 0x7f07400a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0758107900 0x7f0758100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0758104fd0 0x7f0758100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 --2- 172.21.15.1:0/2510507314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07581026a0 0x7f0758102000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 >> 172.21.15.1:0/2510507314 conn(0x7f07580fc2a0 msgr2=0x7f0758102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 shutdown_connections 2024-09-19T09:03:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:24.715+0000 7f075e91f640 1 -- 172.21.15.1:0/2510507314 wait complete. 2024-09-19T09:03:25.345 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:25 smithi001 ceph-mon[30939]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:25.346 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:25 smithi001 ceph-mon[30939]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:25.347 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T09:03:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:25.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:25 smithi064 ceph-mon[35179]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:25.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:25 smithi064 ceph-mon[35179]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:25.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:25 smithi022 ceph-mon[35107]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:25.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:25 smithi022 ceph-mon[35107]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 -- 172.21.15.1:0/145286436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c102e00 msgr2=0x7f463c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 --2- 172.21.15.1:0/145286436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c102e00 0x7f463c103280 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4624009900 tx=0x7f462402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 -- 172.21.15.1:0/145286436 shutdown_connections 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 --2- 172.21.15.1:0/145286436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f463c1037c0 0x7f463c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 --2- 172.21.15.1:0/145286436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c102e00 0x7f463c103280 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 --2- 172.21.15.1:0/145286436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f463c101c00 0x7f463c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 -- 172.21.15.1:0/145286436 >> 172.21.15.1:0/145286436 conn(0x7f463c0fd390 msgr2=0x7f463c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 -- 172.21.15.1:0/145286436 shutdown_connections 2024-09-19T09:03:26.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.087+0000 7f4640ef7640 1 -- 172.21.15.1:0/145286436 wait complete. 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4640ef7640 1 Processor -- start 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4640ef7640 1 -- start start 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4640ef7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f463c101c00 0x7f463c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4640ef7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f463c102e00 0x7f463c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4640ef7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c1037c0 0x7f463c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4640ef7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f463c10da40 con 0x7f463c1037c0 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4640ef7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f463c10d8c0 con 0x7f463c101c00 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4640ef7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f463c10dbc0 con 0x7f463c102e00 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c1037c0 0x7f463c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c1037c0 0x7f463c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59396/0 (socket says 172.21.15.1:59396) 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463ad9d640 1 -- 172.21.15.1:0/3711484940 learned_addr learned my addr 172.21.15.1:0/3711484940 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463a59c640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f463c101c00 0x7f463c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f4631d9b640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f463c102e00 0x7f463c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463ad9d640 1 -- 172.21.15.1:0/3711484940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f463c102e00 msgr2=0x7f463c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463ad9d640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f463c102e00 0x7f463c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463ad9d640 1 -- 172.21.15.1:0/3711484940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f463c101c00 msgr2=0x7f463c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463ad9d640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f463c101c00 0x7f463c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.088+0000 7f463ad9d640 1 -- 172.21.15.1:0/3711484940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463c0753e0 con 0x7f463c1037c0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.089+0000 7f463ad9d640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c1037c0 0x7f463c074b20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f463400cad0 tx=0x7f463400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.089+0000 7f4633fff640 1 -- 172.21.15.1:0/3711484940 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463400ad60 con 0x7f463c1037c0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.089+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463c1a2220 con 0x7f463c1037c0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.089+0000 7f4633fff640 1 -- 172.21.15.1:0/3711484940 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4634004b20 con 0x7f463c1037c0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.089+0000 7f4633fff640 1 -- 172.21.15.1:0/3711484940 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463400f6f0 con 0x7f463c1037c0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.089+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463c1a2760 con 0x7f463c1037c0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.090+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f463c109000 con 0x7f463c1037c0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.091+0000 7f4633fff640 1 -- 172.21.15.1:0/3711484940 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4634004cd0 con 0x7f463c1037c0 2024-09-19T09:03:26.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.092+0000 7f4633fff640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f46280a32d0 0x7f46280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:26.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.092+0000 7f463a59c640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f46280a32d0 0x7f46280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:26.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.092+0000 7f4633fff640 1 -- 172.21.15.1:0/3711484940 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f46340cfb60 con 0x7f463c1037c0 2024-09-19T09:03:26.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.092+0000 7f463a59c640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f46280a32d0 0x7f46280a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f463c102c60 tx=0x7f462c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:26.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.096+0000 7f4633fff640 1 -- 172.21.15.1:0/3711484940 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4634014030 con 0x7f463c1037c0 2024-09-19T09:03:26.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.277+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f463c062630 con 0x7f46280a32d0 2024-09-19T09:03:26.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.279+0000 7f4633fff640 1 -- 172.21.15.1:0/3711484940 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f463c062630 con 0x7f46280a32d0 2024-09-19T09:03:26.279 INFO:teuthology.orchestra.run.smithi001.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T09:03:26.280 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513000D480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T09:03:26.280 INFO:teuthology.orchestra.run.smithi001.stdout:smithi022 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402EC480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:03:26.280 INFO:teuthology.orchestra.run.smithi001.stdout:smithi064 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT534400C2400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:03:26.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f46280a32d0 msgr2=0x7f46280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f46280a32d0 0x7f46280a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f463c102c60 tx=0x7f462c009110 comp rx=0 tx=0).stop 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c1037c0 msgr2=0x7f463c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c1037c0 0x7f463c074b20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f463400cad0 tx=0x7f463400ced0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 shutdown_connections 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c1037c0 0x7f463c074b20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f46280a32d0 0x7f46280a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f463c102e00 0x7f463c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 --2- 172.21.15.1:0/3711484940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f463c101c00 0x7f463c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.281+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 >> 172.21.15.1:0/3711484940 conn(0x7f463c0fd390 msgr2=0x7f463c1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.282+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 shutdown_connections 2024-09-19T09:03:26.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:26.282+0000 7f4640ef7640 1 -- 172.21.15.1:0/3711484940 wait complete. 2024-09-19T09:03:26.929 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:03:26.945 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:03:26.945 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:03:27.201 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:27.603 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:27 smithi001 ceph-mon[30939]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:27.603 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:27 smithi001 ceph-mon[30939]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:27.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:27 smithi064 ceph-mon[35179]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:27.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:27 smithi064 ceph-mon[35179]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:27.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:27 smithi022 ceph-mon[35107]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:27.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:27 smithi022 ceph-mon[35107]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.685+0000 7f578edfb640 1 -- 172.21.15.1:0/3090134764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 msgr2=0x7f5788102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.685+0000 7f578edfb640 1 --2- 172.21.15.1:0/3090134764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 0x7f5788102150 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f577c009900 tx=0x7f577c02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.685+0000 7f578edfb640 1 -- 172.21.15.1:0/3090134764 shutdown_connections 2024-09-19T09:03:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.685+0000 7f578edfb640 1 --2- 172.21.15.1:0/3090134764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5788102690 0x7f5788108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.685+0000 7f578edfb640 1 --2- 172.21.15.1:0/3090134764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 0x7f5788102150 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.685+0000 7f578edfb640 1 --2- 172.21.15.1:0/3090134764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5788100ad0 0x7f5788100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.685+0000 7f578edfb640 1 -- 172.21.15.1:0/3090134764 >> 172.21.15.1:0/3090134764 conn(0x7f57880fc280 msgr2=0x7f57880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 -- 172.21.15.1:0/3090134764 shutdown_connections 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 -- 172.21.15.1:0/3090134764 wait complete. 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 Processor -- start 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 -- start start 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5788100ad0 0x7f578806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 0x7f578819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5788102690 0x7f578819f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f578810c8e0 con 0x7f5788101cd0 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f578810c760 con 0x7f5788100ad0 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f578edfb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f578810ca60 con 0x7f5788102690 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f5787fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 0x7f578819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f5787fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 0x7f578819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59416/0 (socket says 172.21.15.1:59416) 2024-09-19T09:03:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.686+0000 7f5787fff640 1 -- 172.21.15.1:0/858603595 learned_addr learned my addr 172.21.15.1:0/858603595 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f578cb97640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5788100ad0 0x7f578806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f578d398640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5788102690 0x7f578819f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5787fff640 1 -- 172.21.15.1:0/858603595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5788102690 msgr2=0x7f578819f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5787fff640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5788102690 0x7f578819f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5787fff640 1 -- 172.21.15.1:0/858603595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5788100ad0 msgr2=0x7f578806aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5787fff640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5788100ad0 0x7f578806aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5787fff640 1 -- 172.21.15.1:0/858603595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578819fbd0 con 0x7f5788101cd0 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f578cb97640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5788100ad0 0x7f578806aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f578d398640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5788102690 0x7f578819f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5787fff640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 0x7f578819cca0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f577c0316a0 tx=0x7f577c032d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5785ffb640 1 -- 172.21.15.1:0/858603595 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c03f030 con 0x7f5788101cd0 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5785ffb640 1 -- 172.21.15.1:0/858603595 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f577c003d00 con 0x7f5788101cd0 2024-09-19T09:03:27.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578819fe00 con 0x7f5788101cd0 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f5785ffb640 1 -- 172.21.15.1:0/858603595 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c035070 con 0x7f5788101cd0 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.687+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57881a0260 con 0x7f5788101cd0 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.688+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5788107da0 con 0x7f5788101cd0 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.689+0000 7f5785ffb640 1 -- 172.21.15.1:0/858603595 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f577c042030 con 0x7f5788101cd0 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.690+0000 7f5785ffb640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57700a3350 0x7f57700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.690+0000 7f578cb97640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57700a3350 0x7f57700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.690+0000 7f5785ffb640 1 -- 172.21.15.1:0/858603595 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f577c0f0200 con 0x7f5788101cd0 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.691+0000 7f578cb97640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57700a3350 0x7f57700a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5788101b30 tx=0x7f577800a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.694+0000 7f5785ffb640 1 -- 172.21.15.1:0/858603595 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f577c0bcd40 con 0x7f5788101cd0 2024-09-19T09:03:27.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.907+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f578802d960 con 0x7f5788101cd0 2024-09-19T09:03:27.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.908+0000 7f5785ffb640 1 -- 172.21.15.1:0/858603595 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3064 (secure 0 0 0) 0x7f577c0b8030 con 0x7f5788101cd0 2024-09-19T09:03:27.908 INFO:teuthology.orchestra.run.smithi001.stdout:e23 2024-09-19T09:03:27.908 INFO:teuthology.orchestra.run.smithi001.stdout:btime 2024-09-19T09:02:13:694219+0000 2024-09-19T09:03:27.908 INFO:teuthology.orchestra.run.smithi001.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:03:27.908 INFO:teuthology.orchestra.run.smithi001.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:03:27.908 INFO:teuthology.orchestra.run.smithi001.stdout:legacy client fscid: 1 2024-09-19T09:03:27.908 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:fs_name cephfs 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 23 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-19T09:02:02.334504+0000 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-19T09:02:13.157593+0000 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:tableserver 0 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:root 0 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:session_timeout 300 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:session_autoclose 300 2024-09-19T09:03:27.909 INFO:teuthology.orchestra.run.smithi001.stdout:max_file_size 1099511627776 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:max_xattr_size 65536 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:required_client_features {} 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure 0 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure_osd_epoch 0 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:max_mds 3 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:in 0,1,2 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:up {0=24500,1=24493,2=24482} 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:failed 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:damaged 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:stopped 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:data_pools [3] 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:metadata_pool 2 2024-09-19T09:03:27.910 INFO:teuthology.orchestra.run.smithi001.stdout:inline_data disabled 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:balancer 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:bal_rank_mask -1 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:standby_count_wanted 0 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:qdb_cluster leader: 24500 members: 24482,24493,24500 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b{0:24500} state up:active seq 4 addr [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c{0:24475} state up:standby-replay seq 1 addr [v2:172.21.15.64:6836/1600726820,v1:172.21.15.64:6837/1600726820] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.i{1:24493} state up:active seq 8 addr [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f{1:24466} state up:standby-replay seq 1 addr [v2:172.21.15.64:6834/1194065600,v1:172.21.15.64:6835/1194065600] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.h{2:24482} state up:active seq 9 addr [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e{2:24455} state up:standby-replay seq 1 addr [v2:172.21.15.22:6834/728335709,v1:172.21.15.22:6835/728335709] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout:Standby daemons: 2024-09-19T09:03:27.911 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:27.912 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.j{-1:14544} state up:standby seq 1 addr [v2:172.21.15.1:6834/250950179,v1:172.21.15.1:6835/250950179] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.912 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d{-1:14556} state up:standby seq 1 addr [v2:172.21.15.1:6836/2260283181,v1:172.21.15.1:6837/2260283181] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.912 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.g{-1:14610} state up:standby seq 1 addr [v2:172.21.15.1:6838/1644028612,v1:172.21.15.1:6839/1644028612] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.912 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a{-1:14622} state up:standby seq 1 addr [v2:172.21.15.1:6840/2023571074,v1:172.21.15.1:6841/2023571074] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.912 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.k{-1:24431} state up:standby seq 1 addr [v2:172.21.15.22:6832/670081711,v1:172.21.15.22:6833/670081711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.912 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.l{-1:24439} state up:standby seq 1 addr [v2:172.21.15.64:6832/1311787098,v1:172.21.15.64:6833/1311787098] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:03:27.912 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57700a3350 msgr2=0x7f57700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57700a3350 0x7f57700a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5788101b30 tx=0x7f577800a5e0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 msgr2=0x7f578819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 0x7f578819cca0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f577c0316a0 tx=0x7f577c032d90 comp rx=0 tx=0).stop 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 shutdown_connections 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57700a3350 0x7f57700a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5788102690 0x7f578819f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788101cd0 0x7f578819cca0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 --2- 172.21.15.1:0/858603595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5788100ad0 0x7f578806aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 >> 172.21.15.1:0/858603595 conn(0x7f57880fc280 msgr2=0x7f5788104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 shutdown_connections 2024-09-19T09:03:27.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:27.910+0000 7f578edfb640 1 -- 172.21.15.1:0/858603595 wait complete. 2024-09-19T09:03:28.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:28 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/858603595' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:03:28.514 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T09:03:28.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:28 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/858603595' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:03:28.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:28 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/858603595' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:03:28.772 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.195+0000 7fb6a9a36640 1 -- 172.21.15.1:0/3993453701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a4100b10 msgr2=0x7fb6a4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.195+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/3993453701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a4100b10 0x7fb6a4100f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb694009900 tx=0x7fb69402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.195+0000 7fb6a9a36640 1 -- 172.21.15.1:0/3993453701 shutdown_connections 2024-09-19T09:03:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.195+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/3993453701 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a41026d0 0x7fb6a4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.195+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/3993453701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6a4101d10 0x7fb6a4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.195+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/3993453701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a4100b10 0x7fb6a4100f10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.195+0000 7fb6a9a36640 1 -- 172.21.15.1:0/3993453701 >> 172.21.15.1:0/3993453701 conn(0x7fb6a40fc2a0 msgr2=0x7fb6a40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:29.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.195+0000 7fb6a9a36640 1 -- 172.21.15.1:0/3993453701 shutdown_connections 2024-09-19T09:03:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.196+0000 7fb6a9a36640 1 -- 172.21.15.1:0/3993453701 wait complete. 2024-09-19T09:03:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.196+0000 7fb6a9a36640 1 Processor -- start 2024-09-19T09:03:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.196+0000 7fb6a9a36640 1 -- start start 2024-09-19T09:03:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a9a36640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a4100b10 0x7fb6a4197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a9a36640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6a4101d10 0x7fb6a41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a9a36640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a41026d0 0x7fb6a419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a9a36640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a410c8c0 con 0x7fb6a41026d0 2024-09-19T09:03:29.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a9a36640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a410c740 con 0x7fb6a4101d10 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a9a36640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a410ca40 con 0x7fb6a4100b10 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a41026d0 0x7fb6a419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a41026d0 0x7fb6a419f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59434/0 (socket says 172.21.15.1:59434) 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 -- 172.21.15.1:0/843169946 learned_addr learned my addr 172.21.15.1:0/843169946 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a27fc640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6a4101d10 0x7fb6a41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a2ffd640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a4100b10 0x7fb6a4197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 -- 172.21.15.1:0/843169946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a4100b10 msgr2=0x7fb6a4197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a4100b10 0x7fb6a4197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 -- 172.21.15.1:0/843169946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6a4101d10 msgr2=0x7fb6a41984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6a4101d10 0x7fb6a41984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 -- 172.21.15.1:0/843169946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a419fbb0 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a37fe640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a41026d0 0x7fb6a419f540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00cce0 tx=0x7fb69c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a8a34640 1 -- 172.21.15.1:0/843169946 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00f450 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a8a34640 1 -- 172.21.15.1:0/843169946 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb69c00faf0 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a419fea0 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.197+0000 7fb6a8a34640 1 -- 172.21.15.1:0/843169946 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c018c50 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.198+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a41a0300 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.198+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a41a05c0 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.200+0000 7fb6a8a34640 1 -- 172.21.15.1:0/843169946 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb69c00fca0 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.201+0000 7fb6a8a34640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6900a3300 0x7fb6900a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.201+0000 7fb6a2ffd640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6900a3300 0x7fb6900a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.201+0000 7fb6a8a34640 1 -- 172.21.15.1:0/843169946 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb69c0d0150 con 0x7fb6a41026d0 2024-09-19T09:03:29.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.202+0000 7fb6a2ffd640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6900a3300 0x7fb6900a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb694000c00 tx=0x7fb694031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:29.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.204+0000 7fb6a8a34640 1 -- 172.21.15.1:0/843169946 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb69c014030 con 0x7fb6a41026d0 2024-09-19T09:03:29.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.383+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb6a41a0790 con 0x7fb6a41026d0 2024-09-19T09:03:29.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.384+0000 7fb6a8a34640 1 -- 172.21.15.1:0/843169946 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v80) ==== 56+0+5279 (secure 0 0 0) 0x7fb69c09cd80 con 0x7fb6a41026d0 2024-09-19T09:03:29.384 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 80 2024-09-19T09:03:29.384 INFO:teuthology.orchestra.run.smithi001.stdout:fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T09:03:29.384 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-19T08:54:23.245178+0000 2024-09-19T09:03:29.384 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-19T09:02:11.680221+0000 2024-09-19T09:03:29.384 INFO:teuthology.orchestra.run.smithi001.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T09:03:29.384 INFO:teuthology.orchestra.run.smithi001.stdout:crush_version 26 2024-09-19T09:03:29.384 INFO:teuthology.orchestra.run.smithi001.stdout:full_ratio 0.95 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:backfillfull_ratio 0.9 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:nearfull_ratio 0.85 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:require_min_compat_client luminous 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:min_compat_client luminous 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:require_osd_release squid 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:stretch_mode_enabled false 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T09:03:29.385 INFO:teuthology.orchestra.run.smithi001.stdout:max_osd 12 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 up in weight 1 up_from 8 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6802/285096053,v1:172.21.15.1:6803/285096053] [v2:172.21.15.1:6804/285096053,v1:172.21.15.1:6805/285096053] exists,up a5c346b8-5301-4325-8c5d-24bfdb5ac836 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 up in weight 1 up_from 12 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6800/704223442,v1:172.21.15.22:6801/704223442] [v2:172.21.15.22:6802/704223442,v1:172.21.15.22:6803/704223442] exists,up 577de251-29ca-43bb-bfa9-62d8edcf7606 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 up in weight 1 up_from 17 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.64:6800/3828827490,v1:172.21.15.64:6801/3828827490] [v2:172.21.15.64:6802/3828827490,v1:172.21.15.64:6803/3828827490] exists,up 08408ff4-bdd7-41e5-9ebd-6bbfdc17c155 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 up in weight 1 up_from 23 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6810/4215889166,v1:172.21.15.1:6811/4215889166] [v2:172.21.15.1:6812/4215889166,v1:172.21.15.1:6813/4215889166] exists,up 9d782b6f-5fcf-4198-b8a9-cf4dc57f038a 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 up in weight 1 up_from 30 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6808/2803831833,v1:172.21.15.22:6809/2803831833] [v2:172.21.15.22:6810/2803831833,v1:172.21.15.22:6811/2803831833] exists,up aa65b2e2-2de3-4303-8efd-76384894b8cf 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 up in weight 1 up_from 35 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.64:6808/2206197763,v1:172.21.15.64:6809/2206197763] [v2:172.21.15.64:6810/2206197763,v1:172.21.15.64:6811/2206197763] exists,up d85e3728-551a-417f-9a1f-37a6c7e144e7 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 up in weight 1 up_from 42 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6818/146026551,v1:172.21.15.1:6819/146026551] [v2:172.21.15.1:6820/146026551,v1:172.21.15.1:6821/146026551] exists,up dd093d03-4420-450f-bae0-f4c8690138f6 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 up in weight 1 up_from 46 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6816/1285451266,v1:172.21.15.22:6817/1285451266] [v2:172.21.15.22:6818/1285451266,v1:172.21.15.22:6819/1285451266] exists,up 6c26c0c5-ee92-4ec9-8adc-6dde6335b42b 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 up in weight 1 up_from 53 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.64:6816/2825124096,v1:172.21.15.64:6817/2825124096] [v2:172.21.15.64:6818/2825124096,v1:172.21.15.64:6819/2825124096] exists,up 6eab8176-97e8-4a26-9293-64dacf2752e5 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 up in weight 1 up_from 61 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6826/1622106901,v1:172.21.15.1:6827/1622106901] [v2:172.21.15.1:6828/1622106901,v1:172.21.15.1:6829/1622106901] exists,up 6c8cb115-549f-42fd-8bff-98586d00e5d2 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 up in weight 1 up_from 65 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6824/3539045596,v1:172.21.15.22:6825/3539045596] [v2:172.21.15.22:6826/3539045596,v1:172.21.15.22:6827/3539045596] exists,up b6a50ba5-0cc9-4be8-bb6c-26b5043c6303 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 up in weight 1 up_from 72 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.64:6824/1960106906,v1:172.21.15.64:6825/1960106906] [v2:172.21.15.64:6826/1960106906,v1:172.21.15.64:6827/1960106906] exists,up ea01a956-f246-4e9e-b294-9f24ae3b250d 2024-09-19T09:03:29.386 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.13 [2,11] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.1d [8,11] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.3 [4,9] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.6 [4,7] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.11 [4,8] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1a [5,6] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1b [4,8] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1e [3,9] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.27 [3,9] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.39 [5,6] 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2387018469 expires 2024-09-20T08:55:09.857036+0000 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/2001580204 expires 2024-09-20T08:55:09.857036+0000 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/2001580204 expires 2024-09-20T08:55:09.857036+0000 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/859712265 expires 2024-09-20T08:55:09.857036+0000 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/4135803667 expires 2024-09-20T08:55:09.857036+0000 2024-09-19T09:03:29.387 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3240635112 expires 2024-09-20T08:54:45.648707+0000 2024-09-19T09:03:29.388 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/3303995107 expires 2024-09-20T08:54:45.648707+0000 2024-09-19T09:03:29.388 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/3303995107 expires 2024-09-20T08:54:45.648707+0000 2024-09-19T09:03:29.388 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3792489660 expires 2024-09-20T08:54:45.648707+0000 2024-09-19T09:03:29.388 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/1402054231 expires 2024-09-20T08:54:45.648707+0000 2024-09-19T09:03:29.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6900a3300 msgr2=0x7fb6900a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6900a3300 0x7fb6900a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb694000c00 tx=0x7fb694031490 comp rx=0 tx=0).stop 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a41026d0 msgr2=0x7fb6a419f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a41026d0 0x7fb6a419f540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00cce0 tx=0x7fb69c00a620 comp rx=0 tx=0).stop 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 shutdown_connections 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6a41026d0 0x7fb6a419f540 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6a4101d10 0x7fb6a41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6900a3300 0x7fb6900a57c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 --2- 172.21.15.1:0/843169946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6a4100b10 0x7fb6a4197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 >> 172.21.15.1:0/843169946 conn(0x7fb6a40fc2a0 msgr2=0x7fb6a40fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 shutdown_connections 2024-09-19T09:03:29.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:29.386+0000 7fb6a9a36640 1 -- 172.21.15.1:0/843169946 wait complete. 2024-09-19T09:03:29.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:29 smithi001 ceph-mon[30939]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:29.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:29 smithi064 ceph-mon[35179]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:29.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:29 smithi022 ceph-mon[35107]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:30.057 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T09:03:30.070 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:30.331 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:30.579 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:30 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/843169946' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:03:30.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:30 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/843169946' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:03:30.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:30 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/843169946' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:03:30.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.768+0000 7fa33a5f0640 1 -- 172.21.15.1:0/2615761351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa334101de0 msgr2=0x7fa3341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.768+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/2615761351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa334101de0 0x7fa3341021c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa324009900 tx=0x7fa32402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:30.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.768+0000 7fa33a5f0640 1 -- 172.21.15.1:0/2615761351 shutdown_connections 2024-09-19T09:03:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.768+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/2615761351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa334106f10 0x7fa33410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.768+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/2615761351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa334102790 0x7fa3341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.768+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/2615761351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa334101de0 0x7fa3341021c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.768+0000 7fa33a5f0640 1 -- 172.21.15.1:0/2615761351 >> 172.21.15.1:0/2615761351 conn(0x7fa3340fd8c0 msgr2=0x7fa3340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.769+0000 7fa33a5f0640 1 -- 172.21.15.1:0/2615761351 shutdown_connections 2024-09-19T09:03:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.769+0000 7fa33a5f0640 1 -- 172.21.15.1:0/2615761351 wait complete. 2024-09-19T09:03:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.769+0000 7fa33a5f0640 1 Processor -- start 2024-09-19T09:03:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.769+0000 7fa33a5f0640 1 -- start start 2024-09-19T09:03:30.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.769+0000 7fa33a5f0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa334101de0 0x7fa334198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.769+0000 7fa33a5f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa334102790 0x7fa3341989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa33a5f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa334106f10 0x7fa33419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa33a5f0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa334112090 con 0x7fa334106f10 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa33a5f0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa334111f10 con 0x7fa334102790 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa33a5f0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa334112210 con 0x7fa334101de0 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa334101de0 0x7fa334198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa334101de0 0x7fa334198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:39076/0 (socket says 172.21.15.1:39076) 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 -- 172.21.15.1:0/1052532863 learned_addr learned my addr 172.21.15.1:0/1052532863 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa3337fe640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa334102790 0x7fa3341989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa338b8d640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa334106f10 0x7fa33419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 -- 172.21.15.1:0/1052532863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa334102790 msgr2=0x7fa3341989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa334102790 0x7fa3341989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 -- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa334106f10 msgr2=0x7fa33419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa334106f10 0x7fa33419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 -- 172.21.15.1:0/1052532863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33419d440 con 0x7fa334101de0 2024-09-19T09:03:30.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa3337fe640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa334102790 0x7fa3341989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:30.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.770+0000 7fa333fff640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa334101de0 0x7fa334198490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa324006010 tx=0x7fa3240042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:30.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.771+0000 7fa3317fa640 1 -- 172.21.15.1:0/1052532863 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32403f030 con 0x7fa334101de0 2024-09-19T09:03:30.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.771+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33419d6d0 con 0x7fa334101de0 2024-09-19T09:03:30.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.771+0000 7fa3317fa640 1 -- 172.21.15.1:0/1052532863 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa324003d00 con 0x7fa334101de0 2024-09-19T09:03:30.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.771+0000 7fa3317fa640 1 -- 172.21.15.1:0/1052532863 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa324035070 con 0x7fa334101de0 2024-09-19T09:03:30.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.771+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3341a5010 con 0x7fa334101de0 2024-09-19T09:03:30.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.772+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3341021c0 con 0x7fa334101de0 2024-09-19T09:03:30.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.773+0000 7fa3317fa640 1 -- 172.21.15.1:0/1052532863 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa324042030 con 0x7fa334101de0 2024-09-19T09:03:30.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.773+0000 7fa3317fa640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa31c0a3350 0x7fa31c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.774+0000 7fa3337fe640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa31c0a3350 0x7fa31c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.774+0000 7fa3317fa640 1 -- 172.21.15.1:0/1052532863 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa3240f00b0 con 0x7fa334101de0 2024-09-19T09:03:30.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.774+0000 7fa3337fe640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa31c0a3350 0x7fa31c0a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3341088e0 tx=0x7fa328005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:30.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.777+0000 7fa3317fa640 1 -- 172.21.15.1:0/1052532863 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3240bc5a0 con 0x7fa334101de0 2024-09-19T09:03:30.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.990+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa33410a0f0 con 0x7fa334101de0 2024-09-19T09:03:30.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.991+0000 7fa3317fa640 1 -- 172.21.15.1:0/1052532863 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11878 (secure 0 0 0) 0x7fa3240c08a0 con 0x7fa334101de0 2024-09-19T09:03:30.991 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:30.991 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"btime":"2024-09-19T09:02:13:694219+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:02:13.157593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:03:30.992 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2024-09-19T09:03:30.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa31c0a3350 msgr2=0x7fa31c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa31c0a3350 0x7fa31c0a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3341088e0 tx=0x7fa328005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:30.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa334101de0 msgr2=0x7fa334198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa334101de0 0x7fa334198490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa324006010 tx=0x7fa3240042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 shutdown_connections 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa334106f10 0x7fa33419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa334102790 0x7fa3341989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa31c0a3350 0x7fa31c0a5810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 --2- 172.21.15.1:0/1052532863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa334101de0 0x7fa334198490 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 >> 172.21.15.1:0/1052532863 conn(0x7fa3340fd8c0 msgr2=0x7fa3340fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 shutdown_connections 2024-09-19T09:03:30.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:30.993+0000 7fa33a5f0640 1 -- 172.21.15.1:0/1052532863 wait complete. 2024-09-19T09:03:31.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:31 smithi001 ceph-mon[30939]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:31.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:31 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1052532863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:31.595 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:31.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:31 smithi064 ceph-mon[35179]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:31.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:31 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1052532863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:31.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:31 smithi022 ceph-mon[35107]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:31.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:31 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1052532863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:31.850 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:32.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 -- 172.21.15.1:0/1199280973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960102d40 msgr2=0x7fb960103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 --2- 172.21.15.1:0/1199280973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960102d40 0x7fb960103120 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb950009900 tx=0x7fb95002a480 comp rx=0 tx=0).stop 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 -- 172.21.15.1:0/1199280973 shutdown_connections 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 --2- 172.21.15.1:0/1199280973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb96010c170 0x7fb96010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 --2- 172.21.15.1:0/1199280973 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb960103660 0x7fb96010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 --2- 172.21.15.1:0/1199280973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960102d40 0x7fb960103120 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 -- 172.21.15.1:0/1199280973 >> 172.21.15.1:0/1199280973 conn(0x7fb9600fc7a0 msgr2=0x7fb9600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 -- 172.21.15.1:0/1199280973 shutdown_connections 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.283+0000 7fb9650d1640 1 -- 172.21.15.1:0/1199280973 wait complete. 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.284+0000 7fb9650d1640 1 Processor -- start 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.284+0000 7fb9650d1640 1 -- start start 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.284+0000 7fb9650d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb960102d40 0x7fb9601985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.284+0000 7fb9650d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960103660 0x7fb960198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.284+0000 7fb9650d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb96010c170 0x7fb96019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.284+0000 7fb9650d1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb960112090 con 0x7fb960103660 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.284+0000 7fb9650d1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb960111f10 con 0x7fb96010c170 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.284+0000 7fb9650d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb960112210 con 0x7fb960102d40 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960103660 0x7fb960198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960103660 0x7fb960198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59482/0 (socket says 172.21.15.1:59482) 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 -- 172.21.15.1:0/3590502717 learned_addr learned my addr 172.21.15.1:0/3590502717 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95f59e640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb96010c170 0x7fb96019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95ed9d640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb960102d40 0x7fb9601985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 -- 172.21.15.1:0/3590502717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb960102d40 msgr2=0x7fb9601985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb960102d40 0x7fb9601985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 -- 172.21.15.1:0/3590502717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb96010c170 msgr2=0x7fb96019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb96010c170 0x7fb96019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 -- 172.21.15.1:0/3590502717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96019d560 con 0x7fb960103660 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95ed9d640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb960102d40 0x7fb9601985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb95e59c640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960103660 0x7fb960198af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb95400d750 tx=0x7fb95400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb947fff640 1 -- 172.21.15.1:0/3590502717 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954017070 con 0x7fb960103660 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96019d850 con 0x7fb960103660 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb947fff640 1 -- 172.21.15.1:0/3590502717 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb954005020 con 0x7fb960103660 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb947fff640 1 -- 172.21.15.1:0/3590502717 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954004dd0 con 0x7fb960103660 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.285+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9601a5130 con 0x7fb960103660 2024-09-19T09:03:32.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.286+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb960103120 con 0x7fb960103660 2024-09-19T09:03:32.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.288+0000 7fb947fff640 1 -- 172.21.15.1:0/3590502717 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb9540051d0 con 0x7fb960103660 2024-09-19T09:03:32.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.288+0000 7fb947fff640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9480a32d0 0x7fb9480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.288+0000 7fb95ed9d640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9480a32d0 0x7fb9480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.288+0000 7fb947fff640 1 -- 172.21.15.1:0/3590502717 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb9540cf490 con 0x7fb960103660 2024-09-19T09:03:32.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.289+0000 7fb95ed9d640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9480a32d0 0x7fb9480a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb950005ab0 tx=0x7fb950005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:32.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.293+0000 7fb947fff640 1 -- 172.21.15.1:0/3590502717 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb95409c030 con 0x7fb960103660 2024-09-19T09:03:32.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.504+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb960107240 con 0x7fb960103660 2024-09-19T09:03:32.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.505+0000 7fb947fff640 1 -- 172.21.15.1:0/3590502717 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11878 (secure 0 0 0) 0x7fb95409b930 con 0x7fb960103660 2024-09-19T09:03:32.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:32.506 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"btime":"2024-09-19T09:02:13:694219+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:02:13.157593+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:03:32.506 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 23 2024-09-19T09:03:32.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9480a32d0 msgr2=0x7fb9480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9480a32d0 0x7fb9480a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb950005ab0 tx=0x7fb950005a20 comp rx=0 tx=0).stop 2024-09-19T09:03:32.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960103660 msgr2=0x7fb960198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960103660 0x7fb960198af0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb95400d750 tx=0x7fb95400dc10 comp rx=0 tx=0).stop 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 shutdown_connections 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb96010c170 0x7fb96019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb960103660 0x7fb960198af0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9480a32d0 0x7fb9480a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 --2- 172.21.15.1:0/3590502717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb960102d40 0x7fb9601985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 >> 172.21.15.1:0/3590502717 conn(0x7fb9600fc7a0 msgr2=0x7fb9600fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 shutdown_connections 2024-09-19T09:03:32.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:32.507+0000 7fb9650d1640 1 -- 172.21.15.1:0/3590502717 wait complete. 2024-09-19T09:03:33.236 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:03:33.503 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:33.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:33 smithi001 ceph-mon[30939]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:33.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:33 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3590502717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:33.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:33 smithi064 ceph-mon[35179]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:33.606 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:33 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3590502717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:33.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:33 smithi022 ceph-mon[35107]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T09:03:33.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:33 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3590502717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 -- 172.21.15.1:0/3215042675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0106f10 msgr2=0x7f8ff010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 --2- 172.21.15.1:0/3215042675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0106f10 0x7f8ff010ea90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009ca0 tx=0x7f8fe802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 -- 172.21.15.1:0/3215042675 shutdown_connections 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 --2- 172.21.15.1:0/3215042675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0106f10 0x7f8ff010ea90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 --2- 172.21.15.1:0/3215042675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff0102790 0x7f8ff01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 --2- 172.21.15.1:0/3215042675 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff0101de0 0x7f8ff01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 -- 172.21.15.1:0/3215042675 >> 172.21.15.1:0/3215042675 conn(0x7f8ff00fd8c0 msgr2=0x7f8ff00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 -- 172.21.15.1:0/3215042675 shutdown_connections 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.950+0000 7f8ff6550640 1 -- 172.21.15.1:0/3215042675 wait complete. 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8ff6550640 1 Processor -- start 2024-09-19T09:03:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8ff6550640 1 -- start start 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8ff6550640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0101de0 0x7f8ff00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8ff6550640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff0102790 0x7f8ff0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8ff6550640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff0106f10 0x7f8ff0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8ff6550640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0112090 con 0x7f8ff0101de0 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8ff6550640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0111f10 con 0x7f8ff0106f10 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8ff6550640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0112210 con 0x7f8ff0102790 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8feffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0101de0 0x7f8ff00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8feffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0101de0 0x7f8ff00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49160/0 (socket says 172.21.15.1:49160) 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.951+0000 7f8feffff640 1 -- 172.21.15.1:0/53513681 learned_addr learned my addr 172.21.15.1:0/53513681 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8ff4aed640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff0106f10 0x7f8ff0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8feffff640 1 -- 172.21.15.1:0/53513681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff0102790 msgr2=0x7f8ff0074a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:03:33.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8feffff640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff0102790 0x7f8ff0074a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8feffff640 1 -- 172.21.15.1:0/53513681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff0106f10 msgr2=0x7f8ff0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8feffff640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff0106f10 0x7f8ff0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8feffff640 1 -- 172.21.15.1:0/53513681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff01a6910 con 0x7f8ff0101de0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8feffff640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0101de0 0x7f8ff00744f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000c890 tx=0x7f8fe000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8fed7fa640 1 -- 172.21.15.1:0/53513681 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0004220 con 0x7f8ff0101de0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8fed7fa640 1 -- 172.21.15.1:0/53513681 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fe00043c0 con 0x7f8ff0101de0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff01a6c00 con 0x7f8ff0101de0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8fed7fa640 1 -- 172.21.15.1:0/53513681 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0004b10 con 0x7f8ff0101de0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.952+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff01a7140 con 0x7f8ff0101de0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.953+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff01021c0 con 0x7f8ff0101de0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.955+0000 7f8fed7fa640 1 -- 172.21.15.1:0/53513681 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8fe00051b0 con 0x7f8ff0101de0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.956+0000 7f8fed7fa640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fd80a32d0 0x7f8fd80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.956+0000 7f8fef7fe640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fd80a32d0 0x7f8fd80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.956+0000 7f8fed7fa640 1 -- 172.21.15.1:0/53513681 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8fe00cfaf0 con 0x7f8ff0101de0 2024-09-19T09:03:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.957+0000 7f8fef7fe640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fd80a32d0 0x7f8fd80a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0075f80 tx=0x7f8fe400b2f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:33.960+0000 7f8fed7fa640 1 -- 172.21.15.1:0/53513681 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8fe0014030 con 0x7f8ff0101de0 2024-09-19T09:03:34.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.136+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ff0109b60 con 0x7f8ff0101de0 2024-09-19T09:03:34.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.137+0000 7f8fed7fa640 1 -- 172.21.15.1:0/53513681 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7f8fe009c690 con 0x7f8ff0101de0 2024-09-19T09:03:34.137 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:34.138 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:03:34.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.139+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fd80a32d0 msgr2=0x7f8fd80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.139+0000 7f8ff6550640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fd80a32d0 0x7f8fd80a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0075f80 tx=0x7f8fe400b2f0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.139+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0101de0 msgr2=0x7f8ff00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.139+0000 7f8ff6550640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0101de0 0x7f8ff00744f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000c890 tx=0x7f8fe000cd50 comp rx=0 tx=0).stop 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.139+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 shutdown_connections 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.140+0000 7f8ff6550640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ff0106f10 0x7f8ff0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.140+0000 7f8ff6550640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8fd80a32d0 0x7f8fd80a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.140+0000 7f8ff6550640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8ff0102790 0x7f8ff0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.140+0000 7f8ff6550640 1 --2- 172.21.15.1:0/53513681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ff0101de0 0x7f8ff00744f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.140+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 >> 172.21.15.1:0/53513681 conn(0x7f8ff00fd8c0 msgr2=0x7f8ff00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.140+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 shutdown_connections 2024-09-19T09:03:34.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:34.140+0000 7f8ff6550640 1 -- 172.21.15.1:0/53513681 wait complete. 2024-09-19T09:03:34.605 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:34 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/53513681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:34.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:34 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/53513681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:34.723 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:34 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/53513681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:34.760 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:02:02.334504+0000', 'modified': '2024-09-19T09:02:13.157593+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24500, 'mds_1': 24493, 'mds_2': 24482}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6835/728335709', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6834', 'nonce': 728335709}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 728335709}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6835/1194065600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 1194065600}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 1194065600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6837/1600726820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6836', 'nonce': 1600726820}, {'type': 'v1', 'addr': '172.21.15.64:6837', 'nonce': 1600726820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.22:6837/866445696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6836', 'nonce': 866445696}, {'type': 'v1', 'addr': '172.21.15.22:6837', 'nonce': 866445696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.64:6839/2311666322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6838', 'nonce': 2311666322}, {'type': 'v1', 'addr': '172.21.15.64:6839', 'nonce': 2311666322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6839/1767594317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 1767594317}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 1767594317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24500, 'qdb_cluster': [24482, 24493, 24500]} 2024-09-19T09:03:34.760 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T09:03:34.760 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:03:35.025 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:35.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:35 smithi001 ceph-mon[30939]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:35.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.526+0000 7f6eef910640 1 -- 172.21.15.1:0/2729037080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8100a80 msgr2=0x7f6ee8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.526+0000 7f6eef910640 1 --2- 172.21.15.1:0/2729037080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8100a80 0x7f6ee8100ee0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009930 tx=0x7f6ed802a420 comp rx=0 tx=0).stop 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.526+0000 7f6eef910640 1 -- 172.21.15.1:0/2729037080 shutdown_connections 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.526+0000 7f6eef910640 1 --2- 172.21.15.1:0/2729037080 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ee8101420 0x7f6ee810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.526+0000 7f6eef910640 1 --2- 172.21.15.1:0/2729037080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8100a80 0x7f6ee8100ee0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.526+0000 7f6eef910640 1 --2- 172.21.15.1:0/2729037080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee8106a80 0x7f6ee8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.526+0000 7f6eef910640 1 -- 172.21.15.1:0/2729037080 >> 172.21.15.1:0/2729037080 conn(0x7f6ee80fc7a0 msgr2=0x7f6ee80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 -- 172.21.15.1:0/2729037080 shutdown_connections 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 -- 172.21.15.1:0/2729037080 wait complete. 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 Processor -- start 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 -- start start 2024-09-19T09:03:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ee8100a80 0x7f6ee81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee8101420 0x7f6ee81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8110f60 con 0x7f6ee8106a80 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee8110de0 con 0x7f6ee8101420 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.527+0000 7f6eef910640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81110e0 con 0x7f6ee8100a80 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49182/0 (socket says 172.21.15.1:49182) 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 -- 172.21.15.1:0/1774584747 learned_addr learned my addr 172.21.15.1:0/1774584747 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ee8100a80 0x7f6ee81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eeceab640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee8101420 0x7f6ee81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 -- 172.21.15.1:0/1774584747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ee8100a80 msgr2=0x7f6ee81993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ee8100a80 0x7f6ee81993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 -- 172.21.15.1:0/1774584747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee8101420 msgr2=0x7f6ee81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee8101420 0x7f6ee81998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 -- 172.21.15.1:0/1774584747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee81a4970 con 0x7f6ee8106a80 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eeceab640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee8101420 0x7f6ee81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eedead640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000eaa0 tx=0x7f6ee000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6ede7fc640 1 -- 172.21.15.1:0/1774584747 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000cdb0 con 0x7f6ee8106a80 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eef910640 1 -- 172.21.15.1:0/1774584747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee81a4b40 con 0x7f6ee8106a80 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6ede7fc640 1 -- 172.21.15.1:0/1774584747 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ee0004b20 con 0x7f6ee8106a80 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6ede7fc640 1 -- 172.21.15.1:0/1774584747 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011760 con 0x7f6ee8106a80 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.528+0000 7f6eef910640 1 -- 172.21.15.1:0/1774584747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee81a5050 con 0x7f6ee8106a80 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.530+0000 7f6ede7fc640 1 -- 172.21.15.1:0/1774584747 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6ee0004cd0 con 0x7f6ee8106a80 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ef1ce9740 1 Processor -- start 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ef1ce9740 1 -- start start 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85481fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 0x55a85482a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 0x55a85482cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a854786090 con 0x55a85481f9d0 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a85472da70 con 0x55a85482abb0 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a854782050 con 0x55a8548202f0 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.531+0000 7f6ede7fc640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ed40a32d0 0x7f6ed40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85481fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85481fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49192/0 (socket says 172.21.15.1:49192) 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 -- 172.21.15.1:0/616708949 learned_addr learned my addr 172.21.15.1:0/616708949 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eedead640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ed40a32d0 0x7f6ed40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 0x55a85482cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6ede7fc640 1 -- 172.21.15.1:0/1774584747 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6ee00cfdd0 con 0x7f6ee8106a80 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 0x55a85482a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 -- 172.21.15.1:0/616708949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 msgr2=0x55a85482a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 0x55a85482a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 -- 172.21.15.1:0/616708949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 msgr2=0x55a85482cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 0x55a85482cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 -- 172.21.15.1:0/616708949 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a85473a130 con 0x55a85481f9d0 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eeceab640 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85481fdb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55a85481d2e0 tx=0x7f6ed8005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939d6d533a75b799 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6eedead640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ed40a32d0 0x7f6ed40a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0098be0 tx=0x7f6ee006be80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6ed37fe640 1 -- 172.21.15.1:0/616708949 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8035050 con 0x55a85481f9d0 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6ed37fe640 1 -- 172.21.15.1:0/616708949 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ed8031a10 con 0x55a85481f9d0 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.532+0000 7f6ed37fe640 1 -- 172.21.15.1:0/616708949 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004920 con 0x55a85481f9d0 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/616708949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 msgr2=0x55a85481fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85481fdb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55a85481d2e0 tx=0x7f6ed8005bb0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/616708949 shutdown_connections 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 0x55a85482cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 0x55a85482a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/616708949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85481fdb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/616708949 >> 172.21.15.1:0/616708949 conn(0x55a85481bf60 msgr2=0x55a85481c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/616708949 shutdown_connections 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/616708949 wait complete. 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.533+0000 7f6ef1ce9740 1 -- start start 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6ef1ce9740 1 Processor -- start 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85481f9d0 0x55a85482a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854827780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85482abb0 0x55a854827cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a85482d780 con 0x55a85482abb0 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a854740f20 con 0x55a8548202f0 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a85482d900 con 0x55a85481f9d0 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6ef1ce9740 10 client.0 _ll_register_callbacks cb 0x55a85470a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85482abb0 0x55a854827cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85482abb0 0x55a854827cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49194/0 (socket says 172.21.15.1:49194) 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 -- 172.21.15.1:0/3336442469 learned_addr learned my addr 172.21.15.1:0/3336442469 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85481f9d0 0x55a85482a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854827780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 -- 172.21.15.1:0/3336442469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85481f9d0 msgr2=0x55a85482a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85481f9d0 0x55a85482a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 -- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 msgr2=0x55a854827780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854827780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eeceab640 1 -- 172.21.15.1:0/3336442469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8544f72b0 con 0x55a85482abb0 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.534+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854827780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6eeceab640 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85482abb0 0x55a854827cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8005550 tx=0x7f6ed8041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5675d9904c67348e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ed0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/3336442469 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed804e070 con 0x55a85482abb0 2024-09-19T09:03:35.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/3336442469 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6ed8004b00 con 0x55a85482abb0 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/3336442469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ed8031a10 con 0x55a85482abb0 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/3336442469 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6ed8035070 con 0x55a85482abb0 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 10 client.15090 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/3336442469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a8548390c0 con 0x55a85482abb0 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/3336442469 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ed8031a10 con 0x55a85482abb0 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/3336442469 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6ed8039410 con 0x55a85482abb0 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 10 client.15090 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 10 client.15090 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 20 client.15090 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a85483b2e0 0x55a85483c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 4 client.15090 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.535+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/3336442469 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a854793600 con 0x55a85483b2e0 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.536+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a85483b2e0 0x55a85483c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.536+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a85483b2e0 0x55a85483c750 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4dae131608171ca3 server_cookie=6f315ce6e6d0ca13 in_seq=0 out_seq=0 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.536+0000 7f6ed0ff9640 10 client.15090 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/3336442469 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a854793600 con 0x55a85483b2e0 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ed0ff9640 10 client.15090 handle_command_reply: tid=0 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 client.15090 shutdown 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/3336442469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85482abb0 msgr2=0x55a854827cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85482abb0 0x55a854827cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8005550 tx=0x7f6ed8041040 comp rx=0 tx=0).stop 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/3336442469 shutdown_connections 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a85483b2e0 0x55a85483c750 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85482abb0 0x55a854827cc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854827780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ed0ff9640 0 client.15090 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/3336442469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85481f9d0 0x55a85482a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.537+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/3336442469 >> 172.21.15.1:0/3336442469 conn(0x55a85481bf60 msgr2=0x55a854821c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.538+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/3336442469 shutdown_connections 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.538+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/3336442469 wait complete. 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.538+0000 7f6ef1ce9740 20 client.15090 trim_cache size 0 max 16384 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.555+0000 7f6ef1ce9740 1 Processor -- start 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.555+0000 7f6ef1ce9740 1 -- start start 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85483c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 0x55a854827040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 0x55a854844e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a85483aa90 con 0x55a85481f9d0 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a85483b160 con 0x55a85482abb0 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a85483b830 con 0x55a8548202f0 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85483c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85483c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49198/0 (socket says 172.21.15.1:49198) 2024-09-19T09:03:35.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 -- 172.21.15.1:0/1040885129 learned_addr learned my addr 172.21.15.1:0/1040885129 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 0x55a854827040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 0x55a854844e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 -- 172.21.15.1:0/1040885129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 msgr2=0x55a854827040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 0x55a854827040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 -- 172.21.15.1:0/1040885129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 msgr2=0x55a854844e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 0x55a854844e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 -- 172.21.15.1:0/1040885129 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a85482a7a0 con 0x55a85481f9d0 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6eeceab640 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85483c750 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8039880 tx=0x7f6ed802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b624552340aa6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.556+0000 7f6ed2ffd640 1 -- 172.21.15.1:0/1040885129 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed804e070 con 0x55a85481f9d0 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ed2ffd640 1 -- 172.21.15.1:0/1040885129 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ed8005640 con 0x55a85481f9d0 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ed2ffd640 1 -- 172.21.15.1:0/1040885129 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004330 con 0x55a85481f9d0 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/1040885129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 msgr2=0x55a85483c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85483c750 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8039880 tx=0x7f6ed802a420 comp rx=0 tx=0).stop 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/1040885129 shutdown_connections 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a85482abb0 0x55a854844e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8548202f0 0x55a854827040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/1040885129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a85483c750 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/1040885129 >> 172.21.15.1:0/1040885129 conn(0x55a85481bf60 msgr2=0x55a854816ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/1040885129 shutdown_connections 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/1040885129 wait complete. 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.557+0000 7f6ef1ce9740 1 -- start start 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ef1ce9740 1 Processor -- start 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a854844020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854844560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ef1ce9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85482abb0 0x55a8548a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a85483c5d0 con 0x55a85481f9d0 2024-09-19T09:03:35.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a85483bf00 con 0x55a8548202f0 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ef1ce9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a85483cca0 con 0x55a85482abb0 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ef1ce9740 10 client.0 _ll_register_callbacks cb 0x7f6ed8031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a854844020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a854844020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49206/0 (socket says 172.21.15.1:49206) 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 -- 172.21.15.1:0/672306288 learned_addr learned my addr 172.21.15.1:0/672306288 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854844560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85482abb0 0x55a8548a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 -- 172.21.15.1:0/672306288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85482abb0 msgr2=0x55a8548a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85482abb0 0x55a8548a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 -- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 msgr2=0x55a854844560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854844560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 -- 172.21.15.1:0/672306288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8548a80c0 con 0x55a85481f9d0 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854844560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:35.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6eeceab640 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a854844020 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6ed802a940 tx=0x7f6ed8039670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf59d9404a4102d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.558+0000 7f6ed0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/672306288 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed804e070 con 0x55a85481f9d0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/672306288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ed8005640 con 0x55a85481f9d0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/672306288 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6ed8004040 con 0x55a85481f9d0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/672306288 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6ed8004240 con 0x55a85481f9d0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 10 client.15096 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/672306288 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a8548a93a0 con 0x55a85481f9d0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/672306288 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ed8005640 con 0x55a85481f9d0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/672306288 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6ed80036f0 con 0x55a85481f9d0 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 10 client.15096 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 10 client.15096 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 20 client.15096 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:35.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a85483b2e0 0x55a8548ac620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 4 client.15096 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/672306288 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "status"}) -- 0x55a85478db10 con 0x55a85483b2e0 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.559+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a85483b2e0 0x55a8548ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6eed6ac640 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a85483b2e0 0x55a8548ac620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4fd397d959df89da server_cookie=fa33b84f4a47c843 in_seq=0 out_seq=0 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ed0ff9640 10 client.15096 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ed0ff9640 1 -- 172.21.15.1:0/672306288 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a85478db10 con 0x55a85483b2e0 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ed0ff9640 10 client.15096 handle_command_reply: tid=0 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 client.15096 shutdown 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/672306288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 msgr2=0x55a854844020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a854844020 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6ed802a940 tx=0x7f6ed8039670 comp rx=0 tx=0).stop 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/672306288 shutdown_connections 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a85483b2e0 0x55a8548ac620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a85482abb0 0x55a8548a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8548202f0 0x55a854844560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 --2- 172.21.15.1:0/672306288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a85481f9d0 0x55a854844020 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.560+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/672306288 >> 172.21.15.1:0/672306288 conn(0x55a85481bf60 msgr2=0x55a854826050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.561+0000 7f6ed0ff9640 0 client.15096 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:03:35.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.561+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/672306288 shutdown_connections 2024-09-19T09:03:35.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.561+0000 7f6ef1ce9740 1 -- 172.21.15.1:0/672306288 wait complete. 2024-09-19T09:03:35.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.561+0000 7f6ef1ce9740 20 client.15096 trim_cache size 0 max 16384 2024-09-19T09:03:35.581 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24482, 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 85.068215373000001, 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 23, 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:03:35.582 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 114.138832936 2024-09-19T09:03:35.583 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:03:35.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 -- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ed40a32d0 msgr2=0x7f6ed40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ed40a32d0 0x7f6ed40a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0098be0 tx=0x7f6ee006be80 comp rx=0 tx=0).stop 2024-09-19T09:03:35.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 -- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8106a80 msgr2=0x7f6ee81a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:35.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000eaa0 tx=0x7f6ee000ef60 comp rx=0 tx=0).stop 2024-09-19T09:03:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 -- 172.21.15.1:0/1774584747 shutdown_connections 2024-09-19T09:03:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ee8106a80 0x7f6ee81a4430 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ee8101420 0x7f6ee81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ed40a32d0 0x7f6ed40a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 --2- 172.21.15.1:0/1774584747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ee8100a80 0x7f6ee81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 -- 172.21.15.1:0/1774584747 >> 172.21.15.1:0/1774584747 conn(0x7f6ee80fc7a0 msgr2=0x7f6ee80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 -- 172.21.15.1:0/1774584747 shutdown_connections 2024-09-19T09:03:35.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:35.562+0000 7f6eef910640 1 -- 172.21.15.1:0/1774584747 wait complete. 2024-09-19T09:03:35.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:35 smithi022 ceph-mon[35107]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:35.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:35 smithi064 ceph-mon[35179]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:03:36.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:03:36.621 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:37.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 -- 172.21.15.1:0/3738073198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40102ef0 msgr2=0x7f5e4010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/3738073198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40102ef0 0x7f5e4010da40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009ca0 tx=0x7f5e3802a950 comp rx=0 tx=0).stop 2024-09-19T09:03:37.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 -- 172.21.15.1:0/3738073198 shutdown_connections 2024-09-19T09:03:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/3738073198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40102ef0 0x7f5e4010da40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/3738073198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e40102570 0x7f5e401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/3738073198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e40100e20 0x7f5e40101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 -- 172.21.15.1:0/3738073198 >> 172.21.15.1:0/3738073198 conn(0x7f5e400fc7d0 msgr2=0x7f5e400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 -- 172.21.15.1:0/3738073198 shutdown_connections 2024-09-19T09:03:37.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.034+0000 7f5e45fa4640 1 -- 172.21.15.1:0/3738073198 wait complete. 2024-09-19T09:03:37.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e45fa4640 1 Processor -- start 2024-09-19T09:03:37.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e45fa4640 1 -- start start 2024-09-19T09:03:37.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e45fa4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40100e20 0x7f5e400fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e45fa4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e40102570 0x7f5e400fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e45fa4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e40102ef0 0x7f5e400fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e45fa4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40111150 con 0x7f5e40100e20 2024-09-19T09:03:37.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e45fa4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40110fd0 con 0x7f5e40102ef0 2024-09-19T09:03:37.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e45fa4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401112d0 con 0x7f5e40102570 2024-09-19T09:03:37.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40100e20 0x7f5e400fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40100e20 0x7f5e400fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49226/0 (socket says 172.21.15.1:49226) 2024-09-19T09:03:37.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2450250812 learned_addr learned my addr 172.21.15.1:0/2450250812 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:37.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.035+0000 7f5e3effd640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e40102570 0x7f5e400fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e40102ef0 0x7f5e400fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2450250812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e40102570 msgr2=0x7f5e400fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e40102570 0x7f5e400fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2450250812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e40102ef0 msgr2=0x7f5e400fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e40102ef0 0x7f5e400fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2450250812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e401a6b00 con 0x7f5e40100e20 2024-09-19T09:03:37.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40100e20 0x7f5e400fcc80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000b4a0 tx=0x7f5e3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3cff9640 1 -- 172.21.15.1:0/2450250812 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30014070 con 0x7f5e40100e20 2024-09-19T09:03:37.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3cff9640 1 -- 172.21.15.1:0/2450250812 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e30010b10 con 0x7f5e40100e20 2024-09-19T09:03:37.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e45fa4640 1 -- 172.21.15.1:0/2450250812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e401a6df0 con 0x7f5e40100e20 2024-09-19T09:03:37.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e3cff9640 1 -- 172.21.15.1:0/2450250812 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30017d60 con 0x7f5e40100e20 2024-09-19T09:03:37.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.036+0000 7f5e45fa4640 1 -- 172.21.15.1:0/2450250812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e401a72a0 con 0x7f5e40100e20 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e3cff9640 1 -- 172.21.15.1:0/2450250812 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5e30017070 con 0x7f5e40100e20 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e4837d740 1 Processor -- start 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e4837d740 1 -- start start 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 0x5620fce42db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce432f0 0x5620fce4d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce4dbb0 0x5620fce4ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e4837d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5620fcda9090 con 0x5620fce432f0 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e4837d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620fcd50a70 con 0x5620fce4dbb0 2024-09-19T09:03:37.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e4837d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5620fcda5050 con 0x5620fce429d0 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e3cff9640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e280a32d0 0x7f5e280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce432f0 0x5620fce4d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce432f0 0x5620fce4d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49242/0 (socket says 172.21.15.1:49242) 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/3495231554 learned_addr learned my addr 172.21.15.1:0/3495231554 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.039+0000 7f5e3effd640 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce4dbb0 0x5620fce4ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e280a32d0 0x7f5e280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 0x5620fce42db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3cff9640 1 -- 172.21.15.1:0/2450250812 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5e300ced20 con 0x7f5e40100e20 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/3495231554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 msgr2=0x5620fce42db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 0x5620fce42db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/3495231554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce4dbb0 msgr2=0x5620fce4ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce4dbb0 0x5620fce4ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/3495231554 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fcd5d130 con 0x5620fce432f0 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce432f0 0x5620fce4d670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5e3009afd0 tx=0x7f5e3001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8430f39ac2d0cd4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e280a32d0 0x7f5e280a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5e38005fe0 tx=0x7f5e38005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e25ffb640 1 -- 172.21.15.1:0/3495231554 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3001e070 con 0x5620fce432f0 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e25ffb640 1 -- 172.21.15.1:0/3495231554 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e3009f680 con 0x5620fce432f0 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.040+0000 7f5e25ffb640 1 -- 172.21.15.1:0/3495231554 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30097940 con 0x5620fce432f0 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 -- 172.21.15.1:0/3495231554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce432f0 msgr2=0x5620fce4d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce432f0 0x5620fce4d670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5e3009afd0 tx=0x7f5e3001c000 comp rx=0 tx=0).stop 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 -- 172.21.15.1:0/3495231554 shutdown_connections 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce4dbb0 0x5620fce4ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce432f0 0x5620fce4d670 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3495231554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 0x5620fce42db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 -- 172.21.15.1:0/3495231554 >> 172.21.15.1:0/3495231554 conn(0x5620fce3ef60 msgr2=0x5620fce3f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 -- 172.21.15.1:0/3495231554 shutdown_connections 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 -- 172.21.15.1:0/3495231554 wait complete. 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.041+0000 7f5e4837d740 1 -- start start 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e4837d740 1 Processor -- start 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce4d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce4a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 0x5620fce4ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e4837d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5620fce50780 con 0x5620fce429d0 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e4837d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620fcd63f20 con 0x5620fce432f0 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e4837d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5620fce50900 con 0x5620fce4dbb0 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e4837d740 10 client.0 _ll_register_callbacks cb 0x5620fcd2d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce4d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce4d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49254/0 (socket says 172.21.15.1:49254) 2024-09-19T09:03:37.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2308305892 learned_addr learned my addr 172.21.15.1:0/2308305892 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3effd640 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce4a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 0x5620fce4ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2308305892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 msgr2=0x5620fce4ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 0x5620fce4ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2308305892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 msgr2=0x5620fce4a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce4a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2308305892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fcb1a2b0 con 0x5620fce429d0 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce4d3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e30017770 tx=0x7f5e300177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb35b25097c8d23b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.042+0000 7f5e1effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e1effd640 1 -- 172.21.15.1:0/2308305892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3001e070 con 0x5620fce429d0 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e1effd640 1 -- 172.21.15.1:0/2308305892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5e300a3ab0 con 0x5620fce429d0 2024-09-19T09:03:37.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 1 -- 172.21.15.1:0/2308305892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e3009f680 con 0x5620fce429d0 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e1effd640 1 -- 172.21.15.1:0/2308305892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5e300a3cd0 con 0x5620fce429d0 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 10 client.15108 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 1 -- 172.21.15.1:0/2308305892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5620fce5c040 con 0x5620fce429d0 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e1effd640 1 -- 172.21.15.1:0/2308305892 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e3009f680 con 0x5620fce429d0 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e1effd640 1 -- 172.21.15.1:0/2308305892 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f5e3009a720 con 0x5620fce429d0 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 10 client.15108 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 10 client.15108 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 20 client.15108 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5620fce5d390 0x5620fce5f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 4 client.15108 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.043+0000 7f5e4837d740 1 -- 172.21.15.1:0/2308305892 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620fcdb6600 con 0x5620fce5d390 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.044+0000 7f5e3effd640 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5620fce5d390 0x5620fce5f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.044+0000 7f5e1effd640 10 client.15108 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:03:37.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.044+0000 7f5e3effd640 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5620fce5d390 0x5620fce5f550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd55d92a28f55bc8 server_cookie=abb7ca8a2fc7e738 in_seq=0 out_seq=0 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e1effd640 1 -- 172.21.15.1:0/2308305892 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620fcdb6600 con 0x5620fce5d390 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e1effd640 10 client.15108 handle_command_reply: tid=0 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 client.15108 shutdown 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 -- 172.21.15.1:0/2308305892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 msgr2=0x5620fce4d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce4d3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e30017770 tx=0x7f5e300177c0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 -- 172.21.15.1:0/2308305892 shutdown_connections 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5620fce5d390 0x5620fce5f550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 0x5620fce4ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce4a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2308305892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce4d3b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 -- 172.21.15.1:0/2308305892 >> 172.21.15.1:0/2308305892 conn(0x5620fce3ef60 msgr2=0x5620fce44c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e1effd640 0 client.15108 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:03:37.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 -- 172.21.15.1:0/2308305892 shutdown_connections 2024-09-19T09:03:37.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 1 -- 172.21.15.1:0/2308305892 wait complete. 2024-09-19T09:03:37.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.045+0000 7f5e4837d740 20 client.15108 trim_cache size 0 max 16384 2024-09-19T09:03:37.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.063+0000 7f5e4837d740 1 Processor -- start 2024-09-19T09:03:37.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e4837d740 1 -- start start 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce5ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce5e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 0x5620fce5da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e4837d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5620fce5d890 con 0x5620fce429d0 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e4837d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620fce5df60 con 0x5620fce432f0 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e4837d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5620fce5e630 con 0x5620fce4dbb0 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce5ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce5ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49268/0 (socket says 172.21.15.1:49268) 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2013684751 learned_addr learned my addr 172.21.15.1:0/2013684751 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3effd640 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce5e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 0x5620fce5da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2013684751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 msgr2=0x5620fce5da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 0x5620fce5da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2013684751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 msgr2=0x5620fce5e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce5e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 -- 172.21.15.1:0/2013684751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fce4d720 con 0x5620fce429d0 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.064+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce5ee80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e30097ca0 tx=0x7f5e300a3e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d92f78be1403a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e257fa640 1 -- 172.21.15.1:0/2013684751 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3001e070 con 0x5620fce429d0 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e257fa640 1 -- 172.21.15.1:0/2013684751 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e3009f680 con 0x5620fce429d0 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e257fa640 1 -- 172.21.15.1:0/2013684751 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e300bb0b0 con 0x5620fce429d0 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 -- 172.21.15.1:0/2013684751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 msgr2=0x5620fce5ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce5ee80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e30097ca0 tx=0x7f5e300a3e70 comp rx=0 tx=0).stop 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 -- 172.21.15.1:0/2013684751 shutdown_connections 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce4dbb0 0x5620fce5da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce5e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 --2- 172.21.15.1:0/2013684751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce429d0 0x5620fce5ee80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 -- 172.21.15.1:0/2013684751 >> 172.21.15.1:0/2013684751 conn(0x5620fce3ef60 msgr2=0x5620fce3d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 -- 172.21.15.1:0/2013684751 shutdown_connections 2024-09-19T09:03:37.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.065+0000 7f5e4837d740 1 -- 172.21.15.1:0/2013684751 wait complete. 2024-09-19T09:03:37.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 1 -- start start 2024-09-19T09:03:37.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 1 Processor -- start 2024-09-19T09:03:37.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 0x5620fce62820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce62d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce4dbb0 0x5620fcec67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5620fce5f3d0 con 0x5620fce4dbb0 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620fce5ed00 con 0x5620fce432f0 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5620fce5faa0 con 0x5620fce429d0 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e4837d740 10 client.0 _ll_register_callbacks cb 0x7f5e3400a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce4dbb0 0x5620fcec67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce4dbb0 0x5620fcec67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49284/0 (socket says 172.21.15.1:49284) 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e3ffff640 1 -- 172.21.15.1:0/3221452566 learned_addr learned my addr 172.21.15.1:0/3221452566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.066+0000 7f5e3effd640 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce62d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 0x5620fce62820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e3ffff640 1 -- 172.21.15.1:0/3221452566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 msgr2=0x5620fce62820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 0x5620fce62820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e3ffff640 1 -- 172.21.15.1:0/3221452566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 msgr2=0x5620fce62d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce62d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e3ffff640 1 -- 172.21.15.1:0/3221452566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fce635f0 con 0x5620fce4dbb0 2024-09-19T09:03:37.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e3effd640 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce62d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:37.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e3ffff640 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce4dbb0 0x5620fcec67e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e38035000 tx=0x7f5e3802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de763f9cd0f694 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e1effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:37.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e1effd640 1 -- 172.21.15.1:0/3221452566 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38034040 con 0x5620fce4dbb0 2024-09-19T09:03:37.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e1effd640 1 -- 172.21.15.1:0/3221452566 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5e38004250 con 0x5620fce4dbb0 2024-09-19T09:03:37.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e4837d740 1 -- 172.21.15.1:0/3221452566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e3009f680 con 0x5620fce4dbb0 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e1effd640 1 -- 172.21.15.1:0/3221452566 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5e38004450 con 0x5620fce4dbb0 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e4837d740 10 client.15114 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.067+0000 7f5e4837d740 1 -- 172.21.15.1:0/3221452566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5620fcec7df0 con 0x5620fce4dbb0 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e1effd640 1 -- 172.21.15.1:0/3221452566 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e3009f680 con 0x5620fce4dbb0 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e1effd640 1 -- 172.21.15.1:0/3221452566 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f5e38052070 con 0x5620fce4dbb0 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e4837d740 10 client.15114 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e4837d740 10 client.15114 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e4837d740 20 client.15114 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:37.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5620fcecca70 0x5620fcecb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e4837d740 4 client.15114 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e4837d740 1 -- 172.21.15.1:0/3221452566 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "status"}) -- 0x5620fcdb0b10 con 0x5620fcecca70 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5620fcecca70 0x5620fcecb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e1effd640 10 client.15114 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.068+0000 7f5e3f7fe640 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5620fcecca70 0x5620fcecb780 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3001ff19661e7e6a server_cookie=58245aec950aaedf in_seq=0 out_seq=0 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e1effd640 1 -- 172.21.15.1:0/3221452566 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5620fcdb0b10 con 0x5620fcecca70 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e1effd640 10 client.15114 handle_command_reply: tid=0 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 client.15114 shutdown 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 -- 172.21.15.1:0/3221452566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce4dbb0 msgr2=0x5620fcec67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce4dbb0 0x5620fcec67e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e38035000 tx=0x7f5e3802a950 comp rx=0 tx=0).stop 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 -- 172.21.15.1:0/3221452566 shutdown_connections 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5620fcecca70 0x5620fcecb780 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620fce4dbb0 0x5620fcec67e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620fce432f0 0x5620fce62d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 --2- 172.21.15.1:0/3221452566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620fce429d0 0x5620fce62820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 -- 172.21.15.1:0/3221452566 >> 172.21.15.1:0/3221452566 conn(0x5620fce3ef60 msgr2=0x5620fce3e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e1effd640 0 client.15114 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 -- 172.21.15.1:0/3221452566 shutdown_connections 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 1 -- 172.21.15.1:0/3221452566 wait complete. 2024-09-19T09:03:37.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.069+0000 7f5e4837d740 20 client.15114 trim_cache size 0 max 16384 2024-09-19T09:03:37.077 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:03:37.077 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:03:37.077 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-19T09:03:37.077 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24493, 2024-09-19T09:03:37.077 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:03:37.077 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:03:37.077 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:03:37.077 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 87.582555341000003, 2024-09-19T09:03:37.078 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 23, 2024-09-19T09:03:37.078 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:03:37.078 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:03:37.078 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 113.094638188 2024-09-19T09:03:37.078 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:03:37.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 -- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e280a32d0 msgr2=0x7f5e280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e280a32d0 0x7f5e280a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5e38005fe0 tx=0x7f5e38005ef0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 -- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40100e20 msgr2=0x7f5e400fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40100e20 0x7f5e400fcc80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000b4a0 tx=0x7f5e3000b960 comp rx=0 tx=0).stop 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 -- 172.21.15.1:0/2450250812 shutdown_connections 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e40102ef0 0x7f5e400fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e280a32d0 0x7f5e280a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e40102570 0x7f5e400fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 --2- 172.21.15.1:0/2450250812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e40100e20 0x7f5e400fcc80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 -- 172.21.15.1:0/2450250812 >> 172.21.15.1:0/2450250812 conn(0x7f5e400fc7d0 msgr2=0x7f5e4006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 -- 172.21.15.1:0/2450250812 shutdown_connections 2024-09-19T09:03:37.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:37.070+0000 7f5e45fa4640 1 -- 172.21.15.1:0/2450250812 wait complete. 2024-09-19T09:03:37.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:37 smithi022 ceph-mon[35107]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:37.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:37 smithi001 ceph-mon[30939]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:37.779 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:03:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:37 smithi064 ceph-mon[35179]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-19T09:03:38.037 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 -- 172.21.15.1:0/915144314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 msgr2=0x7f0360110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 --2- 172.21.15.1:0/915144314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 0x7f0360110870 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0358009ca0 tx=0x7f035802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 -- 172.21.15.1:0/915144314 shutdown_connections 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 --2- 172.21.15.1:0/915144314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 0x7f0360110870 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 --2- 172.21.15.1:0/915144314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360101280 0x7f036010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 --2- 172.21.15.1:0/915144314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03601008d0 0x7f0360100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 -- 172.21.15.1:0/915144314 >> 172.21.15.1:0/915144314 conn(0x7f03600fc7a0 msgr2=0x7f03600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 -- 172.21.15.1:0/915144314 shutdown_connections 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.501+0000 7f0367eb3640 1 -- 172.21.15.1:0/915144314 wait complete. 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0367eb3640 1 Processor -- start 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0367eb3640 1 -- start start 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0367eb3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03601008d0 0x7f03601a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0367eb3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360101280 0x7f03601a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0367eb3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 0x7f036019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0367eb3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0360114300 con 0x7f036010e480 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0367eb3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0360114180 con 0x7f03601008d0 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0367eb3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0360114480 con 0x7f0360101280 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0366450640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 0x7f036019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0366450640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 0x7f036019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49296/0 (socket says 172.21.15.1:49296) 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0366450640 1 -- 172.21.15.1:0/588118633 learned_addr learned my addr 172.21.15.1:0/588118633 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0365c4f640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03601008d0 0x7f03601a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f036544e640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360101280 0x7f03601a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0366450640 1 -- 172.21.15.1:0/588118633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360101280 msgr2=0x7f03601a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0366450640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360101280 0x7f03601a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0366450640 1 -- 172.21.15.1:0/588118633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03601008d0 msgr2=0x7f03601a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0366450640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03601008d0 0x7f03601a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0366450640 1 -- 172.21.15.1:0/588118633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036019ad00 con 0x7f036010e480 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f0365c4f640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03601008d0 0x7f03601a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.502+0000 7f036544e640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360101280 0x7f03601a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.503+0000 7f0366450640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 0x7f036019a5d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f035802ade0 tx=0x7f03580319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.503+0000 7f0356ffd640 1 -- 172.21.15.1:0/588118633 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358003c30 con 0x7f036010e480 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.503+0000 7f0356ffd640 1 -- 172.21.15.1:0/588118633 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0358003dd0 con 0x7f036010e480 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.503+0000 7f0367eb3640 1 -- 172.21.15.1:0/588118633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036019af90 con 0x7f036010e480 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.503+0000 7f0356ffd640 1 -- 172.21.15.1:0/588118633 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035802fce0 con 0x7f036010e480 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.503+0000 7f0367eb3640 1 -- 172.21.15.1:0/588118633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03601a72e0 con 0x7f036010e480 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.505+0000 7f0356ffd640 1 -- 172.21.15.1:0/588118633 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0358004050 con 0x7f036010e480 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.505+0000 7f036a28c740 1 Processor -- start 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036a28c740 1 -- start start 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036a28c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2539d0 0x56081e253db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036a28c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036a28c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e25ebb0 0x56081e260fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036a28c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56081e1ba090 con 0x56081e2539d0 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036a28c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56081e161a70 con 0x56081e25ebb0 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036a28c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56081e1b6050 con 0x56081e2542f0 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036544e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2539d0 0x56081e253db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036544e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2539d0 0x56081e253db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49312/0 (socket says 172.21.15.1:49312) 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036544e640 1 -- 172.21.15.1:0/174106820 learned_addr learned my addr 172.21.15.1:0/174106820 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f0356ffd640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a3350 0x7f034c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f0365c4f640 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f0366450640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a3350 0x7f034c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036544e640 1 -- 172.21.15.1:0/174106820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 msgr2=0x56081e25e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036544e640 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036544e640 1 -- 172.21.15.1:0/174106820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e25ebb0 msgr2=0x56081e260fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:38.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036544e640 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e25ebb0 0x56081e260fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f036544e640 1 -- 172.21.15.1:0/174106820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081e16e130 con 0x56081e2539d0 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.506+0000 7f0365c4f640 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.507+0000 7f0356ffd640 1 -- 172.21.15.1:0/588118633 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f03580f0c70 con 0x7f036010e480 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.507+0000 7f036544e640 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2539d0 0x56081e253db0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03500079d0 tx=0x7f0350007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e873acdc6303394 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.507+0000 7f034bfff640 1 -- 172.21.15.1:0/174106820 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035000fc90 con 0x56081e2539d0 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.507+0000 7f0366450640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a3350 0x7f034c0a5810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0358031a60 tx=0x7f03580902e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.507+0000 7f034bfff640 1 -- 172.21.15.1:0/174106820 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0350010040 con 0x56081e2539d0 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.507+0000 7f034bfff640 1 -- 172.21.15.1:0/174106820 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350013730 con 0x56081e2539d0 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 -- 172.21.15.1:0/174106820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2539d0 msgr2=0x56081e253db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2539d0 0x56081e253db0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03500079d0 tx=0x7f0350007e90 comp rx=0 tx=0).stop 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 -- 172.21.15.1:0/174106820 shutdown_connections 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e25ebb0 0x56081e260fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 --2- 172.21.15.1:0/174106820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2539d0 0x56081e253db0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 -- 172.21.15.1:0/174106820 >> 172.21.15.1:0/174106820 conn(0x56081e24ff60 msgr2=0x56081e250340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 -- 172.21.15.1:0/174106820 shutdown_connections 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 -- 172.21.15.1:0/174106820 wait complete. 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 -- start start 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 Processor -- start 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.508+0000 7f036a28c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e25e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036a28c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036a28c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e25bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036a28c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56081e261780 con 0x56081e25ebb0 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036a28c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56081e174f20 con 0x56081e2539d0 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036a28c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56081e261900 con 0x56081e2542f0 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036a28c740 10 client.0 _ll_register_callbacks cb 0x56081e13e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:38.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e25bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e25e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e25e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:57026/0 (socket says 172.21.15.1:57026) 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 -- 172.21.15.1:0/95404212 learned_addr learned my addr 172.21.15.1:0/95404212 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f0365c4f640 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 -- 172.21.15.1:0/95404212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 msgr2=0x56081e25b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 -- 172.21.15.1:0/95404212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 msgr2=0x56081e25e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e25e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 -- 172.21.15.1:0/95404212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56081df2b2b0 con 0x56081e25ebb0 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036544e640 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e25bc90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0350007210 tx=0x7f03500133d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260d6b06dda5edb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f03497fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f03497fa640 1 -- 172.21.15.1:0/95404212 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350014430 con 0x56081e25ebb0 2024-09-19T09:03:38.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f03497fa640 1 -- 172.21.15.1:0/95404212 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f03500145d0 con 0x56081e25ebb0 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.509+0000 7f036a28c740 1 -- 172.21.15.1:0/95404212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0350010040 con 0x56081e25ebb0 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f03497fa640 1 -- 172.21.15.1:0/95404212 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0350034050 con 0x56081e25ebb0 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f036a28c740 10 client.15126 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f036a28c740 1 -- 172.21.15.1:0/95404212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56081e26cfc0 con 0x56081e25ebb0 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f03497fa640 1 -- 172.21.15.1:0/95404212 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0350010040 con 0x56081e25ebb0 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f03497fa640 1 -- 172.21.15.1:0/95404212 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0350020b00 con 0x56081e25ebb0 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f036a28c740 10 client.15126 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f036a28c740 10 client.15126 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f036a28c740 20 client.15126 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f036a28c740 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56081e26f3d0 0x56081e270840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f036a28c740 4 client.15126 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f036a28c740 1 -- 172.21.15.1:0/95404212 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56081e1c7600 con 0x56081e26f3d0 2024-09-19T09:03:38.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.510+0000 7f0365c4f640 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56081e26f3d0 0x56081e270840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.511+0000 7f0365c4f640 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56081e26f3d0 0x56081e270840 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8848ff9bbfe8ccc9 server_cookie=93e236f801872eec in_seq=0 out_seq=0 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.511+0000 7f03497fa640 10 client.15126 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.511+0000 7f03497fa640 1 -- 172.21.15.1:0/95404212 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56081e1c7600 con 0x56081e26f3d0 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.511+0000 7f03497fa640 10 client.15126 handle_command_reply: tid=0 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.511+0000 7f036a28c740 1 client.15126 shutdown 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.511+0000 7f036a28c740 1 -- 172.21.15.1:0/95404212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 msgr2=0x56081e25bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e25bc90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0350007210 tx=0x7f03500133d0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 -- 172.21.15.1:0/95404212 shutdown_connections 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56081e26f3d0 0x56081e270840 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e25bc90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e25b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 --2- 172.21.15.1:0/95404212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e25e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f03497fa640 0 client.15126 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:38.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 -- 172.21.15.1:0/95404212 >> 172.21.15.1:0/95404212 conn(0x56081e24ff60 msgr2=0x56081e255c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 -- 172.21.15.1:0/95404212 shutdown_connections 2024-09-19T09:03:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 1 -- 172.21.15.1:0/95404212 wait complete. 2024-09-19T09:03:38.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.512+0000 7f036a28c740 20 client.15126 trim_cache size 0 max 16384 2024-09-19T09:03:38.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036a28c740 1 Processor -- start 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036a28c740 1 -- start start 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036a28c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e270840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036a28c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e270170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036a28c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e26ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036a28c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56081e26eb80 con 0x56081e25ebb0 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036a28c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56081e26f250 con 0x56081e2539d0 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036a28c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56081e26f920 con 0x56081e2542f0 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036544e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e26ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036544e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e26ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49326/0 (socket says 172.21.15.1:49326) 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.530+0000 7f036544e640 1 -- 172.21.15.1:0/3321245299 learned_addr learned my addr 172.21.15.1:0/3321245299 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f036544e640 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e270840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f0365c4f640 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e270170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f036544e640 1 -- 172.21.15.1:0/3321245299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 msgr2=0x56081e270170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f036544e640 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e270170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f036544e640 1 -- 172.21.15.1:0/3321245299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 msgr2=0x56081e270840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f036544e640 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e270840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f036544e640 1 -- 172.21.15.1:0/3321245299 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081e261890 con 0x56081e25ebb0 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f036544e640 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e26ed00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0350000c00 tx=0x7f0350022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569e0fd16bca2681 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f034b7fe640 1 -- 172.21.15.1:0/3321245299 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035003d070 con 0x56081e25ebb0 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f034b7fe640 1 -- 172.21.15.1:0/3321245299 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0350031030 con 0x56081e25ebb0 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.531+0000 7f034b7fe640 1 -- 172.21.15.1:0/3321245299 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350024040 con 0x56081e25ebb0 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 -- 172.21.15.1:0/3321245299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 msgr2=0x56081e26ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e26ed00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0350000c00 tx=0x7f0350022000 comp rx=0 tx=0).stop 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 -- 172.21.15.1:0/3321245299 shutdown_connections 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e25ebb0 0x56081e26ed00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e2542f0 0x56081e270170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 --2- 172.21.15.1:0/3321245299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e270840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 -- 172.21.15.1:0/3321245299 >> 172.21.15.1:0/3321245299 conn(0x56081e24ff60 msgr2=0x56081e26e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 -- 172.21.15.1:0/3321245299 shutdown_connections 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 -- 172.21.15.1:0/3321245299 wait complete. 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 -- start start 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.532+0000 7f036a28c740 1 Processor -- start 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036a28c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e2769d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036a28c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2542f0 0x56081e276f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036a28c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e25ebb0 0x56081e271fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036a28c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56081e2706c0 con 0x56081e2542f0 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036a28c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56081e26fff0 con 0x56081e2539d0 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036a28c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56081e270d90 con 0x56081e25ebb0 2024-09-19T09:03:38.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036a28c740 10 client.0 _ll_register_callbacks cb 0x7f0350013610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2542f0 0x56081e276f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2542f0 0x56081e276f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49338/0 (socket says 172.21.15.1:49338) 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 -- 172.21.15.1:0/3567313856 learned_addr learned my addr 172.21.15.1:0/3567313856 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036544e640 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e2769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036544e640 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e25ebb0 0x56081e271fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 -- 172.21.15.1:0/3567313856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e25ebb0 msgr2=0x56081e271fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e25ebb0 0x56081e271fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 -- 172.21.15.1:0/3567313856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 msgr2=0x56081e2769d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e2769d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 -- 172.21.15.1:0/3567313856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56081e2726a0 con 0x56081e2542f0 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f036544e640 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e25ebb0 0x56081e271fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f0365c4f640 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2542f0 0x56081e276f10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f035c005fd0 tx=0x7f035c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62465e7d6ab2f42e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:38.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.533+0000 7f03497fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f03497fa640 1 -- 172.21.15.1:0/3567313856 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c0035f0 con 0x56081e2542f0 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f03497fa640 1 -- 172.21.15.1:0/3567313856 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f035c003790 con 0x56081e2542f0 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 1 -- 172.21.15.1:0/3567313856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0350031030 con 0x56081e2542f0 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f03497fa640 1 -- 172.21.15.1:0/3567313856 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f035c02a070 con 0x56081e2542f0 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 10 client.15132 fetch_fsmap learned FSMap version 23 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 1 -- 172.21.15.1:0/3567313856 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56081e2760e0 con 0x56081e2542f0 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f03497fa640 1 -- 172.21.15.1:0/3567313856 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0350031030 con 0x56081e2542f0 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f03497fa640 1 -- 172.21.15.1:0/3567313856 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f035c00f040 con 0x56081e2542f0 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 10 client.15132 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 10 client.15132 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 20 client.15132 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56081e2de0b0 0x56081e2dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:38.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 4 client.15132 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:03:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036a28c740 1 -- 172.21.15.1:0/3567313856 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "status"}) -- 0x56081e1c1b10 con 0x56081e2de0b0 2024-09-19T09:03:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.534+0000 7f036544e640 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56081e2de0b0 0x56081e2dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036544e640 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56081e2de0b0 0x56081e2dcdc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4040db1642dcdedd server_cookie=403c6ba47c8d51e4 in_seq=0 out_seq=0 2024-09-19T09:03:38.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f03497fa640 10 client.15132 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f03497fa640 1 -- 172.21.15.1:0/3567313856 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56081e1c1b10 con 0x56081e2de0b0 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f03497fa640 10 client.15132 handle_command_reply: tid=0 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 client.15132 shutdown 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 -- 172.21.15.1:0/3567313856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2542f0 msgr2=0x56081e276f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2542f0 0x56081e276f10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f035c005fd0 tx=0x7f035c0128e0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 -- 172.21.15.1:0/3567313856 shutdown_connections 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56081e2de0b0 0x56081e2dcdc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56081e25ebb0 0x56081e271fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56081e2542f0 0x56081e276f10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 --2- 172.21.15.1:0/3567313856 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56081e2539d0 0x56081e2769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 -- 172.21.15.1:0/3567313856 >> 172.21.15.1:0/3567313856 conn(0x56081e24ff60 msgr2=0x56081e24ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f03497fa640 0 client.15132 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 -- 172.21.15.1:0/3567313856 shutdown_connections 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 1 -- 172.21.15.1:0/3567313856 wait complete. 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.535+0000 7f036a28c740 20 client.15132 trim_cache size 0 max 16384 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:03:38.549 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24500, 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 95.880799960999994, 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 23, 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 105.950219241 2024-09-19T09:03:38.550 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:03:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 -- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a3350 msgr2=0x7f034c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a3350 0x7f034c0a5810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0358031a60 tx=0x7f03580902e0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 -- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 msgr2=0x7f036019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 0x7f036019a5d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f035802ade0 tx=0x7f03580319f0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 -- 172.21.15.1:0/588118633 shutdown_connections 2024-09-19T09:03:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f036010e480 0x7f036019a5d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f034c0a3350 0x7f034c0a5810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0360101280 0x7f03601a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 --2- 172.21.15.1:0/588118633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03601008d0 0x7f03601a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:38.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 -- 172.21.15.1:0/588118633 >> 172.21.15.1:0/588118633 conn(0x7f03600fc7a0 msgr2=0x7f03600feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:38.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 -- 172.21.15.1:0/588118633 shutdown_connections 2024-09-19T09:03:38.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:38.536+0000 7f0367eb3640 1 -- 172.21.15.1:0/588118633 wait complete. 2024-09-19T09:03:39.238 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:03:39.251 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:03:39.251 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:03:39.252 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:03:39.252 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:03:39.277 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:03:39.277 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T09:03:39.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:39.277 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T09:03:39.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:39.297 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-19T09:03:39.369 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2024-09-19T09:03:39.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:03:39.370 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T09:03:39.371 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:03:39.371 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:03:39.371 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:03:39.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:39 smithi001 ceph-mon[30939]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:39.673 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:39.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:39 smithi022 ceph-mon[35107]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:39 smithi064 ceph-mon[35179]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:03:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 -- 172.21.15.1:0/4088719106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102570 msgr2=0x7ffb901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 --2- 172.21.15.1:0/4088719106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102570 0x7ffb901029b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009900 tx=0x7ffb8402a480 comp rx=0 tx=0).stop 2024-09-19T09:03:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 -- 172.21.15.1:0/4088719106 shutdown_connections 2024-09-19T09:03:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 --2- 172.21.15.1:0/4088719106 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb90102ef0 0x7ffb9010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 --2- 172.21.15.1:0/4088719106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102570 0x7ffb901029b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 --2- 172.21.15.1:0/4088719106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90100e20 0x7ffb90101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 -- 172.21.15.1:0/4088719106 >> 172.21.15.1:0/4088719106 conn(0x7ffb900fc7d0 msgr2=0x7ffb900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 -- 172.21.15.1:0/4088719106 shutdown_connections 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.217+0000 7ffb957d0640 1 -- 172.21.15.1:0/4088719106 wait complete. 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.218+0000 7ffb957d0640 1 Processor -- start 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.218+0000 7ffb957d0640 1 -- start start 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.218+0000 7ffb957d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb90100e20 0x7ffb901a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.218+0000 7ffb957d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90102570 0x7ffb901a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.218+0000 7ffb957d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102ef0 0x7ffb9019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.218+0000 7ffb957d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90111160 con 0x7ffb90102ef0 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.218+0000 7ffb957d0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb90110fe0 con 0x7ffb90102570 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.218+0000 7ffb957d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffb901112e0 con 0x7ffb90100e20 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102ef0 0x7ffb9019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:40.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102ef0 0x7ffb9019a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49370/0 (socket says 172.21.15.1:49370) 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 -- 172.21.15.1:0/3578707910 learned_addr learned my addr 172.21.15.1:0/3578707910 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8e7fc640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90102570 0x7ffb901a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8effd640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb90100e20 0x7ffb901a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 -- 172.21.15.1:0/3578707910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb90100e20 msgr2=0x7ffb901a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb90100e20 0x7ffb901a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 -- 172.21.15.1:0/3578707910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90102570 msgr2=0x7ffb901a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90102570 0x7ffb901a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 -- 172.21.15.1:0/3578707910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9019afd0 con 0x7ffb90102ef0 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb8f7fe640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102ef0 0x7ffb9019a760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800b970 tx=0x7ffb8800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb77fff640 1 -- 172.21.15.1:0/3578707910 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88019070 con 0x7ffb90102ef0 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9019b2c0 con 0x7ffb90102ef0 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb77fff640 1 -- 172.21.15.1:0/3578707910 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb8800cb40 con 0x7ffb90102ef0 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb77fff640 1 -- 172.21.15.1:0/3578707910 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88007700 con 0x7ffb90102ef0 2024-09-19T09:03:40.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.219+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb901a7610 con 0x7ffb90102ef0 2024-09-19T09:03:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.220+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb901021b0 con 0x7ffb90102ef0 2024-09-19T09:03:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.221+0000 7ffb77fff640 1 -- 172.21.15.1:0/3578707910 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ffb8801c070 con 0x7ffb90102ef0 2024-09-19T09:03:40.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.222+0000 7ffb77fff640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb780a32d0 0x7ffb780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:40.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.222+0000 7ffb8effd640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb780a32d0 0x7ffb780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:40.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.222+0000 7ffb77fff640 1 -- 172.21.15.1:0/3578707910 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ffb880cefb0 con 0x7ffb90102ef0 2024-09-19T09:03:40.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.223+0000 7ffb8effd640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb780a32d0 0x7ffb780a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009890 tx=0x7ffb80008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:40.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.226+0000 7ffb77fff640 1 -- 172.21.15.1:0/3578707910 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb8809bc00 con 0x7ffb90102ef0 2024-09-19T09:03:40.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.400+0000 7ffb77fff640 1 -- 172.21.15.1:0/3578707910 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ffb8800ccf0 con 0x7ffb90102ef0 2024-09-19T09:03:40.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.446+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffb9019bcc0 con 0x7ffb90102ef0 2024-09-19T09:03:40.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.446+0000 7ffb77fff640 1 -- 172.21.15.1:0/3578707910 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7ffb9019bcc0 con 0x7ffb90102ef0 2024-09-19T09:03:40.446 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb780a32d0 msgr2=0x7ffb780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb780a32d0 0x7ffb780a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009890 tx=0x7ffb80008040 comp rx=0 tx=0).stop 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102ef0 msgr2=0x7ffb9019a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102ef0 0x7ffb9019a760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800b970 tx=0x7ffb8800be30 comp rx=0 tx=0).stop 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 shutdown_connections 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb90102ef0 0x7ffb9019a760 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb90102570 0x7ffb901a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ffb780a32d0 0x7ffb780a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 --2- 172.21.15.1:0/3578707910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb90100e20 0x7ffb901a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 >> 172.21.15.1:0/3578707910 conn(0x7ffb900fc7d0 msgr2=0x7ffb90069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:40.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 shutdown_connections 2024-09-19T09:03:40.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:40.448+0000 7ffb957d0640 1 -- 172.21.15.1:0/3578707910 wait complete. 2024-09-19T09:03:41.388 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:03:41.388 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:03:41.389 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-19T09:03:41.389 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:03:41.389 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:03:41.389 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:03:41.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:03:41.389 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:03:41.389 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:03:41.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:41.389 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-19T09:03:41.407 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42178sec preferred_lft 42178sec 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:03:41.408 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-19T09:03:41.409 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:03:41.409 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:03:41.409 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:03:41.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:03:41.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-09-19T09:03:41.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-09-19T09:03:41.409 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:03:41.409 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:03:41.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:03:41.613 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:41 smithi001 ceph-mon[30939]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:41.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:41 smithi001 ceph-mon[30939]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:03:41.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:41 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3578707910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:03:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:41.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:41.624 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:03:41.650 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-19T09:03:41.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:41.652 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-19T09:03:41.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:41 smithi022 ceph-mon[35107]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:41.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:41 smithi022 ceph-mon[35107]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:03:41.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:41 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3578707910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:03:41.720 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-19T09:03:41.721 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:03:41.721 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:03:41.721 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:03:41.721 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:03:41.722 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:03:41.722 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:03:41.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:03:41.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:03:41.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:03:41.723 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:03:41.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:03:41.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:41 smithi064 ceph-mon[35179]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:03:41.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:41 smithi064 ceph-mon[35179]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:03:41.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:41 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3578707910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:03:42.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:42.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:42.024 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T09:03:42.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:42.042 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-09-19T09:03:42.098 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:03:42.098 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:03:42.098 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:03:42.098 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:03:42.098 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:03:42.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:03:42.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:42.218 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:03:42.219 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:03:42.219 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:03:42.219 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:03:42.219 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:03:42.219 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:03:42.219 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:03:42.219 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:03:42.219 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:03:42.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:03:42.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:42.353 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:03:42.353 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:03:42.353 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-19T09:03:42.353 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:03:42.353 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:03:42.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:03:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:42.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:03:42.433 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:03:42.449 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:03:42.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:03:42.449 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:03:42.505 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T09:03:42.505 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T09:03:42.505 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/08242d8f-c833-411d-9ab8-a26d685647dd 2024-09-19T09:03:42.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:42.505 DEBUG:teuthology.orchestra.run.smithi001:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/08242d8f-c833-411d-9ab8-a26d685647dd /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T09:03:42.604 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T09:03:42.604 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-19T09:03:42.604 INFO:teuthology.orchestra.run.smithi001.stdout:invalid new device string format 2024-09-19T09:03:42.732 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T09:03:42.732 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-19T09:03:42.732 INFO:teuthology.orchestra.run.smithi001.stdout:invalid new device string format 2024-09-19T09:03:42.733 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: resolved to: "172.21.15.1:3300,172.21.15.22:3300,172.21.15.64:3300" 2024-09-19T09:03:42.733 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.1:3300,172.21.15.22:3300,172.21.15.64:3300:/volumes/qa/sv_1/08242d8f-c833-411d-9ab8-a26d685647dd 2024-09-19T09:03:42.733 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=98b2a8e0-7664-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T09:03:42.733 INFO:teuthology.orchestra.run.smithi001.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:03:42.733 INFO:teuthology.orchestra.run.smithi001.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:03:42.733 INFO:teuthology.orchestra.run.smithi001.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:03:42.733 INFO:teuthology.orchestra.run.smithi001.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:03:42.734 INFO:teuthology.orchestra.run.smithi001.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:03:42.735 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:03:42.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:03:42.735 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:03:42.762 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:03:42.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:03:42.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:42.861 INFO:teuthology.orchestra.run.smithi001.stdout:client15141 2024-09-19T09:03:42.861 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:03:42.861 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:03:42.879 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:03:42.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:03:42.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:42.977 INFO:teuthology.orchestra.run.smithi001.stdout:client15141 2024-09-19T09:03:42.978 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:03:43.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:03:43.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:43.036 INFO:teuthology.orchestra.run.smithi001.stdout:client15141 2024-09-19T09:03:43.036 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968.client15141/status') 2024-09-19T09:03:43.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:03:43.095 INFO:teuthology.orchestra.run.smithi001.stdout:instance: client.15141 (3)192.168.0.1:0/2292251808 2024-09-19T09:03:43.096 INFO:teuthology.orchestra.run.smithi001.stdout:blocklisted: false 2024-09-19T09:03:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records in 2024-09-19T09:03:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records out 2024-09-19T09:03:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:70 bytes copied, 2.3917e-05 s, 2.9 MB/s 2024-09-19T09:03:43.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:03:43.103 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T09:03:43.114 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:03:43.114 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:03:43.114 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-19T09:03:43.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.218+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/443697300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 msgr2=0x7fbe041049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.218+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/443697300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 0x7fbe041049e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009900 tx=0x7fbdf402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.218+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/443697300 shutdown_connections 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.218+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/443697300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe04107850 0x7fbe04109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.218+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/443697300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe04104f20 0x7fbe04107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.218+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/443697300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 0x7fbe041049e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.218+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/443697300 >> 172.21.15.1:0/443697300 conn(0x7fbe040fc1f0 msgr2=0x7fbe040fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/443697300 shutdown_connections 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/443697300 wait complete. 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 Processor -- start 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 -- start start 2024-09-19T09:03:43.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 0x7fbe04101f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe04104f20 0x7fbe041005a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe04107850 0x7fbe04100ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0410d980 con 0x7fbe041025f0 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0410d800 con 0x7fbe04104f20 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.219+0000 7fbe0a8a6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0410db00 con 0x7fbe04107850 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 0x7fbe04101f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 0x7fbe04101f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60204/0 (socket says 172.21.15.1:60204) 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 -- 172.21.15.1:0/3892004171 learned_addr learned my addr 172.21.15.1:0/3892004171 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe08e43640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe04107850 0x7fbe04100ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe037fe640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe04104f20 0x7fbe041005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 -- 172.21.15.1:0/3892004171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe04107850 msgr2=0x7fbe04100ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe04107850 0x7fbe04100ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 -- 172.21.15.1:0/3892004171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe04104f20 msgr2=0x7fbe041005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe04104f20 0x7fbe041005a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 -- 172.21.15.1:0/3892004171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe04101370 con 0x7fbe041025f0 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe037fe640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe04104f20 0x7fbe041005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe03fff640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 0x7fbe04101f60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005940 tx=0x7fbdf4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe017fa640 1 -- 172.21.15.1:0/3892004171 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf403f030 con 0x7fbe041025f0 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe017fa640 1 -- 172.21.15.1:0/3892004171 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbdf4003af0 con 0x7fbe041025f0 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041a20d0 con 0x7fbe041025f0 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe017fa640 1 -- 172.21.15.1:0/3892004171 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4035070 con 0x7fbe041025f0 2024-09-19T09:03:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.220+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe041a2670 con 0x7fbe041025f0 2024-09-19T09:03:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.221+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe040fdce0 con 0x7fbe041025f0 2024-09-19T09:03:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.222+0000 7fbe017fa640 1 -- 172.21.15.1:0/3892004171 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fbdf4042030 con 0x7fbe041025f0 2024-09-19T09:03:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.223+0000 7fbe017fa640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbdec0a32c0 0x7fbdec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.223+0000 7fbe037fe640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbdec0a32c0 0x7fbdec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.223+0000 7fbe017fa640 1 -- 172.21.15.1:0/3892004171 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fbdf40f0150 con 0x7fbe041025f0 2024-09-19T09:03:43.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.224+0000 7fbe037fe640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbdec0a32c0 0x7fbdec0a5780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe04101cd0 tx=0x7fbdf8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.227+0000 7fbe017fa640 1 -- 172.21.15.1:0/3892004171 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbdf40bcdf0 con 0x7fbe041025f0 2024-09-19T09:03:43.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:43.445+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fbe0402d7c0 con 0x7fbe041025f0 2024-09-19T09:03:43.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:43 smithi022 ceph-mon[35107]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:03:43.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:43 smithi001 ceph-mon[30939]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:03:43.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:43 smithi064 ceph-mon[35179]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:03:44.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.399+0000 7fbe017fa640 1 -- 172.21.15.1:0/3892004171 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fbdf40bc6f0 con 0x7fbe041025f0 2024-09-19T09:03:44.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbdec0a32c0 msgr2=0x7fbdec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbdec0a32c0 0x7fbdec0a5780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe04101cd0 tx=0x7fbdf8005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:44.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 msgr2=0x7fbe04101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 0x7fbe04101f60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005940 tx=0x7fbdf4004270 comp rx=0 tx=0).stop 2024-09-19T09:03:44.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 shutdown_connections 2024-09-19T09:03:44.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbdec0a32c0 0x7fbdec0a5780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe04107850 0x7fbe04100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe04104f20 0x7fbe041005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 --2- 172.21.15.1:0/3892004171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe041025f0 0x7fbe04101f60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 >> 172.21.15.1:0/3892004171 conn(0x7fbe040fc1f0 msgr2=0x7fbe04102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:44.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 shutdown_connections 2024-09-19T09:03:44.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.402+0000 7fbe0a8a6640 1 -- 172.21.15.1:0/3892004171 wait complete. 2024-09-19T09:03:44.416 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 -- 172.21.15.1:0/1068658750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 msgr2=0x7f47201020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 --2- 172.21.15.1:0/1068658750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 0x7f47201020b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4714009900 tx=0x7f471402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 -- 172.21.15.1:0/1068658750 shutdown_connections 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 --2- 172.21.15.1:0/1068658750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47201025f0 0x7f4720108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 --2- 172.21.15.1:0/1068658750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 0x7f47201020b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 --2- 172.21.15.1:0/1068658750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4720100a40 0x7f4720100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 -- 172.21.15.1:0/1068658750 >> 172.21.15.1:0/1068658750 conn(0x7f47200fc1c0 msgr2=0x7f47200fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 -- 172.21.15.1:0/1068658750 shutdown_connections 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.530+0000 7f4726d68640 1 -- 172.21.15.1:0/1068658750 wait complete. 2024-09-19T09:03:44.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4726d68640 1 Processor -- start 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4726d68640 1 -- start start 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4726d68640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4720100a40 0x7f4720197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4726d68640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 0x7f47201984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4726d68640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47201025f0 0x7f472019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4726d68640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f472010d920 con 0x7f4720101c30 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4726d68640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f472010d7a0 con 0x7f47201025f0 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4726d68640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f472010daa0 con 0x7f4720100a40 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f471ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 0x7f47201984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f471ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 0x7f47201984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60230/0 (socket says 172.21.15.1:60230) 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f471ffff640 1 -- 172.21.15.1:0/1763200490 learned_addr learned my addr 172.21.15.1:0/1763200490 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:44.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4724b04640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4720100a40 0x7f4720197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f4725305640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47201025f0 0x7f472019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f471ffff640 1 -- 172.21.15.1:0/1763200490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4720100a40 msgr2=0x7f4720197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f471ffff640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4720100a40 0x7f4720197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f471ffff640 1 -- 172.21.15.1:0/1763200490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47201025f0 msgr2=0x7f472019f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f471ffff640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47201025f0 0x7f472019f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.531+0000 7f471ffff640 1 -- 172.21.15.1:0/1763200490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472019fbd0 con 0x7f4720101c30 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.532+0000 7f471ffff640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 0x7f47201984f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4714009a20 tx=0x7f47140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.532+0000 7f471dffb640 1 -- 172.21.15.1:0/1763200490 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471403f030 con 0x7f4720101c30 2024-09-19T09:03:44.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.532+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472019fe60 con 0x7f4720101c30 2024-09-19T09:03:44.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.532+0000 7f471dffb640 1 -- 172.21.15.1:0/1763200490 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4714003d00 con 0x7f4720101c30 2024-09-19T09:03:44.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.532+0000 7f471dffb640 1 -- 172.21.15.1:0/1763200490 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4714035070 con 0x7f4720101c30 2024-09-19T09:03:44.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.532+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47201a02d0 con 0x7f4720101c30 2024-09-19T09:03:44.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.533+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4720107e80 con 0x7f4720101c30 2024-09-19T09:03:44.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.534+0000 7f471dffb640 1 -- 172.21.15.1:0/1763200490 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4714042030 con 0x7f4720101c30 2024-09-19T09:03:44.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.535+0000 7f471dffb640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47080a3240 0x7f47080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:44.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.535+0000 7f4724b04640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47080a3240 0x7f47080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:44.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.535+0000 7f471dffb640 1 -- 172.21.15.1:0/1763200490 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f47140efe00 con 0x7f4720101c30 2024-09-19T09:03:44.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.536+0000 7f4724b04640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47080a3240 0x7f47080a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4720101a90 tx=0x7f4710005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:44.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.539+0000 7f471dffb640 1 -- 172.21.15.1:0/1763200490 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47140bc4b0 con 0x7f4720101c30 2024-09-19T09:03:44.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:44 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3892004171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T09:03:44.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.743+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f4720062790 con 0x7f47080a3240 2024-09-19T09:03:44.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:44 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3892004171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T09:03:44.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.762+0000 7f471dffb640 1 -- 172.21.15.1:0/1763200490 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f4720062790 con 0x7f47080a3240 2024-09-19T09:03:44.762 INFO:teuthology.orchestra.run.smithi001.stdout:{} 2024-09-19T09:03:44.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47080a3240 msgr2=0x7f47080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47080a3240 0x7f47080a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4720101a90 tx=0x7f4710005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:44.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 msgr2=0x7f47201984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 0x7f47201984f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4714009a20 tx=0x7f47140042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 shutdown_connections 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47201025f0 0x7f472019f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4720101c30 0x7f47201984f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f47080a3240 0x7f47080a5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 --2- 172.21.15.1:0/1763200490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4720100a40 0x7f4720197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 >> 172.21.15.1:0/1763200490 conn(0x7f47200fc1c0 msgr2=0x7f4720105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 shutdown_connections 2024-09-19T09:03:44.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.764+0000 7f4726d68640 1 -- 172.21.15.1:0/1763200490 wait complete. 2024-09-19T09:03:44.775 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T09:03:44.786 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T09:03:44.796 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:03:44.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:44 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3892004171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- 172.21.15.1:0/953566178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 msgr2=0x7f3630101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 --2- 172.21.15.1:0/953566178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 0x7f3630101160 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3620009900 tx=0x7f362002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- 172.21.15.1:0/953566178 shutdown_connections 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 --2- 172.21.15.1:0/953566178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36301016a0 0x7f3630101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 --2- 172.21.15.1:0/953566178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 0x7f3630101160 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 --2- 172.21.15.1:0/953566178 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36301003c0 0x7f36301007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- 172.21.15.1:0/953566178 >> 172.21.15.1:0/953566178 conn(0x7f36300fc190 msgr2=0x7f36300fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- 172.21.15.1:0/953566178 shutdown_connections 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- 172.21.15.1:0/953566178 wait complete. 2024-09-19T09:03:44.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 Processor -- start 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- start start 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36301003c0 0x7f363019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 0x7f363019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36301016a0 0x7f36301a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f363010fb20 con 0x7f3630100d00 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f363010f9a0 con 0x7f36301016a0 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.900+0000 7f363784c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f363010fca0 con 0x7f36301003c0 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 0x7f363019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 0x7f363019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60248/0 (socket says 172.21.15.1:60248) 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 -- 172.21.15.1:0/3448693788 learned_addr learned my addr 172.21.15.1:0/3448693788 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3635de9640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36301016a0 0x7f36301a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f36355e8640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36301003c0 0x7f363019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:44.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 -- 172.21.15.1:0/3448693788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36301003c0 msgr2=0x7f363019a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36301003c0 0x7f363019a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 -- 172.21.15.1:0/3448693788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36301016a0 msgr2=0x7f36301a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36301016a0 0x7f36301a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 -- 172.21.15.1:0/3448693788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36301a1d40 con 0x7f3630100d00 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f36355e8640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36301003c0 0x7f363019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3635de9640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36301016a0 0x7f36301a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f3634de7640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 0x7f363019a660 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3620009a20 tx=0x7f3620004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f36267fc640 1 -- 172.21.15.1:0/3448693788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362003f030 con 0x7f3630100d00 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f36267fc640 1 -- 172.21.15.1:0/3448693788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3620003d00 con 0x7f3630100d00 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36301a1fd0 con 0x7f3630100d00 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f36267fc640 1 -- 172.21.15.1:0/3448693788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620035070 con 0x7f3630100d00 2024-09-19T09:03:44.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.901+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36301a2430 con 0x7f3630100d00 2024-09-19T09:03:44.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.902+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f363010b1e0 con 0x7f3630100d00 2024-09-19T09:03:44.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.903+0000 7f36267fc640 1 -- 172.21.15.1:0/3448693788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3620042030 con 0x7f3630100d00 2024-09-19T09:03:44.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.904+0000 7f36267fc640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f361c0a3250 0x7f361c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:44.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.904+0000 7f36355e8640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f361c0a3250 0x7f361c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:44.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.904+0000 7f36267fc640 1 -- 172.21.15.1:0/3448693788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f36200f0100 con 0x7f3630100d00 2024-09-19T09:03:44.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.905+0000 7f36355e8640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f361c0a3250 0x7f361c0a5710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f362c0058c0 tx=0x7f362c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:44.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:44.908+0000 7f36267fc640 1 -- 172.21.15.1:0/3448693788 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f36200bcda0 con 0x7f3630100d00 2024-09-19T09:03:45.048 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:03:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:03:44.748+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:45.048 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:03:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:03:44.748+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:45.048 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:03:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:03:44.748+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:45.048 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:03:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:03:44.748+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:45.048 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:03:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:03:44.748+0000 7f9b6c26d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:03:45.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.086+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3630062e90 con 0x7f3630100d00 2024-09-19T09:03:45.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.087+0000 7f36267fc640 1 -- 172.21.15.1:0/3448693788 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7f36200bc6a0 con 0x7f3630100d00 2024-09-19T09:03:45.088 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:45.088 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.089+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f361c0a3250 msgr2=0x7f361c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.089+0000 7f363784c640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f361c0a3250 0x7f361c0a5710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f362c0058c0 tx=0x7f362c005850 comp rx=0 tx=0).stop 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.089+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 msgr2=0x7f363019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.089+0000 7f363784c640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 0x7f363019a660 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3620009a20 tx=0x7f3620004430 comp rx=0 tx=0).stop 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.090+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 shutdown_connections 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.090+0000 7f363784c640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36301016a0 0x7f36301a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.090+0000 7f363784c640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3630100d00 0x7f363019a660 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.090+0000 7f363784c640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f361c0a3250 0x7f361c0a5710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.090+0000 7f363784c640 1 --2- 172.21.15.1:0/3448693788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36301003c0 0x7f363019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.090+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 >> 172.21.15.1:0/3448693788 conn(0x7f36300fc190 msgr2=0x7f36300fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.090+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 shutdown_connections 2024-09-19T09:03:45.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.090+0000 7f363784c640 1 -- 172.21.15.1:0/3448693788 wait complete. 2024-09-19T09:03:45.101 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:57:30.365239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:01:58.505972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:02:00.589422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:03:45.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:03:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 -- 172.21.15.1:0/11932573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c0104ee0 msgr2=0x7f72c01072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 --2- 172.21.15.1:0/11932573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c0104ee0 0x7f72c01072d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009900 tx=0x7f72b402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 -- 172.21.15.1:0/11932573 shutdown_connections 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 --2- 172.21.15.1:0/11932573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72c0107810 0x7f72c0109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 --2- 172.21.15.1:0/11932573 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c0104ee0 0x7f72c01072d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 --2- 172.21.15.1:0/11932573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c01025b0 0x7f72c01049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 -- 172.21.15.1:0/11932573 >> 172.21.15.1:0/11932573 conn(0x7f72c00fc190 msgr2=0x7f72c00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 -- 172.21.15.1:0/11932573 shutdown_connections 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.207+0000 7f72c58af640 1 -- 172.21.15.1:0/11932573 wait complete. 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72c58af640 1 Processor -- start 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72c58af640 1 -- start start 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72c58af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c01025b0 0x7f72c0101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72c58af640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72c0104ee0 0x7f72c0100560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72c58af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c0107810 0x7f72c0100aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72c58af640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f72c010d900 con 0x7f72c01025b0 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72c58af640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72c010d780 con 0x7f72c0104ee0 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72c58af640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f72c010da80 con 0x7f72c0107810 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72beffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c01025b0 0x7f72c0101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72beffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c01025b0 0x7f72c0101f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60270/0 (socket says 172.21.15.1:60270) 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.208+0000 7f72beffd640 1 -- 172.21.15.1:0/2480494179 learned_addr learned my addr 172.21.15.1:0/2480494179 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72bf7fe640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c0107810 0x7f72c0100aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72be7fc640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72c0104ee0 0x7f72c0100560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72beffd640 1 -- 172.21.15.1:0/2480494179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c0107810 msgr2=0x7f72c0100aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72beffd640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c0107810 0x7f72c0100aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72beffd640 1 -- 172.21.15.1:0/2480494179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72c0104ee0 msgr2=0x7f72c0100560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72beffd640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72c0104ee0 0x7f72c0100560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72beffd640 1 -- 172.21.15.1:0/2480494179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c0101330 con 0x7f72c01025b0 2024-09-19T09:03:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72bf7fe640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c0107810 0x7f72c0100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72beffd640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c01025b0 0x7f72c0101f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f72b000eab0 tx=0x7f72b000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72c48ad640 1 -- 172.21.15.1:0/2480494179 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b000ce40 con 0x7f72c01025b0 2024-09-19T09:03:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72c48ad640 1 -- 172.21.15.1:0/2480494179 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f72b0011970 con 0x7f72c01025b0 2024-09-19T09:03:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72c48ad640 1 -- 172.21.15.1:0/2480494179 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0010bb0 con 0x7f72c01025b0 2024-09-19T09:03:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c01a20b0 con 0x7f72c01025b0 2024-09-19T09:03:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.209+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01a25b0 con 0x7f72c01025b0 2024-09-19T09:03:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.210+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c00fdc80 con 0x7f72c01025b0 2024-09-19T09:03:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.211+0000 7f72c48ad640 1 -- 172.21.15.1:0/2480494179 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f72b0010d50 con 0x7f72c01025b0 2024-09-19T09:03:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.212+0000 7f72c48ad640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f72a80a32d0 0x7f72a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.212+0000 7f72be7fc640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f72a80a32d0 0x7f72a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.212+0000 7f72c48ad640 1 -- 172.21.15.1:0/2480494179 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f72b00cfff0 con 0x7f72c01025b0 2024-09-19T09:03:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.213+0000 7f72be7fc640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f72a80a32d0 0x7f72a80a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72b4006010 tx=0x7f72b4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.216+0000 7f72c48ad640 1 -- 172.21.15.1:0/2480494179 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72b0016030 con 0x7f72c01025b0 2024-09-19T09:03:45.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.392+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f72c0062df0 con 0x7f72c01025b0 2024-09-19T09:03:45.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.392+0000 7f72c48ad640 1 -- 172.21.15.1:0/2480494179 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f72b009ccd0 con 0x7f72c01025b0 2024-09-19T09:03:45.394 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-19T09:03:45.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f72a80a32d0 msgr2=0x7f72a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f72a80a32d0 0x7f72a80a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72b4006010 tx=0x7f72b4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c01025b0 msgr2=0x7f72c0101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c01025b0 0x7f72c0101f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f72b000eab0 tx=0x7f72b000ef70 comp rx=0 tx=0).stop 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 shutdown_connections 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f72a80a32d0 0x7f72a80a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c0107810 0x7f72c0100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72c0104ee0 0x7f72c0100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 --2- 172.21.15.1:0/2480494179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72c01025b0 0x7f72c0101f20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.394+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 >> 172.21.15.1:0/2480494179 conn(0x7f72c00fc190 msgr2=0x7f72c0102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.395+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 shutdown_connections 2024-09-19T09:03:45.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.395+0000 7f72c58af640 1 -- 172.21.15.1:0/2480494179 wait complete. 2024-09-19T09:03:45.408 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:03:45.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 -- 172.21.15.1:0/4181448802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc102d10 msgr2=0x7f4afc103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 --2- 172.21.15.1:0/4181448802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc102d10 0x7f4afc103190 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009900 tx=0x7f4af002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:45.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 -- 172.21.15.1:0/4181448802 shutdown_connections 2024-09-19T09:03:45.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 --2- 172.21.15.1:0/4181448802 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4afc1036d0 0x7f4afc109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 --2- 172.21.15.1:0/4181448802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc102d10 0x7f4afc103190 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 --2- 172.21.15.1:0/4181448802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4afc101b20 0x7f4afc101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 -- 172.21.15.1:0/4181448802 >> 172.21.15.1:0/4181448802 conn(0x7f4afc0fd2a0 msgr2=0x7f4afc0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 -- 172.21.15.1:0/4181448802 shutdown_connections 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 -- 172.21.15.1:0/4181448802 wait complete. 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 Processor -- start 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 -- start start 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4afc101b20 0x7f4afc197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4afc102d10 0x7f4afc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.514+0000 7f4b0305e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc1036d0 0x7f4afc19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b0305e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc10d900 con 0x7f4afc1036d0 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b0305e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc10d780 con 0x7f4afc102d10 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b0305e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc10da80 con 0x7f4afc101b20 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc1036d0 0x7f4afc19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc1036d0 0x7f4afc19f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60286/0 (socket says 172.21.15.1:60286) 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 -- 172.21.15.1:0/2694714914 learned_addr learned my addr 172.21.15.1:0/2694714914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b00dfa640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4afc101b20 0x7f4afc197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4afbfff640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4afc102d10 0x7f4afc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 -- 172.21.15.1:0/2694714914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4afc101b20 msgr2=0x7f4afc197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4afc101b20 0x7f4afc197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 -- 172.21.15.1:0/2694714914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4afc102d10 msgr2=0x7f4afc198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4afc102d10 0x7f4afc198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 -- 172.21.15.1:0/2694714914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc19fb50 con 0x7f4afc1036d0 2024-09-19T09:03:45.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b015fb640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc1036d0 0x7f4afc19f4e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4af400cad0 tx=0x7f4af400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4af9ffb640 1 -- 172.21.15.1:0/2694714914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af400ae20 con 0x7f4afc1036d0 2024-09-19T09:03:45.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4af9ffb640 1 -- 172.21.15.1:0/2694714914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4af4004b20 con 0x7f4afc1036d0 2024-09-19T09:03:45.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4afc19fe40 con 0x7f4afc1036d0 2024-09-19T09:03:45.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.515+0000 7f4af9ffb640 1 -- 172.21.15.1:0/2694714914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af400f780 con 0x7f4afc1036d0 2024-09-19T09:03:45.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.516+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4afc1a0300 con 0x7f4afc1036d0 2024-09-19T09:03:45.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.516+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4afc108f60 con 0x7f4afc1036d0 2024-09-19T09:03:45.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.518+0000 7f4af9ffb640 1 -- 172.21.15.1:0/2694714914 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4af4004cd0 con 0x7f4afc1036d0 2024-09-19T09:03:45.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.518+0000 7f4af9ffb640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4ae40a3250 0x7f4ae40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.518+0000 7f4af9ffb640 1 -- 172.21.15.1:0/2694714914 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4af40cf810 con 0x7f4afc1036d0 2024-09-19T09:03:45.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.518+0000 7f4b00dfa640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4ae40a3250 0x7f4ae40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.519+0000 7f4b00dfa640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4ae40a3250 0x7f4ae40a5710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4aec005fd0 tx=0x7f4aec00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.522+0000 7f4af9ffb640 1 -- 172.21.15.1:0/2694714914 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4af4014030 con 0x7f4afc1036d0 2024-09-19T09:03:45.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.703+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4afc062e90 con 0x7f4afc1036d0 2024-09-19T09:03:45.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.704+0000 7f4af9ffb640 1 -- 172.21.15.1:0/2694714914 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7f4af409bec0 con 0x7f4afc1036d0 2024-09-19T09:03:45.705 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4ae40a3250 msgr2=0x7f4ae40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4ae40a3250 0x7f4ae40a5710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4aec005fd0 tx=0x7f4aec00b410 comp rx=0 tx=0).stop 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc1036d0 msgr2=0x7f4afc19f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc1036d0 0x7f4afc19f4e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4af400cad0 tx=0x7f4af400cf90 comp rx=0 tx=0).stop 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 shutdown_connections 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4afc1036d0 0x7f4afc19f4e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4afc102d10 0x7f4afc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4ae40a3250 0x7f4ae40a5710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 --2- 172.21.15.1:0/2694714914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4afc101b20 0x7f4afc197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 >> 172.21.15.1:0/2694714914 conn(0x7f4afc0fd2a0 msgr2=0x7f4afc106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 shutdown_connections 2024-09-19T09:03:45.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.706+0000 7f4b0305e640 1 -- 172.21.15.1:0/2694714914 wait complete. 2024-09-19T09:03:45.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:45 smithi022 ceph-mon[35107]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:03:45.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:45 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3892004171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T09:03:45.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:45 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:03:45.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:45 smithi022 ceph-mon[35107]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:45.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:45 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3448693788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:45.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:45 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2480494179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:03:45.716 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:45 smithi001 ceph-mon[30939]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:03:45.716 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:45 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3892004171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T09:03:45.716 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:45 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:03:45.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:45 smithi001 ceph-mon[30939]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:45.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:45 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3448693788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:45.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:45 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2480494179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:03:45.718 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:03:45.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 -- 172.21.15.1:0/1842384880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 msgr2=0x7f30b81020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 --2- 172.21.15.1:0/1842384880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 0x7f30b81020c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009900 tx=0x7f30ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 -- 172.21.15.1:0/1842384880 shutdown_connections 2024-09-19T09:03:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 --2- 172.21.15.1:0/1842384880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30b8102600 0x7f30b8108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 --2- 172.21.15.1:0/1842384880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 0x7f30b81020c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 --2- 172.21.15.1:0/1842384880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30b8100a50 0x7f30b8100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 -- 172.21.15.1:0/1842384880 >> 172.21.15.1:0/1842384880 conn(0x7f30b80fc190 msgr2=0x7f30b80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 -- 172.21.15.1:0/1842384880 shutdown_connections 2024-09-19T09:03:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 -- 172.21.15.1:0/1842384880 wait complete. 2024-09-19T09:03:45.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.823+0000 7f30bdb28640 1 Processor -- start 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30bdb28640 1 -- start start 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30bdb28640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30b8100a50 0x7f30b806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30bdb28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 0x7f30b819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30bdb28640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30b8102600 0x7f30b819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30bdb28640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30b810c830 con 0x7f30b8101c40 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30bdb28640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30b810c6b0 con 0x7f30b8102600 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30bdb28640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f30b810c9b0 con 0x7f30b8100a50 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 0x7f30b819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 0x7f30b819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60310/0 (socket says 172.21.15.1:60310) 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b6ffd640 1 -- 172.21.15.1:0/3373584030 learned_addr learned my addr 172.21.15.1:0/3373584030 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b77fe640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30b8100a50 0x7f30b806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b7fff640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30b8102600 0x7f30b819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b6ffd640 1 -- 172.21.15.1:0/3373584030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30b8100a50 msgr2=0x7f30b806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b6ffd640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30b8100a50 0x7f30b806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b6ffd640 1 -- 172.21.15.1:0/3373584030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30b8102600 msgr2=0x7f30b819f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b6ffd640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30b8102600 0x7f30b819f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.824+0000 7f30b6ffd640 1 -- 172.21.15.1:0/3373584030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b819fc40 con 0x7f30b8101c40 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.825+0000 7f30b6ffd640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 0x7f30b819cd10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0316a0 tx=0x7f30ac004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.825+0000 7f30b4ff9640 1 -- 172.21.15.1:0/3373584030 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac03f030 con 0x7f30b8101c40 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.825+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b819fe70 con 0x7f30b8101c40 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.825+0000 7f30b4ff9640 1 -- 172.21.15.1:0/3373584030 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30ac003d00 con 0x7f30b8101c40 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.825+0000 7f30b4ff9640 1 -- 172.21.15.1:0/3373584030 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac035070 con 0x7f30b8101c40 2024-09-19T09:03:45.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.825+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b81a02d0 con 0x7f30b8101c40 2024-09-19T09:03:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.826+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b8107e40 con 0x7f30b8101c40 2024-09-19T09:03:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.827+0000 7f30b4ff9640 1 -- 172.21.15.1:0/3373584030 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f30ac042030 con 0x7f30b8101c40 2024-09-19T09:03:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.828+0000 7f30b4ff9640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30a00a3250 0x7f30a00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.828+0000 7f30b77fe640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30a00a3250 0x7f30a00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.828+0000 7f30b4ff9640 1 -- 172.21.15.1:0/3373584030 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f30ac0efef0 con 0x7f30b8101c40 2024-09-19T09:03:45.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.828+0000 7f30b77fe640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30a00a3250 0x7f30a00a5710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30b8101aa0 tx=0x7f30a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:45.832+0000 7f30b4ff9640 1 -- 172.21.15.1:0/3373584030 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f30ac0bc540 con 0x7f30b8101c40 2024-09-19T09:03:45.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:45 smithi064 ceph-mon[35179]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:03:45.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:45 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3892004171' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T09:03:45.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:45 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:03:45.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:45 smithi064 ceph-mon[35179]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:03:45.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:45 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3448693788' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:45.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:45 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2480494179' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:03:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.007+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f30b8062e90 con 0x7f30b8101c40 2024-09-19T09:03:46.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.007+0000 7f30b4ff9640 1 -- 172.21.15.1:0/3373584030 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7f30ac0c0840 con 0x7f30b8101c40 2024-09-19T09:03:46.008 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30a00a3250 msgr2=0x7f30a00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30a00a3250 0x7f30a00a5710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30b8101aa0 tx=0x7f30a800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 msgr2=0x7f30b819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 0x7f30b819cd10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0316a0 tx=0x7f30ac004430 comp rx=0 tx=0).stop 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 shutdown_connections 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30b8102600 0x7f30b819f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30b8101c40 0x7f30b819cd10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30a00a3250 0x7f30a00a5710 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 --2- 172.21.15.1:0/3373584030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30b8100a50 0x7f30b806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.009+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 >> 172.21.15.1:0/3373584030 conn(0x7f30b80fc190 msgr2=0x7f30b8105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.010+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 shutdown_connections 2024-09-19T09:03:46.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.010+0000 7f30bdb28640 1 -- 172.21.15.1:0/3373584030 wait complete. 2024-09-19T09:03:46.022 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T09:03:46.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:46.278 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:46.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:46 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2694714914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:03:46.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:46 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3373584030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:03:46.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:46 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2694714914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:03:46.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:46 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3373584030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/1545938269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 msgr2=0x7fe5d4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/1545938269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 0x7fe5d4100f10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009900 tx=0x7fe5c402a470 comp rx=0 tx=0).stop 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/1545938269 shutdown_connections 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/1545938269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5d4105f40 0x7fe5d41063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/1545938269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5d4101450 0x7fe5d4105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/1545938269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 0x7fe5d4100f10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/1545938269 >> 172.21.15.1:0/1545938269 conn(0x7fe5d40fc7a0 msgr2=0x7fe5d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/1545938269 shutdown_connections 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.748+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/1545938269 wait complete. 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.749+0000 7fe5d8c9a640 1 Processor -- start 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.749+0000 7fe5d8c9a640 1 -- start start 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.749+0000 7fe5d8c9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 0x7fe5d41a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.749+0000 7fe5d8c9a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5d4101450 0x7fe5d41a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d8c9a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5d4105f40 0x7fe5d419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d8c9a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41186a0 con 0x7fe5d4100b30 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d8c9a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d4118520 con 0x7fe5d4105f40 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d8c9a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d4118820 con 0x7fe5d4101450 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 0x7fe5d41a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 0x7fe5d41a47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60322/0 (socket says 172.21.15.1:60322) 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 -- 172.21.15.1:0/2856510391 learned_addr learned my addr 172.21.15.1:0/2856510391 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5cbfff640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5d4101450 0x7fe5d41a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d2d9d640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5d4105f40 0x7fe5d419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 -- 172.21.15.1:0/2856510391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5d4101450 msgr2=0x7fe5d41a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5d4101450 0x7fe5d41a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 -- 172.21.15.1:0/2856510391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5d4105f40 msgr2=0x7fe5d419e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5d4105f40 0x7fe5d419e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 -- 172.21.15.1:0/2856510391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d419f0e0 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d2d9d640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5d4105f40 0x7fe5d419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d259c640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 0x7fe5d41a47f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4006010 tx=0x7fe5c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5cb7fe640 1 -- 172.21.15.1:0/2856510391 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c403f030 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d419f370 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5cb7fe640 1 -- 172.21.15.1:0/2856510391 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe5c4003d00 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5cb7fe640 1 -- 172.21.15.1:0/2856510391 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4035070 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.750+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d41ab6c0 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.751+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d4105920 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.753+0000 7fe5cb7fe640 1 -- 172.21.15.1:0/2856510391 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fe5c4042030 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.753+0000 7fe5cb7fe640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe5c00a32d0 0x7fe5c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.753+0000 7fe5cbfff640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe5c00a32d0 0x7fe5c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.753+0000 7fe5cb7fe640 1 -- 172.21.15.1:0/2856510391 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe5c40f0440 con 0x7fe5d4100b30 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.754+0000 7fe5cbfff640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe5c00a32d0 0x7fe5c00a5790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40ffe70 tx=0x7fe5bc00b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.757+0000 7fe5cb7fe640 1 -- 172.21.15.1:0/2856510391 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5c40bd0a0 con 0x7fe5d4100b30 2024-09-19T09:03:46.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:46 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2694714914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:03:46.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:46 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3373584030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:03:46.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.975+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5d419fee0 con 0x7fe5d4100b30 2024-09-19T09:03:46.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.976+0000 7fe5cb7fe640 1 -- 172.21.15.1:0/2856510391 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7fe5c40bc9a0 con 0x7fe5d4100b30 2024-09-19T09:03:46.977 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:46.978 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:03:46.978 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.978+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe5c00a32d0 msgr2=0x7fe5c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.978+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe5c00a32d0 0x7fe5c00a5790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40ffe70 tx=0x7fe5bc00b2e0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 msgr2=0x7fe5d41a47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 0x7fe5d41a47f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4006010 tx=0x7fe5c40042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 shutdown_connections 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5d4105f40 0x7fe5d419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe5c00a32d0 0x7fe5c00a5790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5d4101450 0x7fe5d41a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 --2- 172.21.15.1:0/2856510391 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5d4100b30 0x7fe5d41a47f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 >> 172.21.15.1:0/2856510391 conn(0x7fe5d40fc7a0 msgr2=0x7fe5d41038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 shutdown_connections 2024-09-19T09:03:46.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:46.979+0000 7fe5d8c9a640 1 -- 172.21.15.1:0/2856510391 wait complete. 2024-09-19T09:03:47.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:47 smithi022 ceph-mon[35107]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:03:47.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:47 smithi022 ceph-mon[35107]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T09:03:47.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:47 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2856510391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:47.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:47 smithi001 ceph-mon[30939]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:03:47.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:47 smithi001 ceph-mon[30939]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T09:03:47.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:47 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2856510391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:47.784 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T09:03:47.784 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T09:03:47.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:03:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:47 smithi064 ceph-mon[35179]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:03:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:47 smithi064 ceph-mon[35179]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T09:03:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:47 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2856510391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 -- 172.21.15.1:0/2507998276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac104f00 msgr2=0x7f43ac1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 --2- 172.21.15.1:0/2507998276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac104f00 0x7f43ac1072f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009900 tx=0x7f43a002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 -- 172.21.15.1:0/2507998276 shutdown_connections 2024-09-19T09:03:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 --2- 172.21.15.1:0/2507998276 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ac107830 0x7f43ac109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 --2- 172.21.15.1:0/2507998276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac104f00 0x7f43ac1072f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 --2- 172.21.15.1:0/2507998276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ac1025d0 0x7f43ac1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 -- 172.21.15.1:0/2507998276 >> 172.21.15.1:0/2507998276 conn(0x7f43ac0fc1f0 msgr2=0x7f43ac0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 -- 172.21.15.1:0/2507998276 shutdown_connections 2024-09-19T09:03:47.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.897+0000 7f43b1931640 1 -- 172.21.15.1:0/2507998276 wait complete. 2024-09-19T09:03:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43b1931640 1 Processor -- start 2024-09-19T09:03:47.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43b1931640 1 -- start start 2024-09-19T09:03:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43b1931640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac1025d0 0x7f43ac197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43b1931640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ac104f00 0x7f43ac1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43b1931640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ac107830 0x7f43ac19f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43b1931640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac10d920 con 0x7f43ac1025d0 2024-09-19T09:03:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43b1931640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac10d7a0 con 0x7f43ac107830 2024-09-19T09:03:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43b1931640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac10daa0 con 0x7f43ac104f00 2024-09-19T09:03:47.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43aaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac1025d0 0x7f43ac197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43aaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac1025d0 0x7f43ac197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60330/0 (socket says 172.21.15.1:60330) 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.898+0000 7f43aaffd640 1 -- 172.21.15.1:0/2316197475 learned_addr learned my addr 172.21.15.1:0/2316197475 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43aa7fc640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ac104f00 0x7f43ac1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43ab7fe640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ac107830 0x7f43ac19f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43aaffd640 1 -- 172.21.15.1:0/2316197475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ac104f00 msgr2=0x7f43ac1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43aaffd640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ac104f00 0x7f43ac1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43aaffd640 1 -- 172.21.15.1:0/2316197475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ac107830 msgr2=0x7f43ac19f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43aaffd640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ac107830 0x7f43ac19f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43aaffd640 1 -- 172.21.15.1:0/2316197475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac19fba0 con 0x7f43ac1025d0 2024-09-19T09:03:47.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43aaffd640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac1025d0 0x7f43ac197f80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f439c00eab0 tx=0x7f439c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43b092f640 1 -- 172.21.15.1:0/2316197475 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c00ce40 con 0x7f43ac1025d0 2024-09-19T09:03:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac19fe90 con 0x7f43ac1025d0 2024-09-19T09:03:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43b092f640 1 -- 172.21.15.1:0/2316197475 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f439c011970 con 0x7f43ac1025d0 2024-09-19T09:03:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43b092f640 1 -- 172.21.15.1:0/2316197475 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c010bb0 con 0x7f43ac1025d0 2024-09-19T09:03:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.899+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac1a0300 con 0x7f43ac1025d0 2024-09-19T09:03:47.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.900+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ac0fdce0 con 0x7f43ac1025d0 2024-09-19T09:03:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.901+0000 7f43b092f640 1 -- 172.21.15.1:0/2316197475 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f439c010d50 con 0x7f43ac1025d0 2024-09-19T09:03:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.902+0000 7f43b092f640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43940a32e0 0x7f43940a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.902+0000 7f43b092f640 1 -- 172.21.15.1:0/2316197475 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f439c0d0040 con 0x7f43ac1025d0 2024-09-19T09:03:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.902+0000 7f43aa7fc640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43940a32e0 0x7f43940a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:47.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.903+0000 7f43aa7fc640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43940a32e0 0x7f43940a57a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43a0031570 tx=0x7f43a0031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:47.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:47.906+0000 7f43b092f640 1 -- 172.21.15.1:0/2316197475 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f439c016030 con 0x7f43ac1025d0 2024-09-19T09:03:48.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.094+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43ac062630 con 0x7f43940a32e0 2024-09-19T09:03:48.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.101+0000 7f43b092f640 1 -- 172.21.15.1:0/2316197475 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258979 (secure 0 0 0) 0x7f43ac062630 con 0x7f43940a32e0 2024-09-19T09:03:48.108 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:48.111 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:03:48.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43940a32e0 msgr2=0x7f43940a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43940a32e0 0x7f43940a57a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f43a0031570 tx=0x7f43a0031640 comp rx=0 tx=0).stop 2024-09-19T09:03:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac1025d0 msgr2=0x7f43ac197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac1025d0 0x7f43ac197f80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f439c00eab0 tx=0x7f439c00ef70 comp rx=0 tx=0).stop 2024-09-19T09:03:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 shutdown_connections 2024-09-19T09:03:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ac107830 0x7f43ac19f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f43940a32e0 0x7f43940a57a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f43ac104f00 0x7f43ac1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 --2- 172.21.15.1:0/2316197475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ac1025d0 0x7f43ac197f80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 >> 172.21.15.1:0/2316197475 conn(0x7f43ac0fc1f0 msgr2=0x7f43ac102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 shutdown_connections 2024-09-19T09:03:48.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.104+0000 7f43b1931640 1 -- 172.21.15.1:0/2316197475 wait complete. 2024-09-19T09:03:48.116 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-19T09:03:47.962678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658006,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":715,"num_read_kb":474,"num_write":357,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":399096,"kb_used_data":12408,"kb_used_omap":18,"kb_used_meta":386477,"kb_avail":1124542728,"statfs":{"total":1151940427776,"available":1151531753472,"internally_reserved":0,"allocated":12705792,"data_stored":7092912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":395752764},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1091,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002826"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967625+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:03:39.967625+0000","last_peered":"2024-09-19T09:03:39.967625+0000","last_clean":"2024-09-19T09:03:39.967625+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:03:39.967625+0000","last_undegraded":"2024-09-19T09:03:39.967625+0000","last_fullsized":"2024-09-19T09:03:39.967625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951240+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:03:39.951240+0000","last_peered":"2024-09-19T09:03:39.951240+0000","last_clean":"2024-09-19T09:03:39.951240+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:03:39.951240+0000","last_undegraded":"2024-09-19T09:03:39.951240+0000","last_fullsized":"2024-09-19T09:03:39.951240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960322+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:03:39.960322+0000","last_peered":"2024-09-19T09:03:39.960322+0000","last_clean":"2024-09-19T09:03:39.960322+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:03:39.960322+0000","last_undegraded":"2024-09-19T09:03:39.960322+0000","last_fullsized":"2024-09-19T09:03:39.960322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950848+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:03:39.950848+0000","last_peered":"2024-09-19T09:03:39.950848+0000","last_clean":"2024-09-19T09:03:39.950848+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:03:39.950848+0000","last_undegraded":"2024-09-19T09:03:39.950848+0000","last_fullsized":"2024-09-19T09:03:39.950848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.936295+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:03:39.936295+0000","last_peered":"2024-09-19T09:03:39.936295+0000","last_clean":"2024-09-19T09:03:39.936295+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:03:39.936295+0000","last_undegraded":"2024-09-19T09:03:39.936295+0000","last_fullsized":"2024-09-19T09:03:39.936295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.956562+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:03:39.956562+0000","last_peered":"2024-09-19T09:03:39.956562+0000","last_clean":"2024-09-19T09:03:39.956562+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:03:39.956562+0000","last_undegraded":"2024-09-19T09:03:39.956562+0000","last_fullsized":"2024-09-19T09:03:39.956562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965237+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:03:39.965237+0000","last_peered":"2024-09-19T09:03:39.965237+0000","last_clean":"2024-09-19T09:03:39.965237+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:03:39.965237+0000","last_undegraded":"2024-09-19T09:03:39.965237+0000","last_fullsized":"2024-09-19T09:03:39.965237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957157+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:03:39.957157+0000","last_peered":"2024-09-19T09:03:39.957157+0000","last_clean":"2024-09-19T09:03:39.957157+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:03:39.957157+0000","last_undegraded":"2024-09-19T09:03:39.957157+0000","last_fullsized":"2024-09-19T09:03:39.957157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966943+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:03:39.966943+0000","last_peered":"2024-09-19T09:03:39.966943+0000","last_clean":"2024-09-19T09:03:39.966943+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:03:39.966943+0000","last_undegraded":"2024-09-19T09:03:39.966943+0000","last_fullsized":"2024-09-19T09:03:39.966943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.958176+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:03:39.958176+0000","last_peered":"2024-09-19T09:03:39.958176+0000","last_clean":"2024-09-19T09:03:39.958176+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:03:39.958176+0000","last_undegraded":"2024-09-19T09:03:39.958176+0000","last_fullsized":"2024-09-19T09:03:39.958176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964976+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:03:39.964976+0000","last_peered":"2024-09-19T09:03:39.964976+0000","last_clean":"2024-09-19T09:03:39.964976+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:03:39.964976+0000","last_undegraded":"2024-09-19T09:03:39.964976+0000","last_fullsized":"2024-09-19T09:03:39.964976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941887+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:03:39.941887+0000","last_peered":"2024-09-19T09:03:39.941887+0000","last_clean":"2024-09-19T09:03:39.941887+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:03:39.941887+0000","last_undegraded":"2024-09-19T09:03:39.941887+0000","last_fullsized":"2024-09-19T09:03:39.941887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.948226+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:03:39.948226+0000","last_peered":"2024-09-19T09:03:39.948226+0000","last_clean":"2024-09-19T09:03:39.948226+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:03:39.948226+0000","last_undegraded":"2024-09-19T09:03:39.948226+0000","last_fullsized":"2024-09-19T09:03:39.948226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951997+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:03:39.951997+0000","last_peered":"2024-09-19T09:03:39.951997+0000","last_clean":"2024-09-19T09:03:39.951997+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:03:39.951997+0000","last_undegraded":"2024-09-19T09:03:39.951997+0000","last_fullsized":"2024-09-19T09:03:39.951997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950575+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:03:39.950575+0000","last_peered":"2024-09-19T09:03:39.950575+0000","last_clean":"2024-09-19T09:03:39.950575+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:03:39.950575+0000","last_undegraded":"2024-09-19T09:03:39.950575+0000","last_fullsized":"2024-09-19T09:03:39.950575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.963547+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:03:39.963547+0000","last_peered":"2024-09-19T09:03:39.963547+0000","last_clean":"2024-09-19T09:03:39.963547+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:03:39.963547+0000","last_undegraded":"2024-09-19T09:03:39.963547+0000","last_fullsized":"2024-09-19T09:03:39.963547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967695+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:03:39.967695+0000","last_peered":"2024-09-19T09:03:39.967695+0000","last_clean":"2024-09-19T09:03:39.967695+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:03:39.967695+0000","last_undegraded":"2024-09-19T09:03:39.967695+0000","last_fullsized":"2024-09-19T09:03:39.967695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962356+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:03:39.962356+0000","last_peered":"2024-09-19T09:03:39.962356+0000","last_clean":"2024-09-19T09:03:39.962356+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:03:39.962356+0000","last_undegraded":"2024-09-19T09:03:39.962356+0000","last_fullsized":"2024-09-19T09:03:39.962356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957485+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:03:39.957485+0000","last_peered":"2024-09-19T09:03:39.957485+0000","last_clean":"2024-09-19T09:03:39.957485+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:03:39.957485+0000","last_undegraded":"2024-09-19T09:03:39.957485+0000","last_fullsized":"2024-09-19T09:03:39.957485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957966+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:03:39.957966+0000","last_peered":"2024-09-19T09:03:39.957966+0000","last_clean":"2024-09-19T09:03:39.957966+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:03:39.957966+0000","last_undegraded":"2024-09-19T09:03:39.957966+0000","last_fullsized":"2024-09-19T09:03:39.957966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979621+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:03:39.979621+0000","last_peered":"2024-09-19T09:03:39.979621+0000","last_clean":"2024-09-19T09:03:39.979621+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:03:39.979621+0000","last_undegraded":"2024-09-19T09:03:39.979621+0000","last_fullsized":"2024-09-19T09:03:39.979621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965614+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:03:39.965614+0000","last_peered":"2024-09-19T09:03:39.965614+0000","last_clean":"2024-09-19T09:03:39.965614+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:03:39.965614+0000","last_undegraded":"2024-09-19T09:03:39.965614+0000","last_fullsized":"2024-09-19T09:03:39.965614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955089+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:03:39.955089+0000","last_peered":"2024-09-19T09:03:39.955089+0000","last_clean":"2024-09-19T09:03:39.955089+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:03:39.955089+0000","last_undegraded":"2024-09-19T09:03:39.955089+0000","last_fullsized":"2024-09-19T09:03:39.955089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952591+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:03:39.952591+0000","last_peered":"2024-09-19T09:03:39.952591+0000","last_clean":"2024-09-19T09:03:39.952591+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:03:39.952591+0000","last_undegraded":"2024-09-19T09:03:39.952591+0000","last_fullsized":"2024-09-19T09:03:39.952591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950831+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:03:39.950831+0000","last_peered":"2024-09-19T09:03:39.950831+0000","last_clean":"2024-09-19T09:03:39.950831+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:03:39.950831+0000","last_undegraded":"2024-09-19T09:03:39.950831+0000","last_fullsized":"2024-09-19T09:03:39.950831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966529+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:03:39.966529+0000","last_peered":"2024-09-19T09:03:39.966529+0000","last_clean":"2024-09-19T09:03:39.966529+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:03:39.966529+0000","last_undegraded":"2024-09-19T09:03:39.966529+0000","last_fullsized":"2024-09-19T09:03:39.966529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952375+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:03:39.952375+0000","last_peered":"2024-09-19T09:03:39.952375+0000","last_clean":"2024-09-19T09:03:39.952375+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:03:39.952375+0000","last_undegraded":"2024-09-19T09:03:39.952375+0000","last_fullsized":"2024-09-19T09:03:39.952375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950943+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:03:39.950943+0000","last_peered":"2024-09-19T09:03:39.950943+0000","last_clean":"2024-09-19T09:03:39.950943+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:03:39.950943+0000","last_undegraded":"2024-09-19T09:03:39.950943+0000","last_fullsized":"2024-09-19T09:03:39.950943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955565+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:03:39.955565+0000","last_peered":"2024-09-19T09:03:39.955565+0000","last_clean":"2024-09-19T09:03:39.955565+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:03:39.955565+0000","last_undegraded":"2024-09-19T09:03:39.955565+0000","last_fullsized":"2024-09-19T09:03:39.955565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957500+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:03:39.957500+0000","last_peered":"2024-09-19T09:03:39.957500+0000","last_clean":"2024-09-19T09:03:39.957500+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:03:39.957500+0000","last_undegraded":"2024-09-19T09:03:39.957500+0000","last_fullsized":"2024-09-19T09:03:39.957500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955901+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:03:39.955901+0000","last_peered":"2024-09-19T09:03:39.955901+0000","last_clean":"2024-09-19T09:03:39.955901+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:03:39.955901+0000","last_undegraded":"2024-09-19T09:03:39.955901+0000","last_fullsized":"2024-09-19T09:03:39.955901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959198+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:03:39.959198+0000","last_peered":"2024-09-19T09:03:39.959198+0000","last_clean":"2024-09-19T09:03:39.959198+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:03:39.959198+0000","last_undegraded":"2024-09-19T09:03:39.959198+0000","last_fullsized":"2024-09-19T09:03:39.959198+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952610+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:03:39.952610+0000","last_peered":"2024-09-19T09:03:39.952610+0000","last_clean":"2024-09-19T09:03:39.952610+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:03:39.952610+0000","last_undegraded":"2024-09-19T09:03:39.952610+0000","last_fullsized":"2024-09-19T09:03:39.952610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:44.654408+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:03:44.654408+0000","last_peered":"2024-09-19T09:03:44.654408+0000","last_clean":"2024-09-19T09:03:44.654408+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:03:44.654408+0000","last_undegraded":"2024-09-19T09:03:44.654408+0000","last_fullsized":"2024-09-19T09:03:44.654408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950481+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:03:39.950481+0000","last_peered":"2024-09-19T09:03:39.950481+0000","last_clean":"2024-09-19T09:03:39.950481+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:03:39.950481+0000","last_undegraded":"2024-09-19T09:03:39.950481+0000","last_fullsized":"2024-09-19T09:03:39.950481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953709+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:03:39.953709+0000","last_peered":"2024-09-19T09:03:39.953709+0000","last_clean":"2024-09-19T09:03:39.953709+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:03:39.953709+0000","last_undegraded":"2024-09-19T09:03:39.953709+0000","last_fullsized":"2024-09-19T09:03:39.953709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954288+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:03:39.954288+0000","last_peered":"2024-09-19T09:03:39.954288+0000","last_clean":"2024-09-19T09:03:39.954288+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:03:39.954288+0000","last_undegraded":"2024-09-19T09:03:39.954288+0000","last_fullsized":"2024-09-19T09:03:39.954288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:42.650304+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:03:42.650304+0000","last_peered":"2024-09-19T09:03:42.650304+0000","last_clean":"2024-09-19T09:03:42.650304+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:03:42.650304+0000","last_undegraded":"2024-09-19T09:03:42.650304+0000","last_fullsized":"2024-09-19T09:03:42.650304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967297+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:03:39.967297+0000","last_peered":"2024-09-19T09:03:39.967297+0000","last_clean":"2024-09-19T09:03:39.967297+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:03:39.967297+0000","last_undegraded":"2024-09-19T09:03:39.967297+0000","last_fullsized":"2024-09-19T09:03:39.967297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953419+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:03:39.953419+0000","last_peered":"2024-09-19T09:03:39.953419+0000","last_clean":"2024-09-19T09:03:39.953419+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:03:39.953419+0000","last_undegraded":"2024-09-19T09:03:39.953419+0000","last_fullsized":"2024-09-19T09:03:39.953419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966193+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:03:39.966193+0000","last_peered":"2024-09-19T09:03:39.966193+0000","last_clean":"2024-09-19T09:03:39.966193+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:03:39.966193+0000","last_undegraded":"2024-09-19T09:03:39.966193+0000","last_fullsized":"2024-09-19T09:03:39.966193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'34","reported_seq":253,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:43.838828+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:03:43.838828+0000","last_peered":"2024-09-19T09:03:43.838828+0000","last_clean":"2024-09-19T09:03:43.838828+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:03:43.838828+0000","last_undegraded":"2024-09-19T09:03:43.838828+0000","last_fullsized":"2024-09-19T09:03:43.838828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":160,"num_write":35,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.961829+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:03:39.961829+0000","last_peered":"2024-09-19T09:03:39.961829+0000","last_clean":"2024-09-19T09:03:39.961829+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:03:39.961829+0000","last_undegraded":"2024-09-19T09:03:39.961829+0000","last_fullsized":"2024-09-19T09:03:39.961829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979339+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:03:39.979339+0000","last_peered":"2024-09-19T09:03:39.979339+0000","last_clean":"2024-09-19T09:03:39.979339+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:03:39.979339+0000","last_undegraded":"2024-09-19T09:03:39.979339+0000","last_fullsized":"2024-09-19T09:03:39.979339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966978+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:03:39.966978+0000","last_peered":"2024-09-19T09:03:39.966978+0000","last_clean":"2024-09-19T09:03:39.966978+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:03:39.966978+0000","last_undegraded":"2024-09-19T09:03:39.966978+0000","last_fullsized":"2024-09-19T09:03:39.966978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:42.826838+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:03:42.826838+0000","last_peered":"2024-09-19T09:03:42.826838+0000","last_clean":"2024-09-19T09:03:42.826838+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:03:42.826838+0000","last_undegraded":"2024-09-19T09:03:42.826838+0000","last_fullsized":"2024-09-19T09:03:42.826838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962145+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:03:39.962145+0000","last_peered":"2024-09-19T09:03:39.962145+0000","last_clean":"2024-09-19T09:03:39.962145+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:03:39.962145+0000","last_undegraded":"2024-09-19T09:03:39.962145+0000","last_fullsized":"2024-09-19T09:03:39.962145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959818+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:03:39.959818+0000","last_peered":"2024-09-19T09:03:39.959818+0000","last_clean":"2024-09-19T09:03:39.959818+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:03:39.959818+0000","last_undegraded":"2024-09-19T09:03:39.959818+0000","last_fullsized":"2024-09-19T09:03:39.959818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957934+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:03:39.957934+0000","last_peered":"2024-09-19T09:03:39.957934+0000","last_clean":"2024-09-19T09:03:39.957934+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:03:39.957934+0000","last_undegraded":"2024-09-19T09:03:39.957934+0000","last_fullsized":"2024-09-19T09:03:39.957934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964690+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:03:39.964690+0000","last_peered":"2024-09-19T09:03:39.964690+0000","last_clean":"2024-09-19T09:03:39.964690+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:03:39.964690+0000","last_undegraded":"2024-09-19T09:03:39.964690+0000","last_fullsized":"2024-09-19T09:03:39.964690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962180+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:03:39.962180+0000","last_peered":"2024-09-19T09:03:39.962180+0000","last_clean":"2024-09-19T09:03:39.962180+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:03:39.962180+0000","last_undegraded":"2024-09-19T09:03:39.962180+0000","last_fullsized":"2024-09-19T09:03:39.962180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964213+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:03:39.964213+0000","last_peered":"2024-09-19T09:03:39.964213+0000","last_clean":"2024-09-19T09:03:39.964213+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:03:39.964213+0000","last_undegraded":"2024-09-19T09:03:39.964213+0000","last_fullsized":"2024-09-19T09:03:39.964213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688290+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688290+0000","last_peered":"2024-09-19T09:02:11.688290+0000","last_clean":"2024-09-19T09:02:11.688290+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688290+0000","last_undegraded":"2024-09-19T09:02:11.688290+0000","last_fullsized":"2024-09-19T09:02:11.688290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947301+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:03:39.947301+0000","last_peered":"2024-09-19T09:03:39.947301+0000","last_clean":"2024-09-19T09:03:39.947301+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:03:39.947301+0000","last_undegraded":"2024-09-19T09:03:39.947301+0000","last_fullsized":"2024-09-19T09:03:39.947301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953996+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:03:39.953996+0000","last_peered":"2024-09-19T09:03:39.953996+0000","last_clean":"2024-09-19T09:03:39.953996+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:03:39.953996+0000","last_undegraded":"2024-09-19T09:03:39.953996+0000","last_fullsized":"2024-09-19T09:03:39.953996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:41.824716+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:03:41.824716+0000","last_peered":"2024-09-19T09:03:41.824716+0000","last_clean":"2024-09-19T09:03:41.824716+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:03:41.824716+0000","last_undegraded":"2024-09-19T09:03:41.824716+0000","last_fullsized":"2024-09-19T09:03:41.824716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955511+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:03:39.955511+0000","last_peered":"2024-09-19T09:03:39.955511+0000","last_clean":"2024-09-19T09:03:39.955511+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:03:39.955511+0000","last_undegraded":"2024-09-19T09:03:39.955511+0000","last_fullsized":"2024-09-19T09:03:39.955511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957047+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:03:39.957047+0000","last_peered":"2024-09-19T09:03:39.957047+0000","last_clean":"2024-09-19T09:03:39.957047+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:03:39.957047+0000","last_undegraded":"2024-09-19T09:03:39.957047+0000","last_fullsized":"2024-09-19T09:03:39.957047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954576+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:03:39.954576+0000","last_peered":"2024-09-19T09:03:39.954576+0000","last_clean":"2024-09-19T09:03:39.954576+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:03:39.954576+0000","last_undegraded":"2024-09-19T09:03:39.954576+0000","last_fullsized":"2024-09-19T09:03:39.954576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953774+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:03:39.953774+0000","last_peered":"2024-09-19T09:03:39.953774+0000","last_clean":"2024-09-19T09:03:39.953774+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:03:39.953774+0000","last_undegraded":"2024-09-19T09:03:39.953774+0000","last_fullsized":"2024-09-19T09:03:39.953774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:40.675225+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:03:40.675225+0000","last_peered":"2024-09-19T09:03:40.675225+0000","last_clean":"2024-09-19T09:03:40.675225+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:03:40.675225+0000","last_undegraded":"2024-09-19T09:03:40.675225+0000","last_fullsized":"2024-09-19T09:03:40.675225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947181+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:03:39.947181+0000","last_peered":"2024-09-19T09:03:39.947181+0000","last_clean":"2024-09-19T09:03:39.947181+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:03:39.947181+0000","last_undegraded":"2024-09-19T09:03:39.947181+0000","last_fullsized":"2024-09-19T09:03:39.947181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950637+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:03:39.950637+0000","last_peered":"2024-09-19T09:03:39.950637+0000","last_clean":"2024-09-19T09:03:39.950637+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:03:39.950637+0000","last_undegraded":"2024-09-19T09:03:39.950637+0000","last_fullsized":"2024-09-19T09:03:39.950637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941644+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:03:39.941644+0000","last_peered":"2024-09-19T09:03:39.941644+0000","last_clean":"2024-09-19T09:03:39.941644+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:03:39.941644+0000","last_undegraded":"2024-09-19T09:03:39.941644+0000","last_fullsized":"2024-09-19T09:03:39.941644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959045+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:03:39.959045+0000","last_peered":"2024-09-19T09:03:39.959045+0000","last_clean":"2024-09-19T09:03:39.959045+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:03:39.959045+0000","last_undegraded":"2024-09-19T09:03:39.959045+0000","last_fullsized":"2024-09-19T09:03:39.959045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686861+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686861+0000","last_peered":"2024-09-19T09:02:11.686861+0000","last_clean":"2024-09-19T09:02:11.686861+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686861+0000","last_undegraded":"2024-09-19T09:02:11.686861+0000","last_fullsized":"2024-09-19T09:02:11.686861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955275+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:03:39.955275+0000","last_peered":"2024-09-19T09:03:39.955275+0000","last_clean":"2024-09-19T09:03:39.955275+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:03:39.955275+0000","last_undegraded":"2024-09-19T09:03:39.955275+0000","last_fullsized":"2024-09-19T09:03:39.955275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964988+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:03:39.964988+0000","last_peered":"2024-09-19T09:03:39.964988+0000","last_clean":"2024-09-19T09:03:39.964988+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:03:39.964988+0000","last_undegraded":"2024-09-19T09:03:39.964988+0000","last_fullsized":"2024-09-19T09:03:39.964988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965901+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:03:39.965901+0000","last_peered":"2024-09-19T09:03:39.965901+0000","last_clean":"2024-09-19T09:03:39.965901+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:03:39.965901+0000","last_undegraded":"2024-09-19T09:03:39.965901+0000","last_fullsized":"2024-09-19T09:03:39.965901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967486+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:03:39.967486+0000","last_peered":"2024-09-19T09:03:39.967486+0000","last_clean":"2024-09-19T09:03:39.967486+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:03:39.967486+0000","last_undegraded":"2024-09-19T09:03:39.967486+0000","last_fullsized":"2024-09-19T09:03:39.967486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960510+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:03:39.960510+0000","last_peered":"2024-09-19T09:03:39.960510+0000","last_clean":"2024-09-19T09:03:39.960510+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:03:39.960510+0000","last_undegraded":"2024-09-19T09:03:39.960510+0000","last_fullsized":"2024-09-19T09:03:39.960510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953415+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:03:39.953415+0000","last_peered":"2024-09-19T09:03:39.953415+0000","last_clean":"2024-09-19T09:03:39.953415+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:03:39.953415+0000","last_undegraded":"2024-09-19T09:03:39.953415+0000","last_fullsized":"2024-09-19T09:03:39.953415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686208+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.686208+0000","last_peered":"2024-09-19T09:02:11.686208+0000","last_clean":"2024-09-19T09:02:11.686208+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.686208+0000","last_undegraded":"2024-09-19T09:02:11.686208+0000","last_fullsized":"2024-09-19T09:02:11.686208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67404,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":589,"num_read_kb":365,"num_write":174,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645345,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874279,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1081570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40956,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704196,"statfs":{"total":95995035648,"available":95953096704,"internally_reserved":0,"allocated":1486848,"data_stored":1019451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1019528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":491357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":489507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:03:48.124 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:03:48.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 -- 172.21.15.1:0/2827341607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900102600 msgr2=0x7f0900108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 --2- 172.21.15.1:0/2827341607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900102600 0x7f0900108e90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009ca0 tx=0x7f08f802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 -- 172.21.15.1:0/2827341607 shutdown_connections 2024-09-19T09:03:48.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 --2- 172.21.15.1:0/2827341607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900102600 0x7f0900108e90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 --2- 172.21.15.1:0/2827341607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0900101c40 0x7f09001020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 --2- 172.21.15.1:0/2827341607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900100a50 0x7f0900100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 -- 172.21.15.1:0/2827341607 >> 172.21.15.1:0/2827341607 conn(0x7f09000fc190 msgr2=0x7f09000fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 -- 172.21.15.1:0/2827341607 shutdown_connections 2024-09-19T09:03:48.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.260+0000 7f0904ed0640 1 -- 172.21.15.1:0/2827341607 wait complete. 2024-09-19T09:03:48.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f0904ed0640 1 Processor -- start 2024-09-19T09:03:48.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f0904ed0640 1 -- start start 2024-09-19T09:03:48.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f0904ed0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900100a50 0x7f090006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f0904ed0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900101c40 0x7f090019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f0904ed0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0900102600 0x7f090019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f0904ed0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f090010c830 con 0x7f0900100a50 2024-09-19T09:03:48.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f0904ed0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f090010c6b0 con 0x7f0900102600 2024-09-19T09:03:48.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f0904ed0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f090010c9b0 con 0x7f0900101c40 2024-09-19T09:03:48.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fe59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900100a50 0x7f090006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fe59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900100a50 0x7f090006aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60360/0 (socket says 172.21.15.1:60360) 2024-09-19T09:03:48.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fe59c640 1 -- 172.21.15.1:0/765802966 learned_addr learned my addr 172.21.15.1:0/765802966 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:48.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fed9d640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0900102600 0x7f090019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fdd9b640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900101c40 0x7f090019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fe59c640 1 -- 172.21.15.1:0/765802966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900101c40 msgr2=0x7f090019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fe59c640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900101c40 0x7f090019cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fe59c640 1 -- 172.21.15.1:0/765802966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0900102600 msgr2=0x7f090019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fe59c640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0900102600 0x7f090019f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fe59c640 1 -- 172.21.15.1:0/765802966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090019fab0 con 0x7f0900100a50 2024-09-19T09:03:48.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fdd9b640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900101c40 0x7f090019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:48.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.261+0000 7f08fed9d640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0900102600 0x7f090019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:48.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.262+0000 7f08fe59c640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900100a50 0x7f090006aee0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08f000c970 tx=0x7f08f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.262+0000 7f08ef7fe640 1 -- 172.21.15.1:0/765802966 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004220 con 0x7f0900100a50 2024-09-19T09:03:48.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.262+0000 7f08ef7fe640 1 -- 172.21.15.1:0/765802966 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f08f00043c0 con 0x7f0900100a50 2024-09-19T09:03:48.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.262+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090019fd40 con 0x7f0900100a50 2024-09-19T09:03:48.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.262+0000 7f08ef7fe640 1 -- 172.21.15.1:0/765802966 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004a00 con 0x7f0900100a50 2024-09-19T09:03:48.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.262+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09001a0180 con 0x7f0900100a50 2024-09-19T09:03:48.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.263+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0900107d10 con 0x7f0900100a50 2024-09-19T09:03:48.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.264+0000 7f08ef7fe640 1 -- 172.21.15.1:0/765802966 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f08f00079b0 con 0x7f0900100a50 2024-09-19T09:03:48.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.265+0000 7f08ef7fe640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f08e80a32e0 0x7f08e80a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.265+0000 7f08fdd9b640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f08e80a32e0 0x7f08e80a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.265+0000 7f08ef7fe640 1 -- 172.21.15.1:0/765802966 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f08f00cf8f0 con 0x7f0900100a50 2024-09-19T09:03:48.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.265+0000 7f08fdd9b640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f08e80a32e0 0x7f08e80a57a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f090006ac50 tx=0x7f08f400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.269+0000 7f08ef7fe640 1 -- 172.21.15.1:0/765802966 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08f0014030 con 0x7f0900100a50 2024-09-19T09:03:48.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.444+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0900062630 con 0x7f08e80a32e0 2024-09-19T09:03:48.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.451+0000 7f08ef7fe640 1 -- 172.21.15.1:0/765802966 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258979 (secure 0 0 0) 0x7f0900062630 con 0x7f08e80a32e0 2024-09-19T09:03:48.455 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:48.456 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:03:48.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f08e80a32e0 msgr2=0x7f08e80a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f08e80a32e0 0x7f08e80a57a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f090006ac50 tx=0x7f08f400a5c0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900100a50 msgr2=0x7f090006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900100a50 0x7f090006aee0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08f000c970 tx=0x7f08f000ce30 comp rx=0 tx=0).stop 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 shutdown_connections 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0900102600 0x7f090019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f08e80a32e0 0x7f08e80a57a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0900101c40 0x7f090019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 --2- 172.21.15.1:0/765802966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0900100a50 0x7f090006aee0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 >> 172.21.15.1:0/765802966 conn(0x7f09000fc190 msgr2=0x7f0900104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 shutdown_connections 2024-09-19T09:03:48.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.454+0000 7f0904ed0640 1 -- 172.21.15.1:0/765802966 wait complete. 2024-09-19T09:03:48.466 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-19T09:03:47.962678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658006,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":715,"num_read_kb":474,"num_write":357,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":399096,"kb_used_data":12408,"kb_used_omap":18,"kb_used_meta":386477,"kb_avail":1124542728,"statfs":{"total":1151940427776,"available":1151531753472,"internally_reserved":0,"allocated":12705792,"data_stored":7092912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":395752764},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1091,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002826"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967625+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:03:39.967625+0000","last_peered":"2024-09-19T09:03:39.967625+0000","last_clean":"2024-09-19T09:03:39.967625+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:03:39.967625+0000","last_undegraded":"2024-09-19T09:03:39.967625+0000","last_fullsized":"2024-09-19T09:03:39.967625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951240+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:03:39.951240+0000","last_peered":"2024-09-19T09:03:39.951240+0000","last_clean":"2024-09-19T09:03:39.951240+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:03:39.951240+0000","last_undegraded":"2024-09-19T09:03:39.951240+0000","last_fullsized":"2024-09-19T09:03:39.951240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960322+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:03:39.960322+0000","last_peered":"2024-09-19T09:03:39.960322+0000","last_clean":"2024-09-19T09:03:39.960322+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:03:39.960322+0000","last_undegraded":"2024-09-19T09:03:39.960322+0000","last_fullsized":"2024-09-19T09:03:39.960322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950848+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:03:39.950848+0000","last_peered":"2024-09-19T09:03:39.950848+0000","last_clean":"2024-09-19T09:03:39.950848+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:03:39.950848+0000","last_undegraded":"2024-09-19T09:03:39.950848+0000","last_fullsized":"2024-09-19T09:03:39.950848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.936295+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:03:39.936295+0000","last_peered":"2024-09-19T09:03:39.936295+0000","last_clean":"2024-09-19T09:03:39.936295+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:03:39.936295+0000","last_undegraded":"2024-09-19T09:03:39.936295+0000","last_fullsized":"2024-09-19T09:03:39.936295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.956562+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:03:39.956562+0000","last_peered":"2024-09-19T09:03:39.956562+0000","last_clean":"2024-09-19T09:03:39.956562+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:03:39.956562+0000","last_undegraded":"2024-09-19T09:03:39.956562+0000","last_fullsized":"2024-09-19T09:03:39.956562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965237+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:03:39.965237+0000","last_peered":"2024-09-19T09:03:39.965237+0000","last_clean":"2024-09-19T09:03:39.965237+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:03:39.965237+0000","last_undegraded":"2024-09-19T09:03:39.965237+0000","last_fullsized":"2024-09-19T09:03:39.965237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957157+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:03:39.957157+0000","last_peered":"2024-09-19T09:03:39.957157+0000","last_clean":"2024-09-19T09:03:39.957157+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:03:39.957157+0000","last_undegraded":"2024-09-19T09:03:39.957157+0000","last_fullsized":"2024-09-19T09:03:39.957157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966943+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:03:39.966943+0000","last_peered":"2024-09-19T09:03:39.966943+0000","last_clean":"2024-09-19T09:03:39.966943+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:03:39.966943+0000","last_undegraded":"2024-09-19T09:03:39.966943+0000","last_fullsized":"2024-09-19T09:03:39.966943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.958176+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:03:39.958176+0000","last_peered":"2024-09-19T09:03:39.958176+0000","last_clean":"2024-09-19T09:03:39.958176+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:03:39.958176+0000","last_undegraded":"2024-09-19T09:03:39.958176+0000","last_fullsized":"2024-09-19T09:03:39.958176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964976+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:03:39.964976+0000","last_peered":"2024-09-19T09:03:39.964976+0000","last_clean":"2024-09-19T09:03:39.964976+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:03:39.964976+0000","last_undegraded":"2024-09-19T09:03:39.964976+0000","last_fullsized":"2024-09-19T09:03:39.964976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941887+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:03:39.941887+0000","last_peered":"2024-09-19T09:03:39.941887+0000","last_clean":"2024-09-19T09:03:39.941887+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:03:39.941887+0000","last_undegraded":"2024-09-19T09:03:39.941887+0000","last_fullsized":"2024-09-19T09:03:39.941887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.948226+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:03:39.948226+0000","last_peered":"2024-09-19T09:03:39.948226+0000","last_clean":"2024-09-19T09:03:39.948226+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:03:39.948226+0000","last_undegraded":"2024-09-19T09:03:39.948226+0000","last_fullsized":"2024-09-19T09:03:39.948226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951997+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:03:39.951997+0000","last_peered":"2024-09-19T09:03:39.951997+0000","last_clean":"2024-09-19T09:03:39.951997+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:03:39.951997+0000","last_undegraded":"2024-09-19T09:03:39.951997+0000","last_fullsized":"2024-09-19T09:03:39.951997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950575+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:03:39.950575+0000","last_peered":"2024-09-19T09:03:39.950575+0000","last_clean":"2024-09-19T09:03:39.950575+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:03:39.950575+0000","last_undegraded":"2024-09-19T09:03:39.950575+0000","last_fullsized":"2024-09-19T09:03:39.950575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.963547+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:03:39.963547+0000","last_peered":"2024-09-19T09:03:39.963547+0000","last_clean":"2024-09-19T09:03:39.963547+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:03:39.963547+0000","last_undegraded":"2024-09-19T09:03:39.963547+0000","last_fullsized":"2024-09-19T09:03:39.963547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967695+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:03:39.967695+0000","last_peered":"2024-09-19T09:03:39.967695+0000","last_clean":"2024-09-19T09:03:39.967695+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:03:39.967695+0000","last_undegraded":"2024-09-19T09:03:39.967695+0000","last_fullsized":"2024-09-19T09:03:39.967695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962356+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:03:39.962356+0000","last_peered":"2024-09-19T09:03:39.962356+0000","last_clean":"2024-09-19T09:03:39.962356+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:03:39.962356+0000","last_undegraded":"2024-09-19T09:03:39.962356+0000","last_fullsized":"2024-09-19T09:03:39.962356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957485+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:03:39.957485+0000","last_peered":"2024-09-19T09:03:39.957485+0000","last_clean":"2024-09-19T09:03:39.957485+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:03:39.957485+0000","last_undegraded":"2024-09-19T09:03:39.957485+0000","last_fullsized":"2024-09-19T09:03:39.957485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957966+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:03:39.957966+0000","last_peered":"2024-09-19T09:03:39.957966+0000","last_clean":"2024-09-19T09:03:39.957966+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:03:39.957966+0000","last_undegraded":"2024-09-19T09:03:39.957966+0000","last_fullsized":"2024-09-19T09:03:39.957966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979621+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:03:39.979621+0000","last_peered":"2024-09-19T09:03:39.979621+0000","last_clean":"2024-09-19T09:03:39.979621+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:03:39.979621+0000","last_undegraded":"2024-09-19T09:03:39.979621+0000","last_fullsized":"2024-09-19T09:03:39.979621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965614+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:03:39.965614+0000","last_peered":"2024-09-19T09:03:39.965614+0000","last_clean":"2024-09-19T09:03:39.965614+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:03:39.965614+0000","last_undegraded":"2024-09-19T09:03:39.965614+0000","last_fullsized":"2024-09-19T09:03:39.965614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955089+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:03:39.955089+0000","last_peered":"2024-09-19T09:03:39.955089+0000","last_clean":"2024-09-19T09:03:39.955089+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:03:39.955089+0000","last_undegraded":"2024-09-19T09:03:39.955089+0000","last_fullsized":"2024-09-19T09:03:39.955089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952591+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:03:39.952591+0000","last_peered":"2024-09-19T09:03:39.952591+0000","last_clean":"2024-09-19T09:03:39.952591+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:03:39.952591+0000","last_undegraded":"2024-09-19T09:03:39.952591+0000","last_fullsized":"2024-09-19T09:03:39.952591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950831+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:03:39.950831+0000","last_peered":"2024-09-19T09:03:39.950831+0000","last_clean":"2024-09-19T09:03:39.950831+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:03:39.950831+0000","last_undegraded":"2024-09-19T09:03:39.950831+0000","last_fullsized":"2024-09-19T09:03:39.950831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966529+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:03:39.966529+0000","last_peered":"2024-09-19T09:03:39.966529+0000","last_clean":"2024-09-19T09:03:39.966529+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:03:39.966529+0000","last_undegraded":"2024-09-19T09:03:39.966529+0000","last_fullsized":"2024-09-19T09:03:39.966529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952375+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:03:39.952375+0000","last_peered":"2024-09-19T09:03:39.952375+0000","last_clean":"2024-09-19T09:03:39.952375+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:03:39.952375+0000","last_undegraded":"2024-09-19T09:03:39.952375+0000","last_fullsized":"2024-09-19T09:03:39.952375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950943+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:03:39.950943+0000","last_peered":"2024-09-19T09:03:39.950943+0000","last_clean":"2024-09-19T09:03:39.950943+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:03:39.950943+0000","last_undegraded":"2024-09-19T09:03:39.950943+0000","last_fullsized":"2024-09-19T09:03:39.950943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955565+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:03:39.955565+0000","last_peered":"2024-09-19T09:03:39.955565+0000","last_clean":"2024-09-19T09:03:39.955565+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:03:39.955565+0000","last_undegraded":"2024-09-19T09:03:39.955565+0000","last_fullsized":"2024-09-19T09:03:39.955565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957500+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:03:39.957500+0000","last_peered":"2024-09-19T09:03:39.957500+0000","last_clean":"2024-09-19T09:03:39.957500+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:03:39.957500+0000","last_undegraded":"2024-09-19T09:03:39.957500+0000","last_fullsized":"2024-09-19T09:03:39.957500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955901+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:03:39.955901+0000","last_peered":"2024-09-19T09:03:39.955901+0000","last_clean":"2024-09-19T09:03:39.955901+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:03:39.955901+0000","last_undegraded":"2024-09-19T09:03:39.955901+0000","last_fullsized":"2024-09-19T09:03:39.955901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959198+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:03:39.959198+0000","last_peered":"2024-09-19T09:03:39.959198+0000","last_clean":"2024-09-19T09:03:39.959198+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:03:39.959198+0000","last_undegraded":"2024-09-19T09:03:39.959198+0000","last_fullsized":"2024-09-19T09:03:39.959198+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952610+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:03:39.952610+0000","last_peered":"2024-09-19T09:03:39.952610+0000","last_clean":"2024-09-19T09:03:39.952610+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:03:39.952610+0000","last_undegraded":"2024-09-19T09:03:39.952610+0000","last_fullsized":"2024-09-19T09:03:39.952610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:44.654408+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:03:44.654408+0000","last_peered":"2024-09-19T09:03:44.654408+0000","last_clean":"2024-09-19T09:03:44.654408+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:03:44.654408+0000","last_undegraded":"2024-09-19T09:03:44.654408+0000","last_fullsized":"2024-09-19T09:03:44.654408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950481+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:03:39.950481+0000","last_peered":"2024-09-19T09:03:39.950481+0000","last_clean":"2024-09-19T09:03:39.950481+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:03:39.950481+0000","last_undegraded":"2024-09-19T09:03:39.950481+0000","last_fullsized":"2024-09-19T09:03:39.950481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953709+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:03:39.953709+0000","last_peered":"2024-09-19T09:03:39.953709+0000","last_clean":"2024-09-19T09:03:39.953709+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:03:39.953709+0000","last_undegraded":"2024-09-19T09:03:39.953709+0000","last_fullsized":"2024-09-19T09:03:39.953709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954288+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:03:39.954288+0000","last_peered":"2024-09-19T09:03:39.954288+0000","last_clean":"2024-09-19T09:03:39.954288+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:03:39.954288+0000","last_undegraded":"2024-09-19T09:03:39.954288+0000","last_fullsized":"2024-09-19T09:03:39.954288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:42.650304+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:03:42.650304+0000","last_peered":"2024-09-19T09:03:42.650304+0000","last_clean":"2024-09-19T09:03:42.650304+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:03:42.650304+0000","last_undegraded":"2024-09-19T09:03:42.650304+0000","last_fullsized":"2024-09-19T09:03:42.650304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967297+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:03:39.967297+0000","last_peered":"2024-09-19T09:03:39.967297+0000","last_clean":"2024-09-19T09:03:39.967297+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:03:39.967297+0000","last_undegraded":"2024-09-19T09:03:39.967297+0000","last_fullsized":"2024-09-19T09:03:39.967297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953419+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:03:39.953419+0000","last_peered":"2024-09-19T09:03:39.953419+0000","last_clean":"2024-09-19T09:03:39.953419+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:03:39.953419+0000","last_undegraded":"2024-09-19T09:03:39.953419+0000","last_fullsized":"2024-09-19T09:03:39.953419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966193+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:03:39.966193+0000","last_peered":"2024-09-19T09:03:39.966193+0000","last_clean":"2024-09-19T09:03:39.966193+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:03:39.966193+0000","last_undegraded":"2024-09-19T09:03:39.966193+0000","last_fullsized":"2024-09-19T09:03:39.966193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'34","reported_seq":253,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:43.838828+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:03:43.838828+0000","last_peered":"2024-09-19T09:03:43.838828+0000","last_clean":"2024-09-19T09:03:43.838828+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:03:43.838828+0000","last_undegraded":"2024-09-19T09:03:43.838828+0000","last_fullsized":"2024-09-19T09:03:43.838828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":160,"num_write":35,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.961829+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:03:39.961829+0000","last_peered":"2024-09-19T09:03:39.961829+0000","last_clean":"2024-09-19T09:03:39.961829+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:03:39.961829+0000","last_undegraded":"2024-09-19T09:03:39.961829+0000","last_fullsized":"2024-09-19T09:03:39.961829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979339+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:03:39.979339+0000","last_peered":"2024-09-19T09:03:39.979339+0000","last_clean":"2024-09-19T09:03:39.979339+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:03:39.979339+0000","last_undegraded":"2024-09-19T09:03:39.979339+0000","last_fullsized":"2024-09-19T09:03:39.979339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966978+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:03:39.966978+0000","last_peered":"2024-09-19T09:03:39.966978+0000","last_clean":"2024-09-19T09:03:39.966978+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:03:39.966978+0000","last_undegraded":"2024-09-19T09:03:39.966978+0000","last_fullsized":"2024-09-19T09:03:39.966978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:42.826838+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:03:42.826838+0000","last_peered":"2024-09-19T09:03:42.826838+0000","last_clean":"2024-09-19T09:03:42.826838+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:03:42.826838+0000","last_undegraded":"2024-09-19T09:03:42.826838+0000","last_fullsized":"2024-09-19T09:03:42.826838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962145+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:03:39.962145+0000","last_peered":"2024-09-19T09:03:39.962145+0000","last_clean":"2024-09-19T09:03:39.962145+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:03:39.962145+0000","last_undegraded":"2024-09-19T09:03:39.962145+0000","last_fullsized":"2024-09-19T09:03:39.962145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959818+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:03:39.959818+0000","last_peered":"2024-09-19T09:03:39.959818+0000","last_clean":"2024-09-19T09:03:39.959818+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:03:39.959818+0000","last_undegraded":"2024-09-19T09:03:39.959818+0000","last_fullsized":"2024-09-19T09:03:39.959818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957934+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:03:39.957934+0000","last_peered":"2024-09-19T09:03:39.957934+0000","last_clean":"2024-09-19T09:03:39.957934+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:03:39.957934+0000","last_undegraded":"2024-09-19T09:03:39.957934+0000","last_fullsized":"2024-09-19T09:03:39.957934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964690+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:03:39.964690+0000","last_peered":"2024-09-19T09:03:39.964690+0000","last_clean":"2024-09-19T09:03:39.964690+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:03:39.964690+0000","last_undegraded":"2024-09-19T09:03:39.964690+0000","last_fullsized":"2024-09-19T09:03:39.964690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962180+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:03:39.962180+0000","last_peered":"2024-09-19T09:03:39.962180+0000","last_clean":"2024-09-19T09:03:39.962180+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:03:39.962180+0000","last_undegraded":"2024-09-19T09:03:39.962180+0000","last_fullsized":"2024-09-19T09:03:39.962180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964213+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:03:39.964213+0000","last_peered":"2024-09-19T09:03:39.964213+0000","last_clean":"2024-09-19T09:03:39.964213+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:03:39.964213+0000","last_undegraded":"2024-09-19T09:03:39.964213+0000","last_fullsized":"2024-09-19T09:03:39.964213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688290+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688290+0000","last_peered":"2024-09-19T09:02:11.688290+0000","last_clean":"2024-09-19T09:02:11.688290+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688290+0000","last_undegraded":"2024-09-19T09:02:11.688290+0000","last_fullsized":"2024-09-19T09:02:11.688290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947301+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:03:39.947301+0000","last_peered":"2024-09-19T09:03:39.947301+0000","last_clean":"2024-09-19T09:03:39.947301+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:03:39.947301+0000","last_undegraded":"2024-09-19T09:03:39.947301+0000","last_fullsized":"2024-09-19T09:03:39.947301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953996+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:03:39.953996+0000","last_peered":"2024-09-19T09:03:39.953996+0000","last_clean":"2024-09-19T09:03:39.953996+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:03:39.953996+0000","last_undegraded":"2024-09-19T09:03:39.953996+0000","last_fullsized":"2024-09-19T09:03:39.953996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:41.824716+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:03:41.824716+0000","last_peered":"2024-09-19T09:03:41.824716+0000","last_clean":"2024-09-19T09:03:41.824716+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:03:41.824716+0000","last_undegraded":"2024-09-19T09:03:41.824716+0000","last_fullsized":"2024-09-19T09:03:41.824716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955511+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:03:39.955511+0000","last_peered":"2024-09-19T09:03:39.955511+0000","last_clean":"2024-09-19T09:03:39.955511+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:03:39.955511+0000","last_undegraded":"2024-09-19T09:03:39.955511+0000","last_fullsized":"2024-09-19T09:03:39.955511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957047+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:03:39.957047+0000","last_peered":"2024-09-19T09:03:39.957047+0000","last_clean":"2024-09-19T09:03:39.957047+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:03:39.957047+0000","last_undegraded":"2024-09-19T09:03:39.957047+0000","last_fullsized":"2024-09-19T09:03:39.957047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954576+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:03:39.954576+0000","last_peered":"2024-09-19T09:03:39.954576+0000","last_clean":"2024-09-19T09:03:39.954576+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:03:39.954576+0000","last_undegraded":"2024-09-19T09:03:39.954576+0000","last_fullsized":"2024-09-19T09:03:39.954576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953774+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:03:39.953774+0000","last_peered":"2024-09-19T09:03:39.953774+0000","last_clean":"2024-09-19T09:03:39.953774+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:03:39.953774+0000","last_undegraded":"2024-09-19T09:03:39.953774+0000","last_fullsized":"2024-09-19T09:03:39.953774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:40.675225+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:03:40.675225+0000","last_peered":"2024-09-19T09:03:40.675225+0000","last_clean":"2024-09-19T09:03:40.675225+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:03:40.675225+0000","last_undegraded":"2024-09-19T09:03:40.675225+0000","last_fullsized":"2024-09-19T09:03:40.675225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947181+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:03:39.947181+0000","last_peered":"2024-09-19T09:03:39.947181+0000","last_clean":"2024-09-19T09:03:39.947181+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:03:39.947181+0000","last_undegraded":"2024-09-19T09:03:39.947181+0000","last_fullsized":"2024-09-19T09:03:39.947181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950637+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:03:39.950637+0000","last_peered":"2024-09-19T09:03:39.950637+0000","last_clean":"2024-09-19T09:03:39.950637+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:03:39.950637+0000","last_undegraded":"2024-09-19T09:03:39.950637+0000","last_fullsized":"2024-09-19T09:03:39.950637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941644+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:03:39.941644+0000","last_peered":"2024-09-19T09:03:39.941644+0000","last_clean":"2024-09-19T09:03:39.941644+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:03:39.941644+0000","last_undegraded":"2024-09-19T09:03:39.941644+0000","last_fullsized":"2024-09-19T09:03:39.941644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959045+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:03:39.959045+0000","last_peered":"2024-09-19T09:03:39.959045+0000","last_clean":"2024-09-19T09:03:39.959045+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:03:39.959045+0000","last_undegraded":"2024-09-19T09:03:39.959045+0000","last_fullsized":"2024-09-19T09:03:39.959045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686861+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686861+0000","last_peered":"2024-09-19T09:02:11.686861+0000","last_clean":"2024-09-19T09:02:11.686861+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686861+0000","last_undegraded":"2024-09-19T09:02:11.686861+0000","last_fullsized":"2024-09-19T09:02:11.686861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955275+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:03:39.955275+0000","last_peered":"2024-09-19T09:03:39.955275+0000","last_clean":"2024-09-19T09:03:39.955275+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:03:39.955275+0000","last_undegraded":"2024-09-19T09:03:39.955275+0000","last_fullsized":"2024-09-19T09:03:39.955275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964988+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:03:39.964988+0000","last_peered":"2024-09-19T09:03:39.964988+0000","last_clean":"2024-09-19T09:03:39.964988+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:03:39.964988+0000","last_undegraded":"2024-09-19T09:03:39.964988+0000","last_fullsized":"2024-09-19T09:03:39.964988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965901+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:03:39.965901+0000","last_peered":"2024-09-19T09:03:39.965901+0000","last_clean":"2024-09-19T09:03:39.965901+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:03:39.965901+0000","last_undegraded":"2024-09-19T09:03:39.965901+0000","last_fullsized":"2024-09-19T09:03:39.965901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967486+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:03:39.967486+0000","last_peered":"2024-09-19T09:03:39.967486+0000","last_clean":"2024-09-19T09:03:39.967486+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:03:39.967486+0000","last_undegraded":"2024-09-19T09:03:39.967486+0000","last_fullsized":"2024-09-19T09:03:39.967486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960510+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:03:39.960510+0000","last_peered":"2024-09-19T09:03:39.960510+0000","last_clean":"2024-09-19T09:03:39.960510+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:03:39.960510+0000","last_undegraded":"2024-09-19T09:03:39.960510+0000","last_fullsized":"2024-09-19T09:03:39.960510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953415+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:03:39.953415+0000","last_peered":"2024-09-19T09:03:39.953415+0000","last_clean":"2024-09-19T09:03:39.953415+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:03:39.953415+0000","last_undegraded":"2024-09-19T09:03:39.953415+0000","last_fullsized":"2024-09-19T09:03:39.953415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686208+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.686208+0000","last_peered":"2024-09-19T09:02:11.686208+0000","last_clean":"2024-09-19T09:02:11.686208+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.686208+0000","last_undegraded":"2024-09-19T09:02:11.686208+0000","last_fullsized":"2024-09-19T09:02:11.686208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67404,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":589,"num_read_kb":365,"num_write":174,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645345,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874279,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1081570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40956,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704196,"statfs":{"total":95995035648,"available":95953096704,"internally_reserved":0,"allocated":1486848,"data_stored":1019451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1019528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":491357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":489507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:03:48.470 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T09:03:48.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:03:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 -- 172.21.15.1:0/4001912490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c102d30 msgr2=0x7ff88c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 --2- 172.21.15.1:0/4001912490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c102d30 0x7ff88c1031b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009900 tx=0x7ff87c02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 -- 172.21.15.1:0/4001912490 shutdown_connections 2024-09-19T09:03:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 --2- 172.21.15.1:0/4001912490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff88c1036f0 0x7ff88c109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 --2- 172.21.15.1:0/4001912490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c102d30 0x7ff88c1031b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 --2- 172.21.15.1:0/4001912490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88c101b40 0x7ff88c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 -- 172.21.15.1:0/4001912490 >> 172.21.15.1:0/4001912490 conn(0x7ff88c0fd2a0 msgr2=0x7ff88c0ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 -- 172.21.15.1:0/4001912490 shutdown_connections 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 -- 172.21.15.1:0/4001912490 wait complete. 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 Processor -- start 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 -- start start 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c101b40 0x7ff88c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.609+0000 7ff89303c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88c102d30 0x7ff88c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff89303c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff88c1036f0 0x7ff88c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff89303c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c10d980 con 0x7ff88c101b40 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff89303c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c10d800 con 0x7ff88c1036f0 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff89303c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c10db00 con 0x7ff88c102d30 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c101b40 0x7ff88c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c101b40 0x7ff88c197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60378/0 (socket says 172.21.15.1:60378) 2024-09-19T09:03:48.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 -- 172.21.15.1:0/2916143451 learned_addr learned my addr 172.21.15.1:0/2916143451 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff883fff640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88c102d30 0x7ff88c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff8915d9640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff88c1036f0 0x7ff88c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 -- 172.21.15.1:0/2916143451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88c102d30 msgr2=0x7ff88c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88c102d30 0x7ff88c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 -- 172.21.15.1:0/2916143451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff88c1036f0 msgr2=0x7ff88c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff88c1036f0 0x7ff88c19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 -- 172.21.15.1:0/2916143451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c19fb60 con 0x7ff88c101b40 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff883fff640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88c102d30 0x7ff88c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff8915d9640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff88c1036f0 0x7ff88c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:48.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff890dd8640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c101b40 0x7ff88c197f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff88800b9c0 tx=0x7ff88800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff881ffb640 1 -- 172.21.15.1:0/2916143451 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888019070 con 0x7ff88c101b40 2024-09-19T09:03:48.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff881ffb640 1 -- 172.21.15.1:0/2916143451 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff88800cba0 con 0x7ff88c101b40 2024-09-19T09:03:48.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c19fe50 con 0x7ff88c101b40 2024-09-19T09:03:48.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.610+0000 7ff881ffb640 1 -- 172.21.15.1:0/2916143451 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888012740 con 0x7ff88c101b40 2024-09-19T09:03:48.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.611+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c1a0340 con 0x7ff88c101b40 2024-09-19T09:03:48.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.611+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c108e60 con 0x7ff88c101b40 2024-09-19T09:03:48.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.612+0000 7ff881ffb640 1 -- 172.21.15.1:0/2916143451 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7ff88801c070 con 0x7ff88c101b40 2024-09-19T09:03:48.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.613+0000 7ff881ffb640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff8740a3360 0x7ff8740a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.613+0000 7ff883fff640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff8740a3360 0x7ff8740a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.613+0000 7ff881ffb640 1 -- 172.21.15.1:0/2916143451 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff8880cef50 con 0x7ff88c101b40 2024-09-19T09:03:48.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.614+0000 7ff883fff640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff8740a3360 0x7ff8740a5820 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff87c000c00 tx=0x7ff87c031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.617+0000 7ff881ffb640 1 -- 172.21.15.1:0/2916143451 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff88809bc00 con 0x7ff88c101b40 2024-09-19T09:03:48.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.791+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff88c062630 con 0x7ff8740a3360 2024-09-19T09:03:48.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.797+0000 7ff881ffb640 1 -- 172.21.15.1:0/2916143451 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258979 (secure 0 0 0) 0x7ff88c062630 con 0x7ff8740a3360 2024-09-19T09:03:48.801 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:48.802 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:03:48.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff8740a3360 msgr2=0x7ff8740a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff8740a3360 0x7ff8740a5820 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff87c000c00 tx=0x7ff87c031640 comp rx=0 tx=0).stop 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c101b40 msgr2=0x7ff88c197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c101b40 0x7ff88c197f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff88800b9c0 tx=0x7ff88800be80 comp rx=0 tx=0).stop 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 shutdown_connections 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff88c1036f0 0x7ff88c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff8740a3360 0x7ff8740a5820 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88c102d30 0x7ff88c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 --2- 172.21.15.1:0/2916143451 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff88c101b40 0x7ff88c197f40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 >> 172.21.15.1:0/2916143451 conn(0x7ff88c0fd2a0 msgr2=0x7ff88c106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 shutdown_connections 2024-09-19T09:03:48.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:48.800+0000 7ff89303c640 1 -- 172.21.15.1:0/2916143451 wait complete. 2024-09-19T09:03:48.812 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-19T09:03:47.962678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658006,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":715,"num_read_kb":474,"num_write":357,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":399096,"kb_used_data":12408,"kb_used_omap":18,"kb_used_meta":386477,"kb_avail":1124542728,"statfs":{"total":1151940427776,"available":1151531753472,"internally_reserved":0,"allocated":12705792,"data_stored":7092912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":395752764},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1091,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":33,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002826"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967625+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:03:39.967625+0000","last_peered":"2024-09-19T09:03:39.967625+0000","last_clean":"2024-09-19T09:03:39.967625+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:03:39.967625+0000","last_undegraded":"2024-09-19T09:03:39.967625+0000","last_fullsized":"2024-09-19T09:03:39.967625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951240+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:03:39.951240+0000","last_peered":"2024-09-19T09:03:39.951240+0000","last_clean":"2024-09-19T09:03:39.951240+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:03:39.951240+0000","last_undegraded":"2024-09-19T09:03:39.951240+0000","last_fullsized":"2024-09-19T09:03:39.951240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960322+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:03:39.960322+0000","last_peered":"2024-09-19T09:03:39.960322+0000","last_clean":"2024-09-19T09:03:39.960322+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:03:39.960322+0000","last_undegraded":"2024-09-19T09:03:39.960322+0000","last_fullsized":"2024-09-19T09:03:39.960322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950848+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:03:39.950848+0000","last_peered":"2024-09-19T09:03:39.950848+0000","last_clean":"2024-09-19T09:03:39.950848+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:03:39.950848+0000","last_undegraded":"2024-09-19T09:03:39.950848+0000","last_fullsized":"2024-09-19T09:03:39.950848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.936295+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:03:39.936295+0000","last_peered":"2024-09-19T09:03:39.936295+0000","last_clean":"2024-09-19T09:03:39.936295+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:03:39.936295+0000","last_undegraded":"2024-09-19T09:03:39.936295+0000","last_fullsized":"2024-09-19T09:03:39.936295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.956562+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:03:39.956562+0000","last_peered":"2024-09-19T09:03:39.956562+0000","last_clean":"2024-09-19T09:03:39.956562+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:03:39.956562+0000","last_undegraded":"2024-09-19T09:03:39.956562+0000","last_fullsized":"2024-09-19T09:03:39.956562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965237+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:03:39.965237+0000","last_peered":"2024-09-19T09:03:39.965237+0000","last_clean":"2024-09-19T09:03:39.965237+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:03:39.965237+0000","last_undegraded":"2024-09-19T09:03:39.965237+0000","last_fullsized":"2024-09-19T09:03:39.965237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957157+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:03:39.957157+0000","last_peered":"2024-09-19T09:03:39.957157+0000","last_clean":"2024-09-19T09:03:39.957157+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:03:39.957157+0000","last_undegraded":"2024-09-19T09:03:39.957157+0000","last_fullsized":"2024-09-19T09:03:39.957157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966943+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:03:39.966943+0000","last_peered":"2024-09-19T09:03:39.966943+0000","last_clean":"2024-09-19T09:03:39.966943+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:03:39.966943+0000","last_undegraded":"2024-09-19T09:03:39.966943+0000","last_fullsized":"2024-09-19T09:03:39.966943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.958176+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:03:39.958176+0000","last_peered":"2024-09-19T09:03:39.958176+0000","last_clean":"2024-09-19T09:03:39.958176+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:03:39.958176+0000","last_undegraded":"2024-09-19T09:03:39.958176+0000","last_fullsized":"2024-09-19T09:03:39.958176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964976+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:03:39.964976+0000","last_peered":"2024-09-19T09:03:39.964976+0000","last_clean":"2024-09-19T09:03:39.964976+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:03:39.964976+0000","last_undegraded":"2024-09-19T09:03:39.964976+0000","last_fullsized":"2024-09-19T09:03:39.964976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941887+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:03:39.941887+0000","last_peered":"2024-09-19T09:03:39.941887+0000","last_clean":"2024-09-19T09:03:39.941887+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:03:39.941887+0000","last_undegraded":"2024-09-19T09:03:39.941887+0000","last_fullsized":"2024-09-19T09:03:39.941887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.948226+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:03:39.948226+0000","last_peered":"2024-09-19T09:03:39.948226+0000","last_clean":"2024-09-19T09:03:39.948226+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:03:39.948226+0000","last_undegraded":"2024-09-19T09:03:39.948226+0000","last_fullsized":"2024-09-19T09:03:39.948226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951997+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:03:39.951997+0000","last_peered":"2024-09-19T09:03:39.951997+0000","last_clean":"2024-09-19T09:03:39.951997+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:03:39.951997+0000","last_undegraded":"2024-09-19T09:03:39.951997+0000","last_fullsized":"2024-09-19T09:03:39.951997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950575+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:03:39.950575+0000","last_peered":"2024-09-19T09:03:39.950575+0000","last_clean":"2024-09-19T09:03:39.950575+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:03:39.950575+0000","last_undegraded":"2024-09-19T09:03:39.950575+0000","last_fullsized":"2024-09-19T09:03:39.950575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.963547+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:03:39.963547+0000","last_peered":"2024-09-19T09:03:39.963547+0000","last_clean":"2024-09-19T09:03:39.963547+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:03:39.963547+0000","last_undegraded":"2024-09-19T09:03:39.963547+0000","last_fullsized":"2024-09-19T09:03:39.963547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967695+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:03:39.967695+0000","last_peered":"2024-09-19T09:03:39.967695+0000","last_clean":"2024-09-19T09:03:39.967695+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:03:39.967695+0000","last_undegraded":"2024-09-19T09:03:39.967695+0000","last_fullsized":"2024-09-19T09:03:39.967695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962356+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:03:39.962356+0000","last_peered":"2024-09-19T09:03:39.962356+0000","last_clean":"2024-09-19T09:03:39.962356+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:03:39.962356+0000","last_undegraded":"2024-09-19T09:03:39.962356+0000","last_fullsized":"2024-09-19T09:03:39.962356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957485+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:03:39.957485+0000","last_peered":"2024-09-19T09:03:39.957485+0000","last_clean":"2024-09-19T09:03:39.957485+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:03:39.957485+0000","last_undegraded":"2024-09-19T09:03:39.957485+0000","last_fullsized":"2024-09-19T09:03:39.957485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957966+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:03:39.957966+0000","last_peered":"2024-09-19T09:03:39.957966+0000","last_clean":"2024-09-19T09:03:39.957966+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:03:39.957966+0000","last_undegraded":"2024-09-19T09:03:39.957966+0000","last_fullsized":"2024-09-19T09:03:39.957966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979621+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:03:39.979621+0000","last_peered":"2024-09-19T09:03:39.979621+0000","last_clean":"2024-09-19T09:03:39.979621+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:03:39.979621+0000","last_undegraded":"2024-09-19T09:03:39.979621+0000","last_fullsized":"2024-09-19T09:03:39.979621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965614+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:03:39.965614+0000","last_peered":"2024-09-19T09:03:39.965614+0000","last_clean":"2024-09-19T09:03:39.965614+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:03:39.965614+0000","last_undegraded":"2024-09-19T09:03:39.965614+0000","last_fullsized":"2024-09-19T09:03:39.965614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955089+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:03:39.955089+0000","last_peered":"2024-09-19T09:03:39.955089+0000","last_clean":"2024-09-19T09:03:39.955089+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:03:39.955089+0000","last_undegraded":"2024-09-19T09:03:39.955089+0000","last_fullsized":"2024-09-19T09:03:39.955089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952591+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:03:39.952591+0000","last_peered":"2024-09-19T09:03:39.952591+0000","last_clean":"2024-09-19T09:03:39.952591+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:03:39.952591+0000","last_undegraded":"2024-09-19T09:03:39.952591+0000","last_fullsized":"2024-09-19T09:03:39.952591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950831+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:03:39.950831+0000","last_peered":"2024-09-19T09:03:39.950831+0000","last_clean":"2024-09-19T09:03:39.950831+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:03:39.950831+0000","last_undegraded":"2024-09-19T09:03:39.950831+0000","last_fullsized":"2024-09-19T09:03:39.950831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966529+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:03:39.966529+0000","last_peered":"2024-09-19T09:03:39.966529+0000","last_clean":"2024-09-19T09:03:39.966529+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:03:39.966529+0000","last_undegraded":"2024-09-19T09:03:39.966529+0000","last_fullsized":"2024-09-19T09:03:39.966529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952375+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:03:39.952375+0000","last_peered":"2024-09-19T09:03:39.952375+0000","last_clean":"2024-09-19T09:03:39.952375+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:03:39.952375+0000","last_undegraded":"2024-09-19T09:03:39.952375+0000","last_fullsized":"2024-09-19T09:03:39.952375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950943+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:03:39.950943+0000","last_peered":"2024-09-19T09:03:39.950943+0000","last_clean":"2024-09-19T09:03:39.950943+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:03:39.950943+0000","last_undegraded":"2024-09-19T09:03:39.950943+0000","last_fullsized":"2024-09-19T09:03:39.950943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955565+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:03:39.955565+0000","last_peered":"2024-09-19T09:03:39.955565+0000","last_clean":"2024-09-19T09:03:39.955565+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:03:39.955565+0000","last_undegraded":"2024-09-19T09:03:39.955565+0000","last_fullsized":"2024-09-19T09:03:39.955565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957500+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:03:39.957500+0000","last_peered":"2024-09-19T09:03:39.957500+0000","last_clean":"2024-09-19T09:03:39.957500+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:03:39.957500+0000","last_undegraded":"2024-09-19T09:03:39.957500+0000","last_fullsized":"2024-09-19T09:03:39.957500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955901+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:03:39.955901+0000","last_peered":"2024-09-19T09:03:39.955901+0000","last_clean":"2024-09-19T09:03:39.955901+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:03:39.955901+0000","last_undegraded":"2024-09-19T09:03:39.955901+0000","last_fullsized":"2024-09-19T09:03:39.955901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959198+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:03:39.959198+0000","last_peered":"2024-09-19T09:03:39.959198+0000","last_clean":"2024-09-19T09:03:39.959198+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:03:39.959198+0000","last_undegraded":"2024-09-19T09:03:39.959198+0000","last_fullsized":"2024-09-19T09:03:39.959198+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952610+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:03:39.952610+0000","last_peered":"2024-09-19T09:03:39.952610+0000","last_clean":"2024-09-19T09:03:39.952610+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:03:39.952610+0000","last_undegraded":"2024-09-19T09:03:39.952610+0000","last_fullsized":"2024-09-19T09:03:39.952610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:44.654408+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:03:44.654408+0000","last_peered":"2024-09-19T09:03:44.654408+0000","last_clean":"2024-09-19T09:03:44.654408+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:03:44.654408+0000","last_undegraded":"2024-09-19T09:03:44.654408+0000","last_fullsized":"2024-09-19T09:03:44.654408+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950481+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:03:39.950481+0000","last_peered":"2024-09-19T09:03:39.950481+0000","last_clean":"2024-09-19T09:03:39.950481+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:03:39.950481+0000","last_undegraded":"2024-09-19T09:03:39.950481+0000","last_fullsized":"2024-09-19T09:03:39.950481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953709+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:03:39.953709+0000","last_peered":"2024-09-19T09:03:39.953709+0000","last_clean":"2024-09-19T09:03:39.953709+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:03:39.953709+0000","last_undegraded":"2024-09-19T09:03:39.953709+0000","last_fullsized":"2024-09-19T09:03:39.953709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954288+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:03:39.954288+0000","last_peered":"2024-09-19T09:03:39.954288+0000","last_clean":"2024-09-19T09:03:39.954288+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:03:39.954288+0000","last_undegraded":"2024-09-19T09:03:39.954288+0000","last_fullsized":"2024-09-19T09:03:39.954288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:42.650304+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:03:42.650304+0000","last_peered":"2024-09-19T09:03:42.650304+0000","last_clean":"2024-09-19T09:03:42.650304+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:03:42.650304+0000","last_undegraded":"2024-09-19T09:03:42.650304+0000","last_fullsized":"2024-09-19T09:03:42.650304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967297+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:03:39.967297+0000","last_peered":"2024-09-19T09:03:39.967297+0000","last_clean":"2024-09-19T09:03:39.967297+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:03:39.967297+0000","last_undegraded":"2024-09-19T09:03:39.967297+0000","last_fullsized":"2024-09-19T09:03:39.967297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953419+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:03:39.953419+0000","last_peered":"2024-09-19T09:03:39.953419+0000","last_clean":"2024-09-19T09:03:39.953419+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:03:39.953419+0000","last_undegraded":"2024-09-19T09:03:39.953419+0000","last_fullsized":"2024-09-19T09:03:39.953419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966193+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:03:39.966193+0000","last_peered":"2024-09-19T09:03:39.966193+0000","last_clean":"2024-09-19T09:03:39.966193+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:03:39.966193+0000","last_undegraded":"2024-09-19T09:03:39.966193+0000","last_fullsized":"2024-09-19T09:03:39.966193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'34","reported_seq":253,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:43.838828+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:03:43.838828+0000","last_peered":"2024-09-19T09:03:43.838828+0000","last_clean":"2024-09-19T09:03:43.838828+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:03:43.838828+0000","last_undegraded":"2024-09-19T09:03:43.838828+0000","last_fullsized":"2024-09-19T09:03:43.838828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":160,"num_write":35,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.961829+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:03:39.961829+0000","last_peered":"2024-09-19T09:03:39.961829+0000","last_clean":"2024-09-19T09:03:39.961829+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:03:39.961829+0000","last_undegraded":"2024-09-19T09:03:39.961829+0000","last_fullsized":"2024-09-19T09:03:39.961829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979339+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:03:39.979339+0000","last_peered":"2024-09-19T09:03:39.979339+0000","last_clean":"2024-09-19T09:03:39.979339+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:03:39.979339+0000","last_undegraded":"2024-09-19T09:03:39.979339+0000","last_fullsized":"2024-09-19T09:03:39.979339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966978+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:03:39.966978+0000","last_peered":"2024-09-19T09:03:39.966978+0000","last_clean":"2024-09-19T09:03:39.966978+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:03:39.966978+0000","last_undegraded":"2024-09-19T09:03:39.966978+0000","last_fullsized":"2024-09-19T09:03:39.966978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:42.826838+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:03:42.826838+0000","last_peered":"2024-09-19T09:03:42.826838+0000","last_clean":"2024-09-19T09:03:42.826838+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:03:42.826838+0000","last_undegraded":"2024-09-19T09:03:42.826838+0000","last_fullsized":"2024-09-19T09:03:42.826838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962145+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:03:39.962145+0000","last_peered":"2024-09-19T09:03:39.962145+0000","last_clean":"2024-09-19T09:03:39.962145+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:03:39.962145+0000","last_undegraded":"2024-09-19T09:03:39.962145+0000","last_fullsized":"2024-09-19T09:03:39.962145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959818+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:03:39.959818+0000","last_peered":"2024-09-19T09:03:39.959818+0000","last_clean":"2024-09-19T09:03:39.959818+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:03:39.959818+0000","last_undegraded":"2024-09-19T09:03:39.959818+0000","last_fullsized":"2024-09-19T09:03:39.959818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957934+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:03:39.957934+0000","last_peered":"2024-09-19T09:03:39.957934+0000","last_clean":"2024-09-19T09:03:39.957934+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:03:39.957934+0000","last_undegraded":"2024-09-19T09:03:39.957934+0000","last_fullsized":"2024-09-19T09:03:39.957934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964690+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:03:39.964690+0000","last_peered":"2024-09-19T09:03:39.964690+0000","last_clean":"2024-09-19T09:03:39.964690+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:03:39.964690+0000","last_undegraded":"2024-09-19T09:03:39.964690+0000","last_fullsized":"2024-09-19T09:03:39.964690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962180+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:03:39.962180+0000","last_peered":"2024-09-19T09:03:39.962180+0000","last_clean":"2024-09-19T09:03:39.962180+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:03:39.962180+0000","last_undegraded":"2024-09-19T09:03:39.962180+0000","last_fullsized":"2024-09-19T09:03:39.962180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964213+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:03:39.964213+0000","last_peered":"2024-09-19T09:03:39.964213+0000","last_clean":"2024-09-19T09:03:39.964213+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:03:39.964213+0000","last_undegraded":"2024-09-19T09:03:39.964213+0000","last_fullsized":"2024-09-19T09:03:39.964213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688290+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688290+0000","last_peered":"2024-09-19T09:02:11.688290+0000","last_clean":"2024-09-19T09:02:11.688290+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688290+0000","last_undegraded":"2024-09-19T09:02:11.688290+0000","last_fullsized":"2024-09-19T09:02:11.688290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947301+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:03:39.947301+0000","last_peered":"2024-09-19T09:03:39.947301+0000","last_clean":"2024-09-19T09:03:39.947301+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:03:39.947301+0000","last_undegraded":"2024-09-19T09:03:39.947301+0000","last_fullsized":"2024-09-19T09:03:39.947301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953996+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:03:39.953996+0000","last_peered":"2024-09-19T09:03:39.953996+0000","last_clean":"2024-09-19T09:03:39.953996+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:03:39.953996+0000","last_undegraded":"2024-09-19T09:03:39.953996+0000","last_fullsized":"2024-09-19T09:03:39.953996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:41.824716+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:03:41.824716+0000","last_peered":"2024-09-19T09:03:41.824716+0000","last_clean":"2024-09-19T09:03:41.824716+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:03:41.824716+0000","last_undegraded":"2024-09-19T09:03:41.824716+0000","last_fullsized":"2024-09-19T09:03:41.824716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955511+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:03:39.955511+0000","last_peered":"2024-09-19T09:03:39.955511+0000","last_clean":"2024-09-19T09:03:39.955511+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:03:39.955511+0000","last_undegraded":"2024-09-19T09:03:39.955511+0000","last_fullsized":"2024-09-19T09:03:39.955511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957047+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:03:39.957047+0000","last_peered":"2024-09-19T09:03:39.957047+0000","last_clean":"2024-09-19T09:03:39.957047+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:03:39.957047+0000","last_undegraded":"2024-09-19T09:03:39.957047+0000","last_fullsized":"2024-09-19T09:03:39.957047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954576+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:03:39.954576+0000","last_peered":"2024-09-19T09:03:39.954576+0000","last_clean":"2024-09-19T09:03:39.954576+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:03:39.954576+0000","last_undegraded":"2024-09-19T09:03:39.954576+0000","last_fullsized":"2024-09-19T09:03:39.954576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953774+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:03:39.953774+0000","last_peered":"2024-09-19T09:03:39.953774+0000","last_clean":"2024-09-19T09:03:39.953774+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:03:39.953774+0000","last_undegraded":"2024-09-19T09:03:39.953774+0000","last_fullsized":"2024-09-19T09:03:39.953774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:40.675225+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:03:40.675225+0000","last_peered":"2024-09-19T09:03:40.675225+0000","last_clean":"2024-09-19T09:03:40.675225+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:03:40.675225+0000","last_undegraded":"2024-09-19T09:03:40.675225+0000","last_fullsized":"2024-09-19T09:03:40.675225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947181+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:03:39.947181+0000","last_peered":"2024-09-19T09:03:39.947181+0000","last_clean":"2024-09-19T09:03:39.947181+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:03:39.947181+0000","last_undegraded":"2024-09-19T09:03:39.947181+0000","last_fullsized":"2024-09-19T09:03:39.947181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950637+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:03:39.950637+0000","last_peered":"2024-09-19T09:03:39.950637+0000","last_clean":"2024-09-19T09:03:39.950637+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:03:39.950637+0000","last_undegraded":"2024-09-19T09:03:39.950637+0000","last_fullsized":"2024-09-19T09:03:39.950637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941644+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:03:39.941644+0000","last_peered":"2024-09-19T09:03:39.941644+0000","last_clean":"2024-09-19T09:03:39.941644+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:03:39.941644+0000","last_undegraded":"2024-09-19T09:03:39.941644+0000","last_fullsized":"2024-09-19T09:03:39.941644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959045+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:03:39.959045+0000","last_peered":"2024-09-19T09:03:39.959045+0000","last_clean":"2024-09-19T09:03:39.959045+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:03:39.959045+0000","last_undegraded":"2024-09-19T09:03:39.959045+0000","last_fullsized":"2024-09-19T09:03:39.959045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686861+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686861+0000","last_peered":"2024-09-19T09:02:11.686861+0000","last_clean":"2024-09-19T09:02:11.686861+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686861+0000","last_undegraded":"2024-09-19T09:02:11.686861+0000","last_fullsized":"2024-09-19T09:02:11.686861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955275+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:03:39.955275+0000","last_peered":"2024-09-19T09:03:39.955275+0000","last_clean":"2024-09-19T09:03:39.955275+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:03:39.955275+0000","last_undegraded":"2024-09-19T09:03:39.955275+0000","last_fullsized":"2024-09-19T09:03:39.955275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964988+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:03:39.964988+0000","last_peered":"2024-09-19T09:03:39.964988+0000","last_clean":"2024-09-19T09:03:39.964988+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:03:39.964988+0000","last_undegraded":"2024-09-19T09:03:39.964988+0000","last_fullsized":"2024-09-19T09:03:39.964988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965901+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:03:39.965901+0000","last_peered":"2024-09-19T09:03:39.965901+0000","last_clean":"2024-09-19T09:03:39.965901+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:03:39.965901+0000","last_undegraded":"2024-09-19T09:03:39.965901+0000","last_fullsized":"2024-09-19T09:03:39.965901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967486+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:03:39.967486+0000","last_peered":"2024-09-19T09:03:39.967486+0000","last_clean":"2024-09-19T09:03:39.967486+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:03:39.967486+0000","last_undegraded":"2024-09-19T09:03:39.967486+0000","last_fullsized":"2024-09-19T09:03:39.967486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960510+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:03:39.960510+0000","last_peered":"2024-09-19T09:03:39.960510+0000","last_clean":"2024-09-19T09:03:39.960510+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:03:39.960510+0000","last_undegraded":"2024-09-19T09:03:39.960510+0000","last_fullsized":"2024-09-19T09:03:39.960510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953415+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:03:39.953415+0000","last_peered":"2024-09-19T09:03:39.953415+0000","last_clean":"2024-09-19T09:03:39.953415+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:03:39.953415+0000","last_undegraded":"2024-09-19T09:03:39.953415+0000","last_fullsized":"2024-09-19T09:03:39.953415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686208+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.686208+0000","last_peered":"2024-09-19T09:02:11.686208+0000","last_clean":"2024-09-19T09:02:11.686208+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.686208+0000","last_undegraded":"2024-09-19T09:02:11.686208+0000","last_fullsized":"2024-09-19T09:02:11.686208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67404,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":589,"num_read_kb":365,"num_write":174,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645345,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874279,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1081570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005100,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40956,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704196,"statfs":{"total":95995035648,"available":95953096704,"internally_reserved":0,"allocated":1486848,"data_stored":1019451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1019528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":491357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":489507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:03:48.816 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:49.107 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:49.520 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:49 smithi001 ceph-mon[30939]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T09:03:49.520 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:49 smithi001 ceph-mon[30939]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:49.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:49 smithi001 ceph-mon[30939]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:49.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:49 smithi001 ceph-mon[30939]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:49.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 -- 172.21.15.1:0/1976926156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc101de0 msgr2=0x7f6efc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 --2- 172.21.15.1:0/1976926156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc101de0 0x7f6efc1021c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009900 tx=0x7f6eec02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 -- 172.21.15.1:0/1976926156 shutdown_connections 2024-09-19T09:03:49.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 --2- 172.21.15.1:0/1976926156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6efc106f10 0x7f6efc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 --2- 172.21.15.1:0/1976926156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6efc102790 0x7f6efc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 --2- 172.21.15.1:0/1976926156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc101de0 0x7f6efc1021c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 -- 172.21.15.1:0/1976926156 >> 172.21.15.1:0/1976926156 conn(0x7f6efc0fd8c0 msgr2=0x7f6efc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 -- 172.21.15.1:0/1976926156 shutdown_connections 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.600+0000 7f6f02285640 1 -- 172.21.15.1:0/1976926156 wait complete. 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6f02285640 1 Processor -- start 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6f02285640 1 -- start start 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6f02285640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6efc101de0 0x7f6efc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6f02285640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc102790 0x7f6efc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6f02285640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6efc106f10 0x7f6efc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6f02285640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1120d0 con 0x7f6efc102790 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6f02285640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc111f50 con 0x7f6efc101de0 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6f02285640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc112250 con 0x7f6efc106f10 2024-09-19T09:03:49.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6efb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc102790 0x7f6efc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6efb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc102790 0x7f6efc1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60404/0 (socket says 172.21.15.1:60404) 2024-09-19T09:03:49.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.601+0000 7f6efb7fe640 1 -- 172.21.15.1:0/2171388653 learned_addr learned my addr 172.21.15.1:0/2171388653 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:49.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6f00822640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6efc106f10 0x7f6efc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6efbfff640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6efc101de0 0x7f6efc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6efb7fe640 1 -- 172.21.15.1:0/2171388653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6efc106f10 msgr2=0x7f6efc19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6efb7fe640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6efc106f10 0x7f6efc19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6efb7fe640 1 -- 172.21.15.1:0/2171388653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6efc101de0 msgr2=0x7f6efc198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6efb7fe640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6efc101de0 0x7f6efc198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6efb7fe640 1 -- 172.21.15.1:0/2171388653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc19d410 con 0x7f6efc102790 2024-09-19T09:03:49.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6efbfff640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6efc101de0 0x7f6efc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:49.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.602+0000 7f6efb7fe640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc102790 0x7f6efc1989a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000c920 tx=0x7f6ef000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.603+0000 7f6ef97fa640 1 -- 172.21.15.1:0/2171388653 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0007c70 con 0x7f6efc102790 2024-09-19T09:03:49.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.603+0000 7f6ef97fa640 1 -- 172.21.15.1:0/2171388653 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ef0007e10 con 0x7f6efc102790 2024-09-19T09:03:49.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.603+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc19d700 con 0x7f6efc102790 2024-09-19T09:03:49.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.603+0000 7f6ef97fa640 1 -- 172.21.15.1:0/2171388653 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0018940 con 0x7f6efc102790 2024-09-19T09:03:49.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.603+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc1a4fe0 con 0x7f6efc102790 2024-09-19T09:03:49.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.604+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6efc1021c0 con 0x7f6efc102790 2024-09-19T09:03:49.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.605+0000 7f6ef97fa640 1 -- 172.21.15.1:0/2171388653 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f6ef0018b20 con 0x7f6efc102790 2024-09-19T09:03:49.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.606+0000 7f6ef97fa640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ee40a3350 0x7f6ee40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.606+0000 7f6efbfff640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ee40a3350 0x7f6ee40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.606+0000 7f6ef97fa640 1 -- 172.21.15.1:0/2171388653 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6ef00cfb80 con 0x7f6efc102790 2024-09-19T09:03:49.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.606+0000 7f6efbfff640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ee40a3350 0x7f6ee40a5810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6eec005ab0 tx=0x7f6eec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.610+0000 7f6ef97fa640 1 -- 172.21.15.1:0/2171388653 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ef0014030 con 0x7f6efc102790 2024-09-19T09:03:49.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:49 smithi022 ceph-mon[35107]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T09:03:49.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:49 smithi022 ceph-mon[35107]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:49.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:49 smithi022 ceph-mon[35107]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:49.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:49 smithi022 ceph-mon[35107]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:49.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.822+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6efc1a5310 con 0x7f6efc102790 2024-09-19T09:03:49.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.823+0000 7f6ef97fa640 1 -- 172.21.15.1:0/2171388653 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f6ef009c720 con 0x7f6efc102790 2024-09-19T09:03:49.824 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:49.824 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:03:49.824 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:03:49.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ee40a3350 msgr2=0x7f6ee40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ee40a3350 0x7f6ee40a5810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6eec005ab0 tx=0x7f6eec005a20 comp rx=0 tx=0).stop 2024-09-19T09:03:49.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc102790 msgr2=0x7f6efc1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc102790 0x7f6efc1989a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000c920 tx=0x7f6ef000cde0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 shutdown_connections 2024-09-19T09:03:49.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6ee40a3350 0x7f6ee40a5810 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6efc106f10 0x7f6efc19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6efc102790 0x7f6efc1989a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 --2- 172.21.15.1:0/2171388653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6efc101de0 0x7f6efc198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 >> 172.21.15.1:0/2171388653 conn(0x7f6efc0fd8c0 msgr2=0x7f6efc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 shutdown_connections 2024-09-19T09:03:49.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:49.825+0000 7f6f02285640 1 -- 172.21.15.1:0/2171388653 wait complete. 2024-09-19T09:03:49.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:49 smithi064 ceph-mon[35179]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T09:03:49.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:49 smithi064 ceph-mon[35179]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:49.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:49 smithi064 ceph-mon[35179]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:49.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:49 smithi064 ceph-mon[35179]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:50.532 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:50 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2171388653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:50.563 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:03:50.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:50 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2171388653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:50.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:50 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2171388653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 -- 172.21.15.1:0/963150208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908102790 msgr2=0x7f19081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 --2- 172.21.15.1:0/963150208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908102790 0x7f19081067e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009900 tx=0x7f18f002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 -- 172.21.15.1:0/963150208 shutdown_connections 2024-09-19T09:03:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 --2- 172.21.15.1:0/963150208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1908106f10 0x7f190810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 --2- 172.21.15.1:0/963150208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908102790 0x7f19081067e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 --2- 172.21.15.1:0/963150208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1908101de0 0x7f19081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 -- 172.21.15.1:0/963150208 >> 172.21.15.1:0/963150208 conn(0x7f19080fd8c0 msgr2=0x7f19080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 -- 172.21.15.1:0/963150208 shutdown_connections 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.294+0000 7f190ee1e640 1 -- 172.21.15.1:0/963150208 wait complete. 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190ee1e640 1 Processor -- start 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190ee1e640 1 -- start start 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190ee1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1908101de0 0x7f19080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190ee1e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1908102790 0x7f1908074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190ee1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908106f10 0x7f1908074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190ee1e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1908112090 con 0x7f1908106f10 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190ee1e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1908111f10 con 0x7f1908101de0 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190ee1e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1908112210 con 0x7f1908102790 2024-09-19T09:03:51.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190d3bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908106f10 0x7f1908074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190d3bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908106f10 0x7f1908074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60434/0 (socket says 172.21.15.1:60434) 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190d3bb640 1 -- 172.21.15.1:0/1989417536 learned_addr learned my addr 172.21.15.1:0/1989417536 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f190cbba640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1908101de0 0x7f19080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.295+0000 7f1907fff640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1908102790 0x7f1908074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f190d3bb640 1 -- 172.21.15.1:0/1989417536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1908102790 msgr2=0x7f1908074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f190d3bb640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1908102790 0x7f1908074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f190d3bb640 1 -- 172.21.15.1:0/1989417536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1908101de0 msgr2=0x7f19080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f190d3bb640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1908101de0 0x7f19080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f190d3bb640 1 -- 172.21.15.1:0/1989417536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19081a6a00 con 0x7f1908106f10 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f190d3bb640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908106f10 0x7f1908074f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f190000eaa0 tx=0x7f190000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f1905ffb640 1 -- 172.21.15.1:0/1989417536 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190000cdb0 con 0x7f1908106f10 2024-09-19T09:03:51.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19081a6cf0 con 0x7f1908106f10 2024-09-19T09:03:51.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f1905ffb640 1 -- 172.21.15.1:0/1989417536 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1900004b20 con 0x7f1908106f10 2024-09-19T09:03:51.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f1905ffb640 1 -- 172.21.15.1:0/1989417536 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900011760 con 0x7f1908106f10 2024-09-19T09:03:51.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.296+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19081a7200 con 0x7f1908106f10 2024-09-19T09:03:51.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.297+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19081021c0 con 0x7f1908106f10 2024-09-19T09:03:51.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.298+0000 7f1905ffb640 1 -- 172.21.15.1:0/1989417536 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f1900004cd0 con 0x7f1908106f10 2024-09-19T09:03:51.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.299+0000 7f1905ffb640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18f40a3350 0x7f18f40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.299+0000 7f190cbba640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18f40a3350 0x7f18f40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.299+0000 7f1905ffb640 1 -- 172.21.15.1:0/1989417536 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f19000cfc70 con 0x7f1908106f10 2024-09-19T09:03:51.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.299+0000 7f190cbba640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18f40a3350 0x7f18f40a5810 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18f80058c0 tx=0x7f18f800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:51.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.303+0000 7f1905ffb640 1 -- 172.21.15.1:0/1989417536 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1900016030 con 0x7f1908106f10 2024-09-19T09:03:51.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.481+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f190810a0f0 con 0x7f1908106f10 2024-09-19T09:03:51.482 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:51 smithi001 ceph-mon[30939]: pgmap v330: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:03:51.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.482+0000 7f1905ffb640 1 -- 172.21.15.1:0/1989417536 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7f190009c160 con 0x7f1908106f10 2024-09-19T09:03:51.484 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:51.484 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:03:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18f40a3350 msgr2=0x7f18f40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18f40a3350 0x7f18f40a5810 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18f80058c0 tx=0x7f18f800a250 comp rx=0 tx=0).stop 2024-09-19T09:03:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908106f10 msgr2=0x7f1908074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908106f10 0x7f1908074f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f190000eaa0 tx=0x7f190000ef60 comp rx=0 tx=0).stop 2024-09-19T09:03:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 shutdown_connections 2024-09-19T09:03:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1908106f10 0x7f1908074f70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f18f40a3350 0x7f18f40a5810 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1908102790 0x7f1908074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 --2- 172.21.15.1:0/1989417536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1908101de0 0x7f19080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 >> 172.21.15.1:0/1989417536 conn(0x7f19080fd8c0 msgr2=0x7f19080feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 shutdown_connections 2024-09-19T09:03:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:51.485+0000 7f190ee1e640 1 -- 172.21.15.1:0/1989417536 wait complete. 2024-09-19T09:03:51.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:51 smithi022 ceph-mon[35107]: pgmap v330: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:03:51.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:51 smithi064 ceph-mon[35179]: pgmap v330: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:03:52.259 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T09:03:52.259 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T09:03:52.270 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:03:52.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T09:03:52.270 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T09:03:52.270 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:03:52.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:03:52.273 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T09:03:52.285 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:03:52.286 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:03:52.543 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:52.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:52 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1989417536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:52.552 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:52.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:52 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1989417536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:52.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:52 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1989417536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 -- 172.21.15.1:0/2230043576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 msgr2=0x7f9d6010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/2230043576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 0x7f9d6010bb50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009900 tx=0x7f9d4802a480 comp rx=0 tx=0).stop 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 -- 172.21.15.1:0/2230043576 shutdown_connections 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/2230043576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6010c170 0x7f9d6010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/2230043576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 0x7f9d6010bb50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/2230043576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d60102d40 0x7f9d60103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 -- 172.21.15.1:0/2230043576 >> 172.21.15.1:0/2230043576 conn(0x7f9d600fc7a0 msgr2=0x7f9d600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 -- 172.21.15.1:0/2230043576 shutdown_connections 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.241+0000 7f9d65d3b640 1 -- 172.21.15.1:0/2230043576 wait complete. 2024-09-19T09:03:53.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.242+0000 7f9d65d3b640 1 Processor -- start 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.242+0000 7f9d65d3b640 1 -- start start 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.242+0000 7f9d65d3b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d60102d40 0x7f9d601984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.242+0000 7f9d65d3b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 0x7f9d60198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.242+0000 7f9d65d3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6010c170 0x7f9d6019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.242+0000 7f9d65d3b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60112090 con 0x7f9d60103660 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.242+0000 7f9d65d3b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60111f10 con 0x7f9d6010c170 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.242+0000 7f9d65d3b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60112210 con 0x7f9d60102d40 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d60102d40 0x7f9d601984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d56ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 0x7f9d60198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d60102d40 0x7f9d601984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:58568/0 (socket says 172.21.15.1:58568) 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/373596788 learned_addr learned my addr 172.21.15.1:0/373596788 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6010c170 0x7f9d6019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d56ffd640 1 -- 172.21.15.1:0/373596788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d60102d40 msgr2=0x7f9d601984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d60102d40 0x7f9d601984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d56ffd640 1 -- 172.21.15.1:0/373596788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6010c170 msgr2=0x7f9d6019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6010c170 0x7f9d6019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d56ffd640 1 -- 172.21.15.1:0/373596788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6019d4a0 con 0x7f9d60103660 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6010c170 0x7f9d6019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 0x7f9d60198a30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005940 tx=0x7f9d48032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d5d7fa640 1 -- 172.21.15.1:0/373596788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4803f030 con 0x7f9d60103660 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.243+0000 7f9d5d7fa640 1 -- 172.21.15.1:0/373596788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d480043d0 con 0x7f9d60103660 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.244+0000 7f9d65d3b640 1 -- 172.21.15.1:0/373596788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6019d730 con 0x7f9d60103660 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.244+0000 7f9d5d7fa640 1 -- 172.21.15.1:0/373596788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48035070 con 0x7f9d60103660 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.244+0000 7f9d65d3b640 1 -- 172.21.15.1:0/373596788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601a5070 con 0x7f9d60103660 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d5d7fa640 1 -- 172.21.15.1:0/373596788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f9d48042030 con 0x7f9d60103660 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d68114740 1 Processor -- start 2024-09-19T09:03:53.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d68114740 1 -- start start 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d68114740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934ef9b60 0x55c934ef9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d68114740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f04800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d68114740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934f04d40 0x55c934f07130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d68114740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c934e5f280 con 0x55c934efa480 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d68114740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c934e06b10 con 0x55c934f04d40 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.246+0000 7f9d68114740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c934e5b240 con 0x55c934ef9b60 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5d7fa640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9d4c0a3350 0x7f9d4c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f04800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f04800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44436/0 (socket says 172.21.15.1:44436) 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/144926131 learned_addr learned my addr 172.21.15.1:0/144926131 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5d7fa640 1 -- 172.21.15.1:0/373596788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9d480efd10 con 0x7f9d60103660 2024-09-19T09:03:53.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/144926131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934f04d40 0x55c934f07130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/144926131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934ef9b60 msgr2=0x55c934ef9f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/144926131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934ef9b60 0x55c934ef9f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/144926131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934f04d40 msgr2=0x55c934f07130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/144926131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934f04d40 0x55c934f07130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/144926131 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c934e131f0 con 0x55c934efa480 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9d4c0a3350 0x7f9d4c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.247+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/144926131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f04800 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000bda0 tx=0x7f9d500107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b6b1ab2dbb8e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d55ffb640 1 -- 172.21.15.1:0/144926131 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5001c680 con 0x55c934efa480 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d55ffb640 1 -- 172.21.15.1:0/144926131 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d50011940 con 0x55c934efa480 2024-09-19T09:03:53.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d55ffb640 1 -- 172.21.15.1:0/144926131 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5001aa60 con 0x55c934efa480 2024-09-19T09:03:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d68114740 1 -- 172.21.15.1:0/144926131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 msgr2=0x55c934f04800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d68114740 1 --2- 172.21.15.1:0/144926131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f04800 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000bda0 tx=0x7f9d500107a0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9d4c0a3350 0x7f9d4c0a5810 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009fd0 tx=0x7f9d58009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d68114740 1 -- 172.21.15.1:0/144926131 shutdown_connections 2024-09-19T09:03:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d68114740 1 --2- 172.21.15.1:0/144926131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934f04d40 0x55c934f07130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d68114740 1 --2- 172.21.15.1:0/144926131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f04800 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d68114740 1 --2- 172.21.15.1:0/144926131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934ef9b60 0x55c934ef9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.248+0000 7f9d68114740 1 -- 172.21.15.1:0/144926131 >> 172.21.15.1:0/144926131 conn(0x55c934ef60f0 msgr2=0x55c934ef64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.249+0000 7f9d68114740 1 -- 172.21.15.1:0/144926131 shutdown_connections 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.249+0000 7f9d68114740 1 -- 172.21.15.1:0/144926131 wait complete. 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.249+0000 7f9d68114740 1 -- start start 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.249+0000 7f9d68114740 1 Processor -- start 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.249+0000 7f9d68114740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 0x55c934f01c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.249+0000 7f9d68114740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f02160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.249+0000 7f9d68114740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 0x55c934f026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.249+0000 7f9d68114740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c934f07910 con 0x55c934efa480 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d68114740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c934e19f10 con 0x55c934ef9b60 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d68114740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c934f07a90 con 0x55c934f04d40 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f02160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f02160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44444/0 (socket says 172.21.15.1:44444) 2024-09-19T09:03:53.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 -- 172.21.15.1:0/328842607 learned_addr learned my addr 172.21.15.1:0/328842607 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 0x55c934f01c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d68114740 10 client.0 _ll_register_callbacks cb 0x55c934de2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 0x55c934f026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 -- 172.21.15.1:0/328842607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 msgr2=0x55c934f026a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 0x55c934f026a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 -- 172.21.15.1:0/328842607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 msgr2=0x55c934f01c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 0x55c934f01c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 -- 172.21.15.1:0/328842607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c934bd06a0 con 0x55c934efa480 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f02160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9d4802a9a0 tx=0x7f9d480bbd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe0dfa74976d30d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d3effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d3effd640 1 -- 172.21.15.1:0/328842607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48049030 con 0x55c934efa480 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d3effd640 1 -- 172.21.15.1:0/328842607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9d480ed890 con 0x55c934efa480 2024-09-19T09:03:53.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.250+0000 7f9d68114740 1 -- 172.21.15.1:0/328842607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d50011940 con 0x55c934efa480 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d3effd640 1 -- 172.21.15.1:0/328842607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d480d5140 con 0x55c934efa480 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d68114740 10 client.15231 fetch_fsmap learned FSMap version 24 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d68114740 1 -- 172.21.15.1:0/328842607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c934f17890 con 0x55c934efa480 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d3effd640 1 -- 172.21.15.1:0/328842607 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d50011940 con 0x55c934efa480 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d3effd640 1 -- 172.21.15.1:0/328842607 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9d480c0120 con 0x55c934efa480 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d68114740 10 client.15231 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d68114740 10 client.15231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d68114740 20 client.15231 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d68114740 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c934f18be0 0x55c934f1b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d68114740 4 client.15231 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d68114740 1 -- 172.21.15.1:0/328842607 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c934e6c7f0 con 0x55c934f18be0 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.251+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c934f18be0 0x55c934f1b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.252+0000 7f9d3effd640 10 client.15231 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:53.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.252+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c934f18be0 0x55c934f1b030 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c9705876b7d44d4 server_cookie=ca6575296c4b7a98 in_seq=0 out_seq=0 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d3effd640 1 -- 172.21.15.1:0/328842607 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c934e6c7f0 con 0x55c934f18be0 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d3effd640 10 client.15231 handle_command_reply: tid=0 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 client.15231 shutdown 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 -- 172.21.15.1:0/328842607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 msgr2=0x55c934f02160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f02160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9d4802a9a0 tx=0x7f9d480bbd40 comp rx=0 tx=0).stop 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 -- 172.21.15.1:0/328842607 shutdown_connections 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c934f18be0 0x55c934f1b030 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 0x55c934f026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934efa480 0x55c934f02160 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 --2- 172.21.15.1:0/328842607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 0x55c934f01c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 -- 172.21.15.1:0/328842607 >> 172.21.15.1:0/328842607 conn(0x55c934ef60f0 msgr2=0x55c934efbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d3effd640 0 client.15231 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 -- 172.21.15.1:0/328842607 shutdown_connections 2024-09-19T09:03:53.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 1 -- 172.21.15.1:0/328842607 wait complete. 2024-09-19T09:03:53.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.253+0000 7f9d68114740 20 client.15231 trim_cache size 0 max 16384 2024-09-19T09:03:53.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d68114740 1 Processor -- start 2024-09-19T09:03:53.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d68114740 1 -- start start 2024-09-19T09:03:53.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d68114740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 0x55c934f03a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d68114740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934efa480 0x55c934f20940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d68114740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934f04d40 0x55c934f20e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d68114740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601add80 con 0x55c934f04d40 2024-09-19T09:03:53.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d68114740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601ab650 con 0x55c934ef9b60 2024-09-19T09:03:53.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d68114740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601a94c0 con 0x55c934efa480 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d5ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934f04d40 0x55c934f20e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d5ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934f04d40 0x55c934f20e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44446/0 (socket says 172.21.15.1:44446) 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.271+0000 7f9d5ffff640 1 -- 172.21.15.1:0/1079065544 learned_addr learned my addr 172.21.15.1:0/1079065544 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934efa480 0x55c934f20940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 0x55c934f03a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d5ffff640 1 -- 172.21.15.1:0/1079065544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934efa480 msgr2=0x55c934f20940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934efa480 0x55c934f20940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d5ffff640 1 -- 172.21.15.1:0/1079065544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 msgr2=0x55c934f03a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 0x55c934f03a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d5ffff640 1 -- 172.21.15.1:0/1079065544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c934ef5b90 con 0x55c934f04d40 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934f04d40 0x55c934f20e80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9d58003e20 tx=0x7f9d58014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce61e797c1e5119 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d557fa640 1 -- 172.21.15.1:0/1079065544 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58004550 con 0x55c934f04d40 2024-09-19T09:03:53.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d557fa640 1 -- 172.21.15.1:0/1079065544 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d580046f0 con 0x55c934f04d40 2024-09-19T09:03:53.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.272+0000 7f9d557fa640 1 -- 172.21.15.1:0/1079065544 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58026670 con 0x55c934f04d40 2024-09-19T09:03:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 -- 172.21.15.1:0/1079065544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934f04d40 msgr2=0x55c934f20e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934f04d40 0x55c934f20e80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9d58003e20 tx=0x7f9d58014000 comp rx=0 tx=0).stop 2024-09-19T09:03:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 -- 172.21.15.1:0/1079065544 shutdown_connections 2024-09-19T09:03:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934f04d40 0x55c934f20e80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934efa480 0x55c934f20940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 --2- 172.21.15.1:0/1079065544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934ef9b60 0x55c934f03a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 -- 172.21.15.1:0/1079065544 >> 172.21.15.1:0/1079065544 conn(0x55c934ef60f0 msgr2=0x55c934f03370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 -- 172.21.15.1:0/1079065544 shutdown_connections 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 -- 172.21.15.1:0/1079065544 wait complete. 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 -- start start 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.273+0000 7f9d68114740 1 Processor -- start 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d68114740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934ef9b60 0x55c934f0d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d68114740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934efa480 0x55c934f0d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d68114740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 0x55c934f82910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d68114740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601a9b10 con 0x55c934ef9b60 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d68114740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601aaf80 con 0x55c934efa480 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d68114740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601aa1e0 con 0x55c934f04d40 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d68114740 10 client.0 _ll_register_callbacks cb 0x7f9d48004580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:53.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934ef9b60 0x55c934f0d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934ef9b60 0x55c934f0d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44460/0 (socket says 172.21.15.1:44460) 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/474185039 learned_addr learned my addr 172.21.15.1:0/474185039 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5ffff640 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 0x55c934f82910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934efa480 0x55c934f0d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/474185039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 msgr2=0x55c934f82910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 0x55c934f82910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/474185039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934efa480 msgr2=0x55c934f0d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934efa480 0x55c934f0d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 -- 172.21.15.1:0/474185039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c934f82e50 con 0x55c934ef9b60 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d5f7fe640 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934ef9b60 0x55c934f0d2d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000bfe0 tx=0x7f9d50005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb18d9c46cb7ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d3effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d3effd640 1 -- 172.21.15.1:0/474185039 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50005250 con 0x55c934ef9b60 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d3effd640 1 -- 172.21.15.1:0/474185039 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9d500053f0 con 0x55c934ef9b60 2024-09-19T09:03:53.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.274+0000 7f9d68114740 1 -- 172.21.15.1:0/474185039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d580046f0 con 0x55c934ef9b60 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d3effd640 1 -- 172.21.15.1:0/474185039 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d50038050 con 0x55c934ef9b60 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d68114740 10 client.15237 fetch_fsmap learned FSMap version 24 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d68114740 1 -- 172.21.15.1:0/474185039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c934f84030 con 0x55c934ef9b60 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d3effd640 1 -- 172.21.15.1:0/474185039 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d580046f0 con 0x55c934ef9b60 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d3effd640 1 -- 172.21.15.1:0/474185039 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9d5001a7f0 con 0x55c934ef9b60 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d68114740 10 client.15237 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d68114740 10 client.15237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d68114740 20 client.15237 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d68114740 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c934f84480 0x55c934f86870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d68114740 4 client.15237 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d68114740 1 -- 172.21.15.1:0/474185039 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c934e66d00 con 0x55c934f84480 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.275+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c934f84480 0x55c934f86870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:53.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.276+0000 7f9d56ffd640 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c934f84480 0x55c934f86870 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3337d1e3de8b0fbe server_cookie=3708b58d5d6c9f27 in_seq=0 out_seq=0 2024-09-19T09:03:53.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.276+0000 7f9d3effd640 10 client.15237 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:53.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d3effd640 1 -- 172.21.15.1:0/474185039 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c934e66d00 con 0x55c934f84480 2024-09-19T09:03:53.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d3effd640 10 client.15237 handle_command_reply: tid=0 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 client.15237 shutdown 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 -- 172.21.15.1:0/474185039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934ef9b60 msgr2=0x55c934f0d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934ef9b60 0x55c934f0d2d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000bfe0 tx=0x7f9d50005d30 comp rx=0 tx=0).stop 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 -- 172.21.15.1:0/474185039 shutdown_connections 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c934f84480 0x55c934f86870 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c934f04d40 0x55c934f82910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c934efa480 0x55c934f0d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d3effd640 0 client.15237 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 --2- 172.21.15.1:0/474185039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c934ef9b60 0x55c934f0d2d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 -- 172.21.15.1:0/474185039 >> 172.21.15.1:0/474185039 conn(0x55c934ef60f0 msgr2=0x55c934f14810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 -- 172.21.15.1:0/474185039 shutdown_connections 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.277+0000 7f9d68114740 1 -- 172.21.15.1:0/474185039 wait complete. 2024-09-19T09:03:53.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d68114740 20 client.15237 trim_cache size 0 max 16384 2024-09-19T09:03:53.283 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:03:53.283 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:03:53.283 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "7cec2f62-811d-4122-821c-03f905275cb1", 2024-09-19T09:03:53.283 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:03:53.283 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:03:53.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 -- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9d4c0a3350 msgr2=0x7f9d4c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9d4c0a3350 0x7f9d4c0a5810 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009fd0 tx=0x7f9d58009500 comp rx=0 tx=0).stop 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 -- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 msgr2=0x7f9d60198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 0x7f9d60198a30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005940 tx=0x7f9d48032f80 comp rx=0 tx=0).stop 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 -- 172.21.15.1:0/373596788 shutdown_connections 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6010c170 0x7f9d6019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9d60103660 0x7f9d60198a30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9d4c0a3350 0x7f9d4c0a5810 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 --2- 172.21.15.1:0/373596788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d60102d40 0x7f9d601984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 -- 172.21.15.1:0/373596788 >> 172.21.15.1:0/373596788 conn(0x7f9d600fc7a0 msgr2=0x7f9d600fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 -- 172.21.15.1:0/373596788 shutdown_connections 2024-09-19T09:03:53.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:53.278+0000 7f9d65d3b640 1 -- 172.21.15.1:0/373596788 wait complete. 2024-09-19T09:03:53.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:53 smithi001 ceph-mon[30939]: pgmap v331: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:03:53.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:53 smithi022 ceph-mon[35107]: pgmap v331: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:03:53.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:53 smithi064 ceph-mon[35179]: pgmap v331: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:03:54.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:03:54.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 -- 172.21.15.1:0/3536289858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 msgr2=0x7f332010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:54.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 --2- 172.21.15.1:0/3536289858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 0x7f332010da40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3318009ca0 tx=0x7f331802a950 comp rx=0 tx=0).stop 2024-09-19T09:03:54.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 -- 172.21.15.1:0/3536289858 shutdown_connections 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 --2- 172.21.15.1:0/3536289858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 0x7f332010da40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 --2- 172.21.15.1:0/3536289858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3320102570 0x7f33201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 --2- 172.21.15.1:0/3536289858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3320100e20 0x7f3320101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 -- 172.21.15.1:0/3536289858 >> 172.21.15.1:0/3536289858 conn(0x7f33200fc7d0 msgr2=0x7f33200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 -- 172.21.15.1:0/3536289858 shutdown_connections 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 -- 172.21.15.1:0/3536289858 wait complete. 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 Processor -- start 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.281+0000 7f3326705640 1 -- start start 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3326705640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3320100e20 0x7f332010e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3326705640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3320102570 0x7f332010e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3326705640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 0x7f332010edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3326705640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3320112240 con 0x7f3320102ef0 2024-09-19T09:03:54.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3326705640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33201120c0 con 0x7f3320102570 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3326705640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f33201123c0 con 0x7f3320100e20 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3324ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 0x7f332010edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3324ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 0x7f332010edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44474/0 (socket says 172.21.15.1:44474) 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3324ca2640 1 -- 172.21.15.1:0/466991281 learned_addr learned my addr 172.21.15.1:0/466991281 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f331f7fe640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3320102570 0x7f332010e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f331ffff640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3320100e20 0x7f332010e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3324ca2640 1 -- 172.21.15.1:0/466991281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3320100e20 msgr2=0x7f332010e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3324ca2640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3320100e20 0x7f332010e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3324ca2640 1 -- 172.21.15.1:0/466991281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3320102570 msgr2=0x7f332010e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3324ca2640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3320102570 0x7f332010e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.282+0000 7f3324ca2640 1 -- 172.21.15.1:0/466991281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33201a6a80 con 0x7f3320102ef0 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.283+0000 7f3324ca2640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 0x7f332010edd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3318005e30 tx=0x7f331802ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:54.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.283+0000 7f331d7fa640 1 -- 172.21.15.1:0/466991281 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3318034040 con 0x7f3320102ef0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.283+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33201a6d10 con 0x7f3320102ef0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.283+0000 7f331d7fa640 1 -- 172.21.15.1:0/466991281 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3318030940 con 0x7f3320102ef0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.283+0000 7f331d7fa640 1 -- 172.21.15.1:0/466991281 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3318039430 con 0x7f3320102ef0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.283+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33201a7240 con 0x7f3320102ef0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.284+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33201021b0 con 0x7f3320102ef0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.285+0000 7f331d7fa640 1 -- 172.21.15.1:0/466991281 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f3318037020 con 0x7f3320102ef0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.286+0000 7f331d7fa640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33080a32d0 0x7f33080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.286+0000 7f331ffff640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33080a32d0 0x7f33080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.286+0000 7f331d7fa640 1 -- 172.21.15.1:0/466991281 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f33180f0a50 con 0x7f3320102ef0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.286+0000 7f331ffff640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33080a32d0 0x7f33080a5790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f331000bbe0 tx=0x7f331000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:54.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.290+0000 7f331d7fa640 1 -- 172.21.15.1:0/466991281 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33180bd6a0 con 0x7f3320102ef0 2024-09-19T09:03:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:54.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.496+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3320106ed0 con 0x7f33080a32d0 2024-09-19T09:03:54.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.502+0000 7f331d7fa640 1 -- 172.21.15.1:0/466991281 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258837 (secure 0 0 0) 0x7f3320106ed0 con 0x7f33080a32d0 2024-09-19T09:03:54.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:54.506 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:03:54.509 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:54 smithi001 ceph-mon[30939]: scrub queued for path: / 2024-09-19T09:03:54.509 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:54 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:54.509 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:54 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:03:54.509 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:54 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33080a32d0 msgr2=0x7f33080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33080a32d0 0x7f33080a5790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f331000bbe0 tx=0x7f331000b390 comp rx=0 tx=0).stop 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 msgr2=0x7f332010edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 0x7f332010edd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3318005e30 tx=0x7f331802ff90 comp rx=0 tx=0).stop 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 shutdown_connections 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3320102ef0 0x7f332010edd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3320102570 0x7f332010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f33080a32d0 0x7f33080a5790 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 --2- 172.21.15.1:0/466991281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3320100e20 0x7f332010e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.505+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 >> 172.21.15.1:0/466991281 conn(0x7f33200fc7d0 msgr2=0x7f33201067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.506+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 shutdown_connections 2024-09-19T09:03:54.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:54.506+0000 7f3326705640 1 -- 172.21.15.1:0/466991281 wait complete. 2024-09-19T09:03:54.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:54 smithi022 ceph-mon[35107]: scrub queued for path: / 2024-09-19T09:03:54.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:54 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:54.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:54 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:03:54.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:54 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:54.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:54 smithi064 ceph-mon[35179]: scrub queued for path: / 2024-09-19T09:03:54.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:54 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:54.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:54 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:03:54.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:54 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:55.436 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-19T09:03:53.964141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666292,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":753,"num_read_kb":504,"num_write":363,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":403280,"kb_used_data":12432,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124538544,"statfs":{"total":1151940427776,"available":1151527469056,"internally_reserved":0,"allocated":12730368,"data_stored":7118556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":400012604},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9236,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002932"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967625+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:03:39.967625+0000","last_peered":"2024-09-19T09:03:39.967625+0000","last_clean":"2024-09-19T09:03:39.967625+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:03:39.967625+0000","last_undegraded":"2024-09-19T09:03:39.967625+0000","last_fullsized":"2024-09-19T09:03:39.967625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951240+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:03:39.951240+0000","last_peered":"2024-09-19T09:03:39.951240+0000","last_clean":"2024-09-19T09:03:39.951240+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:03:39.951240+0000","last_undegraded":"2024-09-19T09:03:39.951240+0000","last_fullsized":"2024-09-19T09:03:39.951240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960322+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:03:39.960322+0000","last_peered":"2024-09-19T09:03:39.960322+0000","last_clean":"2024-09-19T09:03:39.960322+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:03:39.960322+0000","last_undegraded":"2024-09-19T09:03:39.960322+0000","last_fullsized":"2024-09-19T09:03:39.960322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950848+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:03:39.950848+0000","last_peered":"2024-09-19T09:03:39.950848+0000","last_clean":"2024-09-19T09:03:39.950848+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:03:39.950848+0000","last_undegraded":"2024-09-19T09:03:39.950848+0000","last_fullsized":"2024-09-19T09:03:39.950848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.936295+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:03:39.936295+0000","last_peered":"2024-09-19T09:03:39.936295+0000","last_clean":"2024-09-19T09:03:39.936295+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:03:39.936295+0000","last_undegraded":"2024-09-19T09:03:39.936295+0000","last_fullsized":"2024-09-19T09:03:39.936295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.956562+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:03:39.956562+0000","last_peered":"2024-09-19T09:03:39.956562+0000","last_clean":"2024-09-19T09:03:39.956562+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:03:39.956562+0000","last_undegraded":"2024-09-19T09:03:39.956562+0000","last_fullsized":"2024-09-19T09:03:39.956562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965237+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:03:39.965237+0000","last_peered":"2024-09-19T09:03:39.965237+0000","last_clean":"2024-09-19T09:03:39.965237+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:03:39.965237+0000","last_undegraded":"2024-09-19T09:03:39.965237+0000","last_fullsized":"2024-09-19T09:03:39.965237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957157+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:03:39.957157+0000","last_peered":"2024-09-19T09:03:39.957157+0000","last_clean":"2024-09-19T09:03:39.957157+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:03:39.957157+0000","last_undegraded":"2024-09-19T09:03:39.957157+0000","last_fullsized":"2024-09-19T09:03:39.957157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966943+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:03:39.966943+0000","last_peered":"2024-09-19T09:03:39.966943+0000","last_clean":"2024-09-19T09:03:39.966943+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:03:39.966943+0000","last_undegraded":"2024-09-19T09:03:39.966943+0000","last_fullsized":"2024-09-19T09:03:39.966943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.958176+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:03:39.958176+0000","last_peered":"2024-09-19T09:03:39.958176+0000","last_clean":"2024-09-19T09:03:39.958176+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:03:39.958176+0000","last_undegraded":"2024-09-19T09:03:39.958176+0000","last_fullsized":"2024-09-19T09:03:39.958176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964976+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:03:39.964976+0000","last_peered":"2024-09-19T09:03:39.964976+0000","last_clean":"2024-09-19T09:03:39.964976+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:03:39.964976+0000","last_undegraded":"2024-09-19T09:03:39.964976+0000","last_fullsized":"2024-09-19T09:03:39.964976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941887+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:03:39.941887+0000","last_peered":"2024-09-19T09:03:39.941887+0000","last_clean":"2024-09-19T09:03:39.941887+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:03:39.941887+0000","last_undegraded":"2024-09-19T09:03:39.941887+0000","last_fullsized":"2024-09-19T09:03:39.941887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.948226+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:03:39.948226+0000","last_peered":"2024-09-19T09:03:39.948226+0000","last_clean":"2024-09-19T09:03:39.948226+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:03:39.948226+0000","last_undegraded":"2024-09-19T09:03:39.948226+0000","last_fullsized":"2024-09-19T09:03:39.948226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951997+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:03:39.951997+0000","last_peered":"2024-09-19T09:03:39.951997+0000","last_clean":"2024-09-19T09:03:39.951997+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:03:39.951997+0000","last_undegraded":"2024-09-19T09:03:39.951997+0000","last_fullsized":"2024-09-19T09:03:39.951997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950575+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:03:39.950575+0000","last_peered":"2024-09-19T09:03:39.950575+0000","last_clean":"2024-09-19T09:03:39.950575+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:03:39.950575+0000","last_undegraded":"2024-09-19T09:03:39.950575+0000","last_fullsized":"2024-09-19T09:03:39.950575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.963547+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:03:39.963547+0000","last_peered":"2024-09-19T09:03:39.963547+0000","last_clean":"2024-09-19T09:03:39.963547+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:03:39.963547+0000","last_undegraded":"2024-09-19T09:03:39.963547+0000","last_fullsized":"2024-09-19T09:03:39.963547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967695+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:03:39.967695+0000","last_peered":"2024-09-19T09:03:39.967695+0000","last_clean":"2024-09-19T09:03:39.967695+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:03:39.967695+0000","last_undegraded":"2024-09-19T09:03:39.967695+0000","last_fullsized":"2024-09-19T09:03:39.967695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962356+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:03:39.962356+0000","last_peered":"2024-09-19T09:03:39.962356+0000","last_clean":"2024-09-19T09:03:39.962356+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:03:39.962356+0000","last_undegraded":"2024-09-19T09:03:39.962356+0000","last_fullsized":"2024-09-19T09:03:39.962356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957485+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:03:39.957485+0000","last_peered":"2024-09-19T09:03:39.957485+0000","last_clean":"2024-09-19T09:03:39.957485+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:03:39.957485+0000","last_undegraded":"2024-09-19T09:03:39.957485+0000","last_fullsized":"2024-09-19T09:03:39.957485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957966+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:03:39.957966+0000","last_peered":"2024-09-19T09:03:39.957966+0000","last_clean":"2024-09-19T09:03:39.957966+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:03:39.957966+0000","last_undegraded":"2024-09-19T09:03:39.957966+0000","last_fullsized":"2024-09-19T09:03:39.957966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979621+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:03:39.979621+0000","last_peered":"2024-09-19T09:03:39.979621+0000","last_clean":"2024-09-19T09:03:39.979621+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:03:39.979621+0000","last_undegraded":"2024-09-19T09:03:39.979621+0000","last_fullsized":"2024-09-19T09:03:39.979621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965614+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:03:39.965614+0000","last_peered":"2024-09-19T09:03:39.965614+0000","last_clean":"2024-09-19T09:03:39.965614+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:03:39.965614+0000","last_undegraded":"2024-09-19T09:03:39.965614+0000","last_fullsized":"2024-09-19T09:03:39.965614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955089+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:03:39.955089+0000","last_peered":"2024-09-19T09:03:39.955089+0000","last_clean":"2024-09-19T09:03:39.955089+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:03:39.955089+0000","last_undegraded":"2024-09-19T09:03:39.955089+0000","last_fullsized":"2024-09-19T09:03:39.955089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952591+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:03:39.952591+0000","last_peered":"2024-09-19T09:03:39.952591+0000","last_clean":"2024-09-19T09:03:39.952591+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:03:39.952591+0000","last_undegraded":"2024-09-19T09:03:39.952591+0000","last_fullsized":"2024-09-19T09:03:39.952591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950831+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:03:39.950831+0000","last_peered":"2024-09-19T09:03:39.950831+0000","last_clean":"2024-09-19T09:03:39.950831+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:03:39.950831+0000","last_undegraded":"2024-09-19T09:03:39.950831+0000","last_fullsized":"2024-09-19T09:03:39.950831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966529+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:03:39.966529+0000","last_peered":"2024-09-19T09:03:39.966529+0000","last_clean":"2024-09-19T09:03:39.966529+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:03:39.966529+0000","last_undegraded":"2024-09-19T09:03:39.966529+0000","last_fullsized":"2024-09-19T09:03:39.966529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952375+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:03:39.952375+0000","last_peered":"2024-09-19T09:03:39.952375+0000","last_clean":"2024-09-19T09:03:39.952375+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:03:39.952375+0000","last_undegraded":"2024-09-19T09:03:39.952375+0000","last_fullsized":"2024-09-19T09:03:39.952375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950943+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:03:39.950943+0000","last_peered":"2024-09-19T09:03:39.950943+0000","last_clean":"2024-09-19T09:03:39.950943+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:03:39.950943+0000","last_undegraded":"2024-09-19T09:03:39.950943+0000","last_fullsized":"2024-09-19T09:03:39.950943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955565+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:03:39.955565+0000","last_peered":"2024-09-19T09:03:39.955565+0000","last_clean":"2024-09-19T09:03:39.955565+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:03:39.955565+0000","last_undegraded":"2024-09-19T09:03:39.955565+0000","last_fullsized":"2024-09-19T09:03:39.955565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957500+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:03:39.957500+0000","last_peered":"2024-09-19T09:03:39.957500+0000","last_clean":"2024-09-19T09:03:39.957500+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:03:39.957500+0000","last_undegraded":"2024-09-19T09:03:39.957500+0000","last_fullsized":"2024-09-19T09:03:39.957500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955901+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:03:39.955901+0000","last_peered":"2024-09-19T09:03:39.955901+0000","last_clean":"2024-09-19T09:03:39.955901+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:03:39.955901+0000","last_undegraded":"2024-09-19T09:03:39.955901+0000","last_fullsized":"2024-09-19T09:03:39.955901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959198+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:03:39.959198+0000","last_peered":"2024-09-19T09:03:39.959198+0000","last_clean":"2024-09-19T09:03:39.959198+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:03:39.959198+0000","last_undegraded":"2024-09-19T09:03:39.959198+0000","last_fullsized":"2024-09-19T09:03:39.959198+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952610+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:03:39.952610+0000","last_peered":"2024-09-19T09:03:39.952610+0000","last_clean":"2024-09-19T09:03:39.952610+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:03:39.952610+0000","last_undegraded":"2024-09-19T09:03:39.952610+0000","last_fullsized":"2024-09-19T09:03:39.952610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:48.661339+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:03:48.661339+0000","last_peered":"2024-09-19T09:03:48.661339+0000","last_clean":"2024-09-19T09:03:48.661339+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:03:48.661339+0000","last_undegraded":"2024-09-19T09:03:48.661339+0000","last_fullsized":"2024-09-19T09:03:48.661339+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950481+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:03:39.950481+0000","last_peered":"2024-09-19T09:03:39.950481+0000","last_clean":"2024-09-19T09:03:39.950481+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:03:39.950481+0000","last_undegraded":"2024-09-19T09:03:39.950481+0000","last_fullsized":"2024-09-19T09:03:39.950481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953709+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:03:39.953709+0000","last_peered":"2024-09-19T09:03:39.953709+0000","last_clean":"2024-09-19T09:03:39.953709+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:03:39.953709+0000","last_undegraded":"2024-09-19T09:03:39.953709+0000","last_fullsized":"2024-09-19T09:03:39.953709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954288+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:03:39.954288+0000","last_peered":"2024-09-19T09:03:39.954288+0000","last_clean":"2024-09-19T09:03:39.954288+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:03:39.954288+0000","last_undegraded":"2024-09-19T09:03:39.954288+0000","last_fullsized":"2024-09-19T09:03:39.954288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:47.659140+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:03:47.659140+0000","last_peered":"2024-09-19T09:03:47.659140+0000","last_clean":"2024-09-19T09:03:47.659140+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:03:47.659140+0000","last_undegraded":"2024-09-19T09:03:47.659140+0000","last_fullsized":"2024-09-19T09:03:47.659140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967297+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:03:39.967297+0000","last_peered":"2024-09-19T09:03:39.967297+0000","last_clean":"2024-09-19T09:03:39.967297+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:03:39.967297+0000","last_undegraded":"2024-09-19T09:03:39.967297+0000","last_fullsized":"2024-09-19T09:03:39.967297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953419+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:03:39.953419+0000","last_peered":"2024-09-19T09:03:39.953419+0000","last_clean":"2024-09-19T09:03:39.953419+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:03:39.953419+0000","last_undegraded":"2024-09-19T09:03:39.953419+0000","last_fullsized":"2024-09-19T09:03:39.953419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966193+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:03:39.966193+0000","last_peered":"2024-09-19T09:03:39.966193+0000","last_clean":"2024-09-19T09:03:39.966193+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:03:39.966193+0000","last_undegraded":"2024-09-19T09:03:39.966193+0000","last_fullsized":"2024-09-19T09:03:39.966193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'36","reported_seq":267,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:48.848509+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:03:48.848509+0000","last_peered":"2024-09-19T09:03:48.848509+0000","last_clean":"2024-09-19T09:03:48.848509+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:03:48.848509+0000","last_undegraded":"2024-09-19T09:03:48.848509+0000","last_fullsized":"2024-09-19T09:03:48.848509+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71153,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":174,"num_write":37,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.961829+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:03:39.961829+0000","last_peered":"2024-09-19T09:03:39.961829+0000","last_clean":"2024-09-19T09:03:39.961829+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:03:39.961829+0000","last_undegraded":"2024-09-19T09:03:39.961829+0000","last_fullsized":"2024-09-19T09:03:39.961829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979339+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:03:39.979339+0000","last_peered":"2024-09-19T09:03:39.979339+0000","last_clean":"2024-09-19T09:03:39.979339+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:03:39.979339+0000","last_undegraded":"2024-09-19T09:03:39.979339+0000","last_fullsized":"2024-09-19T09:03:39.979339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966978+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:03:39.966978+0000","last_peered":"2024-09-19T09:03:39.966978+0000","last_clean":"2024-09-19T09:03:39.966978+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:03:39.966978+0000","last_undegraded":"2024-09-19T09:03:39.966978+0000","last_fullsized":"2024-09-19T09:03:39.966978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":125,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:47.833738+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:03:47.833738+0000","last_peered":"2024-09-19T09:03:47.833738+0000","last_clean":"2024-09-19T09:03:47.833738+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:03:47.833738+0000","last_undegraded":"2024-09-19T09:03:47.833738+0000","last_fullsized":"2024-09-19T09:03:47.833738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962145+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:03:39.962145+0000","last_peered":"2024-09-19T09:03:39.962145+0000","last_clean":"2024-09-19T09:03:39.962145+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:03:39.962145+0000","last_undegraded":"2024-09-19T09:03:39.962145+0000","last_fullsized":"2024-09-19T09:03:39.962145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959818+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:03:39.959818+0000","last_peered":"2024-09-19T09:03:39.959818+0000","last_clean":"2024-09-19T09:03:39.959818+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:03:39.959818+0000","last_undegraded":"2024-09-19T09:03:39.959818+0000","last_fullsized":"2024-09-19T09:03:39.959818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957934+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:03:39.957934+0000","last_peered":"2024-09-19T09:03:39.957934+0000","last_clean":"2024-09-19T09:03:39.957934+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:03:39.957934+0000","last_undegraded":"2024-09-19T09:03:39.957934+0000","last_fullsized":"2024-09-19T09:03:39.957934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964690+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:03:39.964690+0000","last_peered":"2024-09-19T09:03:39.964690+0000","last_clean":"2024-09-19T09:03:39.964690+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:03:39.964690+0000","last_undegraded":"2024-09-19T09:03:39.964690+0000","last_fullsized":"2024-09-19T09:03:39.964690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962180+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:03:39.962180+0000","last_peered":"2024-09-19T09:03:39.962180+0000","last_clean":"2024-09-19T09:03:39.962180+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:03:39.962180+0000","last_undegraded":"2024-09-19T09:03:39.962180+0000","last_fullsized":"2024-09-19T09:03:39.962180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964213+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:03:39.964213+0000","last_peered":"2024-09-19T09:03:39.964213+0000","last_clean":"2024-09-19T09:03:39.964213+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:03:39.964213+0000","last_undegraded":"2024-09-19T09:03:39.964213+0000","last_fullsized":"2024-09-19T09:03:39.964213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688290+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688290+0000","last_peered":"2024-09-19T09:02:11.688290+0000","last_clean":"2024-09-19T09:02:11.688290+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688290+0000","last_undegraded":"2024-09-19T09:02:11.688290+0000","last_fullsized":"2024-09-19T09:02:11.688290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947301+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:03:39.947301+0000","last_peered":"2024-09-19T09:03:39.947301+0000","last_clean":"2024-09-19T09:03:39.947301+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:03:39.947301+0000","last_undegraded":"2024-09-19T09:03:39.947301+0000","last_fullsized":"2024-09-19T09:03:39.947301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953996+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:03:39.953996+0000","last_peered":"2024-09-19T09:03:39.953996+0000","last_clean":"2024-09-19T09:03:39.953996+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:03:39.953996+0000","last_undegraded":"2024-09-19T09:03:39.953996+0000","last_fullsized":"2024-09-19T09:03:39.953996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:51.839503+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:03:51.839503+0000","last_peered":"2024-09-19T09:03:51.839503+0000","last_clean":"2024-09-19T09:03:51.839503+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:03:51.839503+0000","last_undegraded":"2024-09-19T09:03:51.839503+0000","last_fullsized":"2024-09-19T09:03:51.839503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955511+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:03:39.955511+0000","last_peered":"2024-09-19T09:03:39.955511+0000","last_clean":"2024-09-19T09:03:39.955511+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:03:39.955511+0000","last_undegraded":"2024-09-19T09:03:39.955511+0000","last_fullsized":"2024-09-19T09:03:39.955511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957047+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:03:39.957047+0000","last_peered":"2024-09-19T09:03:39.957047+0000","last_clean":"2024-09-19T09:03:39.957047+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:03:39.957047+0000","last_undegraded":"2024-09-19T09:03:39.957047+0000","last_fullsized":"2024-09-19T09:03:39.957047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954576+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:03:39.954576+0000","last_peered":"2024-09-19T09:03:39.954576+0000","last_clean":"2024-09-19T09:03:39.954576+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:03:39.954576+0000","last_undegraded":"2024-09-19T09:03:39.954576+0000","last_fullsized":"2024-09-19T09:03:39.954576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953774+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:03:39.953774+0000","last_peered":"2024-09-19T09:03:39.953774+0000","last_clean":"2024-09-19T09:03:39.953774+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:03:39.953774+0000","last_undegraded":"2024-09-19T09:03:39.953774+0000","last_fullsized":"2024-09-19T09:03:39.953774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'13","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:43.675473+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:03:43.675473+0000","last_peered":"2024-09-19T09:03:43.675473+0000","last_clean":"2024-09-19T09:03:43.675473+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:03:43.675473+0000","last_undegraded":"2024-09-19T09:03:43.675473+0000","last_fullsized":"2024-09-19T09:03:43.675473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947181+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:03:39.947181+0000","last_peered":"2024-09-19T09:03:39.947181+0000","last_clean":"2024-09-19T09:03:39.947181+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:03:39.947181+0000","last_undegraded":"2024-09-19T09:03:39.947181+0000","last_fullsized":"2024-09-19T09:03:39.947181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950637+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:03:39.950637+0000","last_peered":"2024-09-19T09:03:39.950637+0000","last_clean":"2024-09-19T09:03:39.950637+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:03:39.950637+0000","last_undegraded":"2024-09-19T09:03:39.950637+0000","last_fullsized":"2024-09-19T09:03:39.950637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941644+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:03:39.941644+0000","last_peered":"2024-09-19T09:03:39.941644+0000","last_clean":"2024-09-19T09:03:39.941644+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:03:39.941644+0000","last_undegraded":"2024-09-19T09:03:39.941644+0000","last_fullsized":"2024-09-19T09:03:39.941644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959045+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:03:39.959045+0000","last_peered":"2024-09-19T09:03:39.959045+0000","last_clean":"2024-09-19T09:03:39.959045+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:03:39.959045+0000","last_undegraded":"2024-09-19T09:03:39.959045+0000","last_fullsized":"2024-09-19T09:03:39.959045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686917+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686917+0000","last_peered":"2024-09-19T09:02:11.686917+0000","last_clean":"2024-09-19T09:02:11.686917+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686917+0000","last_undegraded":"2024-09-19T09:02:11.686917+0000","last_fullsized":"2024-09-19T09:02:11.686917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955275+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:03:39.955275+0000","last_peered":"2024-09-19T09:03:39.955275+0000","last_clean":"2024-09-19T09:03:39.955275+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:03:39.955275+0000","last_undegraded":"2024-09-19T09:03:39.955275+0000","last_fullsized":"2024-09-19T09:03:39.955275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964988+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:03:39.964988+0000","last_peered":"2024-09-19T09:03:39.964988+0000","last_clean":"2024-09-19T09:03:39.964988+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:03:39.964988+0000","last_undegraded":"2024-09-19T09:03:39.964988+0000","last_fullsized":"2024-09-19T09:03:39.964988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965901+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:03:39.965901+0000","last_peered":"2024-09-19T09:03:39.965901+0000","last_clean":"2024-09-19T09:03:39.965901+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:03:39.965901+0000","last_undegraded":"2024-09-19T09:03:39.965901+0000","last_fullsized":"2024-09-19T09:03:39.965901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967486+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:03:39.967486+0000","last_peered":"2024-09-19T09:03:39.967486+0000","last_clean":"2024-09-19T09:03:39.967486+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:03:39.967486+0000","last_undegraded":"2024-09-19T09:03:39.967486+0000","last_fullsized":"2024-09-19T09:03:39.967486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960510+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:03:39.960510+0000","last_peered":"2024-09-19T09:03:39.960510+0000","last_clean":"2024-09-19T09:03:39.960510+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:03:39.960510+0000","last_undegraded":"2024-09-19T09:03:39.960510+0000","last_fullsized":"2024-09-19T09:03:39.960510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953415+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:03:39.953415+0000","last_peered":"2024-09-19T09:03:39.953415+0000","last_clean":"2024-09-19T09:03:39.953415+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:03:39.953415+0000","last_undegraded":"2024-09-19T09:03:39.953415+0000","last_fullsized":"2024-09-19T09:03:39.953415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686208+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.686208+0000","last_peered":"2024-09-19T09:02:11.686208+0000","last_clean":"2024-09-19T09:02:11.686208+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.686208+0000","last_undegraded":"2024-09-19T09:02:11.686208+0000","last_fullsized":"2024-09-19T09:02:11.686208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75690,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":627,"num_read_kb":395,"num_write":180,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":227070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1089856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005101,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40956,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704196,"statfs":{"total":95995035648,"available":95953096704,"internally_reserved":0,"allocated":1486848,"data_stored":1019844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626493,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855425,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1019528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40380,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704772,"statfs":{"total":95995035648,"available":95953686528,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":500036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607638,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":497793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":73396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":72731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:03:55.440 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:03:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 -- 172.21.15.1:0/3028104643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102570 msgr2=0x7fc3a01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/3028104643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102570 0x7fc3a01029b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc390009900 tx=0x7fc39002a480 comp rx=0 tx=0).stop 2024-09-19T09:03:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 -- 172.21.15.1:0/3028104643 shutdown_connections 2024-09-19T09:03:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/3028104643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3a0102ef0 0x7fc3a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/3028104643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102570 0x7fc3a01029b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/3028104643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a0100e20 0x7fc3a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 -- 172.21.15.1:0/3028104643 >> 172.21.15.1:0/3028104643 conn(0x7fc3a00fc7d0 msgr2=0x7fc3a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 -- 172.21.15.1:0/3028104643 shutdown_connections 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.650+0000 7fc3a79c5640 1 -- 172.21.15.1:0/3028104643 wait complete. 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a79c5640 1 Processor -- start 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a79c5640 1 -- start start 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a79c5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3a0100e20 0x7fc3a01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a79c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a0102570 0x7fc3a0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a79c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102ef0 0x7fc3a019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a79c5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01110a0 con 0x7fc3a0102ef0 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a79c5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0110f20 con 0x7fc3a0102570 2024-09-19T09:03:55.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a79c5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0111220 con 0x7fc3a0100e20 2024-09-19T09:03:55.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a5f62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102ef0 0x7fc3a019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a5761640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3a0100e20 0x7fc3a01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a5f62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102ef0 0x7fc3a019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44490/0 (socket says 172.21.15.1:44490) 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a5f62640 1 -- 172.21.15.1:0/2464184024 learned_addr learned my addr 172.21.15.1:0/2464184024 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.651+0000 7fc3a5761640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3a0100e20 0x7fc3a01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:58630/0 (socket says 172.21.15.1:58630) 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a0102570 0x7fc3a0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3a5f62640 1 -- 172.21.15.1:0/2464184024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3a0100e20 msgr2=0x7fc3a01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3a0100e20 0x7fc3a01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3a5f62640 1 -- 172.21.15.1:0/2464184024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a0102570 msgr2=0x7fc3a0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a0102570 0x7fc3a0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3a5f62640 1 -- 172.21.15.1:0/2464184024 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a019d560 con 0x7fc3a0102ef0 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102ef0 0x7fc3a019ce80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc39800eaa0 tx=0x7fc39800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3967fc640 1 -- 172.21.15.1:0/2464184024 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39800cdb0 con 0x7fc3a0102ef0 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3967fc640 1 -- 172.21.15.1:0/2464184024 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc398004b20 con 0x7fc3a0102ef0 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.652+0000 7fc3a79c5640 1 -- 172.21.15.1:0/2464184024 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a019d850 con 0x7fc3a0102ef0 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.653+0000 7fc3967fc640 1 -- 172.21.15.1:0/2464184024 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398011760 con 0x7fc3a0102ef0 2024-09-19T09:03:55.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.653+0000 7fc3a79c5640 1 -- 172.21.15.1:0/2464184024 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a01a5130 con 0x7fc3a0102ef0 2024-09-19T09:03:55.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.655+0000 7fc3967fc640 1 -- 172.21.15.1:0/2464184024 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fc398004cd0 con 0x7fc3a0102ef0 2024-09-19T09:03:55.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:55 smithi001 ceph-mon[30939]: pgmap v332: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:03:55.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:55 smithi001 ceph-mon[30939]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:55.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.656+0000 7fc3a9d9e740 1 Processor -- start 2024-09-19T09:03:55.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.656+0000 7fc3a9d9e740 1 -- start start 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.656+0000 7fc3967fc640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc38c0a32d0 0x7fc38c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c6903f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c6904a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c68fa52e0 con 0x557c6903f4a0 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557c68f4cce0 con 0x557c6903fdc0 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557c68fa12a0 con 0x557c6904a680 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3967fc640 1 -- 172.21.15.1:0/2464184024 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc3980cfd40 con 0x7fc3a0102ef0 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5f62640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5f62640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:58634/0 (socket says 172.21.15.1:58634) 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5f62640 1 -- 172.21.15.1:0/1937104153 learned_addr learned my addr 172.21.15.1:0/1937104153 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c6904a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5761640 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c6903f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc38c0a32d0 0x7fc38c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5f62640 1 -- 172.21.15.1:0/1937104153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 msgr2=0x557c6904a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c6904a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5f62640 1 -- 172.21.15.1:0/1937104153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 msgr2=0x557c6903f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c6903f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.657+0000 7fc3a5f62640 1 -- 172.21.15.1:0/1937104153 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c68f31440 con 0x557c6904a680 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.658+0000 7fc3a5761640 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c6903f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.658+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc38c0a32d0 0x7fc38c0a5790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00ff060 tx=0x7fc39002a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.658+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904ca70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc398098bb0 tx=0x7fc398013d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=533d9ef8982d4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.658+0000 7fc38b7fe640 1 -- 172.21.15.1:0/1937104153 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39801f040 con 0x557c6904a680 2024-09-19T09:03:55.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.658+0000 7fc38b7fe640 1 -- 172.21.15.1:0/1937104153 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc398013680 con 0x557c6904a680 2024-09-19T09:03:55.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.658+0000 7fc38b7fe640 1 -- 172.21.15.1:0/1937104153 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980cd920 con 0x557c6904a680 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1937104153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 msgr2=0x557c6904ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904ca70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc398098bb0 tx=0x7fc398013d70 comp rx=0 tx=0).stop 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1937104153 shutdown_connections 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904ca70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c6904a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/1937104153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c6903f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1937104153 >> 172.21.15.1:0/1937104153 conn(0x557c6903ba30 msgr2=0x557c6903be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1937104153 shutdown_connections 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.659+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1937104153 wait complete. 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.660+0000 7fc3a9d9e740 1 -- start start 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.660+0000 7fc3a9d9e740 1 Processor -- start 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 0x557c6904a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c690472f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690478e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557c6904d250 con 0x557c6904a680 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557c68f60050 con 0x557c6903fdc0 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557c6904d3d0 con 0x557c6903f4a0 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a9d9e740 10 client.0 _ll_register_callbacks cb 0x557c68fa0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a4f60640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c690472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a4f60640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c690472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:38190/0 (socket says 172.21.15.1:38190) 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a4f60640 1 -- 172.21.15.1:0/2880298275 learned_addr learned my addr 172.21.15.1:0/2880298275 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a5761640 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 0x557c6904a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a4f60640 1 -- 172.21.15.1:0/2880298275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 msgr2=0x557c6904a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 0x557c6904a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a4f60640 1 -- 172.21.15.1:0/2880298275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 msgr2=0x557c690478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.661+0000 7fc3a4f60640 1 -- 172.21.15.1:0/2880298275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c68d163c0 con 0x557c6903fdc0 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.662+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c690472f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc390009900 tx=0x7fc390009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a5a0bc5520eeb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.662+0000 7fc388ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.662+0000 7fc388ff9640 1 -- 172.21.15.1:0/2880298275 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39004f070 con 0x557c6903fdc0 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.662+0000 7fc388ff9640 1 -- 172.21.15.1:0/2880298275 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc390003ac0 con 0x557c6903fdc0 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.662+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2880298275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc398013680 con 0x557c6903fdc0 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.662+0000 7fc388ff9640 1 -- 172.21.15.1:0/2880298275 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc39005b050 con 0x557c6903fdc0 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a9d9e740 10 client.24935 fetch_fsmap learned FSMap version 24 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2880298275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557c69058c70 con 0x557c6903fdc0 2024-09-19T09:03:55.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc388ff9640 1 -- 172.21.15.1:0/2880298275 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc398013680 con 0x557c6903fdc0 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc388ff9640 1 -- 172.21.15.1:0/2880298275 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc39003a040 con 0x557c6903fdc0 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a9d9e740 10 client.24935 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a9d9e740 10 client.24935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a9d9e740 20 client.24935 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557c6905a590 0x557c6905c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a9d9e740 4 client.24935 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2880298275 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c68fb2850 con 0x557c6905a590 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.663+0000 7fc3a5761640 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557c6905a590 0x557c6905c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.664+0000 7fc3a5761640 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557c6905a590 0x557c6905c9b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57e4e9070b6b51c7 server_cookie=e3cd90858a63d2e5 in_seq=0 out_seq=0 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.664+0000 7fc388ff9640 10 client.24935 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc388ff9640 1 -- 172.21.15.1:0/2880298275 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c68fb2850 con 0x557c6905a590 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc388ff9640 10 client.24935 handle_command_reply: tid=0 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 client.24935 shutdown 2024-09-19T09:03:55.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2880298275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 msgr2=0x557c690472f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c690472f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc390009900 tx=0x7fc390009260 comp rx=0 tx=0).stop 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2880298275 shutdown_connections 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557c6905a590 0x557c6905c9b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c690472f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2880298275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 0x557c6904a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2880298275 >> 172.21.15.1:0/2880298275 conn(0x557c6903ba30 msgr2=0x557c69041710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc388ff9640 0 client.24935 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2880298275 shutdown_connections 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2880298275 wait complete. 2024-09-19T09:03:55.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.665+0000 7fc3a9d9e740 20 client.24935 trim_cache size 0 max 16384 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a9d9e740 1 Processor -- start 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a9d9e740 1 -- start start 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 0x557c690564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69045bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01adef0 con 0x557c6904a680 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01ab7c0 con 0x557c6903fdc0 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01a9610 con 0x557c6903f4a0 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5f62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5f62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44526/0 (socket says 172.21.15.1:44526) 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5f62640 1 -- 172.21.15.1:0/1643025977 learned_addr learned my addr 172.21.15.1:0/1643025977 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69045bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5761640 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 0x557c690564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5f62640 1 -- 172.21.15.1:0/1643025977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 msgr2=0x557c690564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 0x557c690564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5f62640 1 -- 172.21.15.1:0/1643025977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 msgr2=0x557c69045bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69045bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a5f62640 1 -- 172.21.15.1:0/1643025977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c690462a0 con 0x557c6904a680 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.688+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69045bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.689+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690427f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc398098640 tx=0x7fc398009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63edd29595830e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.689+0000 7fc38affd640 1 -- 172.21.15.1:0/1643025977 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39801f040 con 0x557c6904a680 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.689+0000 7fc38affd640 1 -- 172.21.15.1:0/1643025977 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc39809c1e0 con 0x557c6904a680 2024-09-19T09:03:55.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.689+0000 7fc38affd640 1 -- 172.21.15.1:0/1643025977 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980cd920 con 0x557c6904a680 2024-09-19T09:03:55.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1643025977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 msgr2=0x557c690427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690427f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc398098640 tx=0x7fc398009230 comp rx=0 tx=0).stop 2024-09-19T09:03:55.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1643025977 shutdown_connections 2024-09-19T09:03:55.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6904a680 0x557c690427f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69045bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/1643025977 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6903f4a0 0x557c690564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1643025977 >> 172.21.15.1:0/1643025977 conn(0x557c6903ba30 msgr2=0x557c690420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1643025977 shutdown_connections 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/1643025977 wait complete. 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 -- start start 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.690+0000 7fc3a9d9e740 1 Processor -- start 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c690529a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69052ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a9d9e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01a9c80 con 0x557c6903f4a0 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01ab0f0 con 0x557c6903fdc0 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a9d9e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01aa350 con 0x557c6904a680 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a9d9e740 10 client.0 _ll_register_callbacks cb 0x7fc390005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5761640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c690529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5761640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c690529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44540/0 (socket says 172.21.15.1:44540) 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5761640 1 -- 172.21.15.1:0/2988898720 learned_addr learned my addr 172.21.15.1:0/2988898720 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5f62640 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69052ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5761640 1 -- 172.21.15.1:0/2988898720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 msgr2=0x557c6904df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5761640 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5761640 1 -- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 msgr2=0x557c69052ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5761640 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69052ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a5761640 1 -- 172.21.15.1:0/2988898720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6904a3b0 con 0x557c6903f4a0 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.691+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69052ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.692+0000 7fc3a5761640 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c690529a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x557c6905d220 tx=0x7fc39c004b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debc80f1587c4f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.692+0000 7fc388ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.692+0000 7fc388ff9640 1 -- 172.21.15.1:0/2988898720 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c02d060 con 0x557c6903f4a0 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.692+0000 7fc388ff9640 1 -- 172.21.15.1:0/2988898720 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc39c00ac50 con 0x557c6903f4a0 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.692+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2988898720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39809c1e0 con 0x557c6903f4a0 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.692+0000 7fc388ff9640 1 -- 172.21.15.1:0/2988898720 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc39c0056d0 con 0x557c6903f4a0 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.692+0000 7fc3a9d9e740 10 client.15261 fetch_fsmap learned FSMap version 24 2024-09-19T09:03:55.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.692+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2988898720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557c690c4d40 con 0x557c6903f4a0 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc388ff9640 1 -- 172.21.15.1:0/2988898720 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc39809c1e0 con 0x557c6903f4a0 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc388ff9640 1 -- 172.21.15.1:0/2988898720 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc39c01e3f0 con 0x557c6903f4a0 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc3a9d9e740 10 client.15261 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc3a9d9e740 10 client.15261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc3a9d9e740 20 client.15261 populate_metadata read hostname 'smithi001' 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557c690c5490 0x557c690c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc3a9d9e740 4 client.15261 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2988898720 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c68facd60 con 0x557c690c5490 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.693+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557c690c5490 0x557c690c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a4f60640 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557c690c5490 0x557c690c78b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74577b6c6573f272 server_cookie=d5daf9b8df194654 in_seq=0 out_seq=0 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc388ff9640 10 client.15261 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc388ff9640 1 -- 172.21.15.1:0/2988898720 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557c68facd60 con 0x557c690c5490 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc388ff9640 10 client.15261 handle_command_reply: tid=0 2024-09-19T09:03:55.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 client.15261 shutdown 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2988898720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 msgr2=0x557c690529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c690529a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x557c6905d220 tx=0x7fc39c004b70 comp rx=0 tx=0).stop 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2988898720 shutdown_connections 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557c690c5490 0x557c690c78b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557c6904a680 0x557c6904df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557c6903fdc0 0x557c69052ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 --2- 172.21.15.1:0/2988898720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557c6903f4a0 0x557c690529a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2988898720 >> 172.21.15.1:0/2988898720 conn(0x557c6903ba30 msgr2=0x557c69048b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc388ff9640 0 client.15261 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2988898720 shutdown_connections 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 1 -- 172.21.15.1:0/2988898720 wait complete. 2024-09-19T09:03:55.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.694+0000 7fc3a9d9e740 20 client.15261 trim_cache size 0 max 16384 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "7cec2f62-811d-4122-821c-03f905275cb1": { 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "7cec2f62-811d-4122-821c-03f905275cb1", 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:03:55.701 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:03:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 -- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc38c0a32d0 msgr2=0x7fc38c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc38c0a32d0 0x7fc38c0a5790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00ff060 tx=0x7fc39002a480 comp rx=0 tx=0).stop 2024-09-19T09:03:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 -- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102ef0 msgr2=0x7fc3a019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102ef0 0x7fc3a019ce80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc39800eaa0 tx=0x7fc39800ef60 comp rx=0 tx=0).stop 2024-09-19T09:03:55.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 -- 172.21.15.1:0/2464184024 shutdown_connections 2024-09-19T09:03:55.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3a0102ef0 0x7fc3a019ce80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc3a0102570 0x7fc3a0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc38c0a32d0 0x7fc38c0a5790 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 --2- 172.21.15.1:0/2464184024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3a0100e20 0x7fc3a01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 -- 172.21.15.1:0/2464184024 >> 172.21.15.1:0/2464184024 conn(0x7fc3a00fc7d0 msgr2=0x7fc3a006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 -- 172.21.15.1:0/2464184024 shutdown_connections 2024-09-19T09:03:55.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:55.695+0000 7fc3a79c5640 1 -- 172.21.15.1:0/2464184024 wait complete. 2024-09-19T09:03:55.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:55 smithi022 ceph-mon[35107]: pgmap v332: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:03:55.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:55 smithi022 ceph-mon[35107]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:55.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:55 smithi064 ceph-mon[35179]: pgmap v332: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:03:55.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:55 smithi064 ceph-mon[35179]: from='client.15243 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:55.912 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:56.389 INFO:tasks.cephfs.filesystem:scrub status for tag:7cec2f62-811d-4122-821c-03f905275cb1 - {'path': '/', 'tag': '7cec2f62-811d-4122-821c-03f905275cb1', 'options': 'recursive,force'} 2024-09-19T09:03:56.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 -- 172.21.15.1:0/1047159182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424100a80 msgr2=0x7fd424100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:56.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 --2- 172.21.15.1:0/1047159182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424100a80 0x7fd424100ee0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd418009930 tx=0x7fd41802a420 comp rx=0 tx=0).stop 2024-09-19T09:03:56.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 -- 172.21.15.1:0/1047159182 shutdown_connections 2024-09-19T09:03:56.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 --2- 172.21.15.1:0/1047159182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd424101420 0x7fd42410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:56.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 --2- 172.21.15.1:0/1047159182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424100a80 0x7fd424100ee0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:56.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 --2- 172.21.15.1:0/1047159182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd424106a80 0x7fd424106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:56.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 -- 172.21.15.1:0/1047159182 >> 172.21.15.1:0/1047159182 conn(0x7fd4240fc7a0 msgr2=0x7fd4240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:56.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 -- 172.21.15.1:0/1047159182 shutdown_connections 2024-09-19T09:03:56.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.845+0000 7fd4291c6640 1 -- 172.21.15.1:0/1047159182 wait complete. 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd4291c6640 1 Processor -- start 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd4291c6640 1 -- start start 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd4291c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd424100a80 0x7fd4240fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd4291c6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd424101420 0x7fd4240fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd4291c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424106a80 0x7fd4240fd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd4291c6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd424110fb0 con 0x7fd424106a80 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd4291c6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd424110e30 con 0x7fd424100a80 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd4291c6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd424111130 con 0x7fd424101420 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.846+0000 7fd42359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424106a80 0x7fd4240fd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424106a80 0x7fd4240fd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44560/0 (socket says 172.21.15.1:44560) 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd422d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd424100a80 0x7fd4240fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:56.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42359e640 1 -- 172.21.15.1:0/3850306964 learned_addr learned my addr 172.21.15.1:0/3850306964 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42259c640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd424101420 0x7fd4240fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42359e640 1 -- 172.21.15.1:0/3850306964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd424101420 msgr2=0x7fd4240fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42359e640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd424101420 0x7fd4240fd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42359e640 1 -- 172.21.15.1:0/3850306964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd424100a80 msgr2=0x7fd4240fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42359e640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd424100a80 0x7fd4240fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42359e640 1 -- 172.21.15.1:0/3850306964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4241a69c0 con 0x7fd424106a80 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd42359e640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424106a80 0x7fd4240fd6d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00d750 tx=0x7fd41c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd40bfff640 1 -- 172.21.15.1:0/3850306964 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c017070 con 0x7fd424106a80 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd40bfff640 1 -- 172.21.15.1:0/3850306964 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd41c005520 con 0x7fd424106a80 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4241a6cb0 con 0x7fd424106a80 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd40bfff640 1 -- 172.21.15.1:0/3850306964 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c004e00 con 0x7fd424106a80 2024-09-19T09:03:56.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.847+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4241a71c0 con 0x7fd424106a80 2024-09-19T09:03:56.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.848+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd424100ee0 con 0x7fd424106a80 2024-09-19T09:03:56.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.850+0000 7fd40bfff640 1 -- 172.21.15.1:0/3850306964 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fd41c004fa0 con 0x7fd424106a80 2024-09-19T09:03:56.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.850+0000 7fd40bfff640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd40c0a3350 0x7fd40c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:56.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.851+0000 7fd422d9d640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd40c0a3350 0x7fd40c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:56.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.851+0000 7fd40bfff640 1 -- 172.21.15.1:0/3850306964 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd41c0cf3a0 con 0x7fd424106a80 2024-09-19T09:03:56.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.851+0000 7fd422d9d640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd40c0a3350 0x7fd40c0a5810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd414007e40 tx=0x7fd4140075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:56.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:56.855+0000 7fd40bfff640 1 -- 172.21.15.1:0/3850306964 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd41c09b8f0 con 0x7fd424106a80 2024-09-19T09:03:57.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.028+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd424062630 con 0x7fd40c0a3350 2024-09-19T09:03:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.037+0000 7fd40bfff640 1 -- 172.21.15.1:0/3850306964 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258839 (secure 0 0 0) 0x7fd424062630 con 0x7fd40c0a3350 2024-09-19T09:03:57.040 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:57.041 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:03:57.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.039+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd40c0a3350 msgr2=0x7fd40c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.039+0000 7fd4291c6640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd40c0a3350 0x7fd40c0a5810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd414007e40 tx=0x7fd4140075b0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.039+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424106a80 msgr2=0x7fd4240fd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.039+0000 7fd4291c6640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424106a80 0x7fd4240fd6d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00d750 tx=0x7fd41c00dc10 comp rx=0 tx=0).stop 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.040+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 shutdown_connections 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.040+0000 7fd4291c6640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd424106a80 0x7fd4240fd6d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.040+0000 7fd4291c6640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd40c0a3350 0x7fd40c0a5810 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.040+0000 7fd4291c6640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd424101420 0x7fd4240fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.040+0000 7fd4291c6640 1 --2- 172.21.15.1:0/3850306964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd424100a80 0x7fd4240fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.040+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 >> 172.21.15.1:0/3850306964 conn(0x7fd4240fc7a0 msgr2=0x7fd42406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.040+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 shutdown_connections 2024-09-19T09:03:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:57.040+0000 7fd4291c6640 1 -- 172.21.15.1:0/3850306964 wait complete. 2024-09-19T09:03:57.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:57 smithi022 ceph-mon[35107]: pgmap v333: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T09:03:57.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:57 smithi001 ceph-mon[30939]: pgmap v333: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T09:03:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:57 smithi064 ceph-mon[35179]: pgmap v333: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T09:03:57.860 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-19T09:03:55.964643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666292,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":780,"num_read_kb":516,"num_write":363,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":403280,"kb_used_data":12432,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124538544,"statfs":{"total":1151940427776,"available":1151527469056,"internally_reserved":0,"allocated":12730368,"data_stored":7118556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":400012604},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9236,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":55,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003018"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967625+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:03:39.967625+0000","last_peered":"2024-09-19T09:03:39.967625+0000","last_clean":"2024-09-19T09:03:39.967625+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:03:39.967625+0000","last_undegraded":"2024-09-19T09:03:39.967625+0000","last_fullsized":"2024-09-19T09:03:39.967625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951240+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:03:39.951240+0000","last_peered":"2024-09-19T09:03:39.951240+0000","last_clean":"2024-09-19T09:03:39.951240+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:03:39.951240+0000","last_undegraded":"2024-09-19T09:03:39.951240+0000","last_fullsized":"2024-09-19T09:03:39.951240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960322+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:03:39.960322+0000","last_peered":"2024-09-19T09:03:39.960322+0000","last_clean":"2024-09-19T09:03:39.960322+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:03:39.960322+0000","last_undegraded":"2024-09-19T09:03:39.960322+0000","last_fullsized":"2024-09-19T09:03:39.960322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950848+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:03:39.950848+0000","last_peered":"2024-09-19T09:03:39.950848+0000","last_clean":"2024-09-19T09:03:39.950848+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:03:39.950848+0000","last_undegraded":"2024-09-19T09:03:39.950848+0000","last_fullsized":"2024-09-19T09:03:39.950848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.936295+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:03:39.936295+0000","last_peered":"2024-09-19T09:03:39.936295+0000","last_clean":"2024-09-19T09:03:39.936295+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:03:39.936295+0000","last_undegraded":"2024-09-19T09:03:39.936295+0000","last_fullsized":"2024-09-19T09:03:39.936295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.956562+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:03:39.956562+0000","last_peered":"2024-09-19T09:03:39.956562+0000","last_clean":"2024-09-19T09:03:39.956562+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:03:39.956562+0000","last_undegraded":"2024-09-19T09:03:39.956562+0000","last_fullsized":"2024-09-19T09:03:39.956562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965237+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:03:39.965237+0000","last_peered":"2024-09-19T09:03:39.965237+0000","last_clean":"2024-09-19T09:03:39.965237+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:03:39.965237+0000","last_undegraded":"2024-09-19T09:03:39.965237+0000","last_fullsized":"2024-09-19T09:03:39.965237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957157+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:03:39.957157+0000","last_peered":"2024-09-19T09:03:39.957157+0000","last_clean":"2024-09-19T09:03:39.957157+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:03:39.957157+0000","last_undegraded":"2024-09-19T09:03:39.957157+0000","last_fullsized":"2024-09-19T09:03:39.957157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966943+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:03:39.966943+0000","last_peered":"2024-09-19T09:03:39.966943+0000","last_clean":"2024-09-19T09:03:39.966943+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:03:39.966943+0000","last_undegraded":"2024-09-19T09:03:39.966943+0000","last_fullsized":"2024-09-19T09:03:39.966943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.958176+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:03:39.958176+0000","last_peered":"2024-09-19T09:03:39.958176+0000","last_clean":"2024-09-19T09:03:39.958176+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:03:39.958176+0000","last_undegraded":"2024-09-19T09:03:39.958176+0000","last_fullsized":"2024-09-19T09:03:39.958176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964976+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:03:39.964976+0000","last_peered":"2024-09-19T09:03:39.964976+0000","last_clean":"2024-09-19T09:03:39.964976+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:03:39.964976+0000","last_undegraded":"2024-09-19T09:03:39.964976+0000","last_fullsized":"2024-09-19T09:03:39.964976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941887+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:03:39.941887+0000","last_peered":"2024-09-19T09:03:39.941887+0000","last_clean":"2024-09-19T09:03:39.941887+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:03:39.941887+0000","last_undegraded":"2024-09-19T09:03:39.941887+0000","last_fullsized":"2024-09-19T09:03:39.941887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.948226+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:03:39.948226+0000","last_peered":"2024-09-19T09:03:39.948226+0000","last_clean":"2024-09-19T09:03:39.948226+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:03:39.948226+0000","last_undegraded":"2024-09-19T09:03:39.948226+0000","last_fullsized":"2024-09-19T09:03:39.948226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951997+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:03:39.951997+0000","last_peered":"2024-09-19T09:03:39.951997+0000","last_clean":"2024-09-19T09:03:39.951997+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:03:39.951997+0000","last_undegraded":"2024-09-19T09:03:39.951997+0000","last_fullsized":"2024-09-19T09:03:39.951997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950575+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:03:39.950575+0000","last_peered":"2024-09-19T09:03:39.950575+0000","last_clean":"2024-09-19T09:03:39.950575+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:03:39.950575+0000","last_undegraded":"2024-09-19T09:03:39.950575+0000","last_fullsized":"2024-09-19T09:03:39.950575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.963547+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:03:39.963547+0000","last_peered":"2024-09-19T09:03:39.963547+0000","last_clean":"2024-09-19T09:03:39.963547+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:03:39.963547+0000","last_undegraded":"2024-09-19T09:03:39.963547+0000","last_fullsized":"2024-09-19T09:03:39.963547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967695+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:03:39.967695+0000","last_peered":"2024-09-19T09:03:39.967695+0000","last_clean":"2024-09-19T09:03:39.967695+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:03:39.967695+0000","last_undegraded":"2024-09-19T09:03:39.967695+0000","last_fullsized":"2024-09-19T09:03:39.967695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962356+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:03:39.962356+0000","last_peered":"2024-09-19T09:03:39.962356+0000","last_clean":"2024-09-19T09:03:39.962356+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:03:39.962356+0000","last_undegraded":"2024-09-19T09:03:39.962356+0000","last_fullsized":"2024-09-19T09:03:39.962356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957485+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:03:39.957485+0000","last_peered":"2024-09-19T09:03:39.957485+0000","last_clean":"2024-09-19T09:03:39.957485+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:03:39.957485+0000","last_undegraded":"2024-09-19T09:03:39.957485+0000","last_fullsized":"2024-09-19T09:03:39.957485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957966+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:03:39.957966+0000","last_peered":"2024-09-19T09:03:39.957966+0000","last_clean":"2024-09-19T09:03:39.957966+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:03:39.957966+0000","last_undegraded":"2024-09-19T09:03:39.957966+0000","last_fullsized":"2024-09-19T09:03:39.957966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979621+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:03:39.979621+0000","last_peered":"2024-09-19T09:03:39.979621+0000","last_clean":"2024-09-19T09:03:39.979621+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:03:39.979621+0000","last_undegraded":"2024-09-19T09:03:39.979621+0000","last_fullsized":"2024-09-19T09:03:39.979621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965614+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:03:39.965614+0000","last_peered":"2024-09-19T09:03:39.965614+0000","last_clean":"2024-09-19T09:03:39.965614+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:03:39.965614+0000","last_undegraded":"2024-09-19T09:03:39.965614+0000","last_fullsized":"2024-09-19T09:03:39.965614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955089+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:03:39.955089+0000","last_peered":"2024-09-19T09:03:39.955089+0000","last_clean":"2024-09-19T09:03:39.955089+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:03:39.955089+0000","last_undegraded":"2024-09-19T09:03:39.955089+0000","last_fullsized":"2024-09-19T09:03:39.955089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952591+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:03:39.952591+0000","last_peered":"2024-09-19T09:03:39.952591+0000","last_clean":"2024-09-19T09:03:39.952591+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:03:39.952591+0000","last_undegraded":"2024-09-19T09:03:39.952591+0000","last_fullsized":"2024-09-19T09:03:39.952591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950831+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:03:39.950831+0000","last_peered":"2024-09-19T09:03:39.950831+0000","last_clean":"2024-09-19T09:03:39.950831+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:03:39.950831+0000","last_undegraded":"2024-09-19T09:03:39.950831+0000","last_fullsized":"2024-09-19T09:03:39.950831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966529+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:03:39.966529+0000","last_peered":"2024-09-19T09:03:39.966529+0000","last_clean":"2024-09-19T09:03:39.966529+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:03:39.966529+0000","last_undegraded":"2024-09-19T09:03:39.966529+0000","last_fullsized":"2024-09-19T09:03:39.966529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952375+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:03:39.952375+0000","last_peered":"2024-09-19T09:03:39.952375+0000","last_clean":"2024-09-19T09:03:39.952375+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:03:39.952375+0000","last_undegraded":"2024-09-19T09:03:39.952375+0000","last_fullsized":"2024-09-19T09:03:39.952375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950943+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:03:39.950943+0000","last_peered":"2024-09-19T09:03:39.950943+0000","last_clean":"2024-09-19T09:03:39.950943+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:03:39.950943+0000","last_undegraded":"2024-09-19T09:03:39.950943+0000","last_fullsized":"2024-09-19T09:03:39.950943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955565+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:03:39.955565+0000","last_peered":"2024-09-19T09:03:39.955565+0000","last_clean":"2024-09-19T09:03:39.955565+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:03:39.955565+0000","last_undegraded":"2024-09-19T09:03:39.955565+0000","last_fullsized":"2024-09-19T09:03:39.955565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957500+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:03:39.957500+0000","last_peered":"2024-09-19T09:03:39.957500+0000","last_clean":"2024-09-19T09:03:39.957500+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:03:39.957500+0000","last_undegraded":"2024-09-19T09:03:39.957500+0000","last_fullsized":"2024-09-19T09:03:39.957500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955901+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:03:39.955901+0000","last_peered":"2024-09-19T09:03:39.955901+0000","last_clean":"2024-09-19T09:03:39.955901+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:03:39.955901+0000","last_undegraded":"2024-09-19T09:03:39.955901+0000","last_fullsized":"2024-09-19T09:03:39.955901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959198+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:03:39.959198+0000","last_peered":"2024-09-19T09:03:39.959198+0000","last_clean":"2024-09-19T09:03:39.959198+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:03:39.959198+0000","last_undegraded":"2024-09-19T09:03:39.959198+0000","last_fullsized":"2024-09-19T09:03:39.959198+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952610+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:03:39.952610+0000","last_peered":"2024-09-19T09:03:39.952610+0000","last_clean":"2024-09-19T09:03:39.952610+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:03:39.952610+0000","last_undegraded":"2024-09-19T09:03:39.952610+0000","last_fullsized":"2024-09-19T09:03:39.952610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:53.670220+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:03:53.670220+0000","last_peered":"2024-09-19T09:03:53.670220+0000","last_clean":"2024-09-19T09:03:53.670220+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:03:53.670220+0000","last_undegraded":"2024-09-19T09:03:53.670220+0000","last_fullsized":"2024-09-19T09:03:53.670220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950481+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:03:39.950481+0000","last_peered":"2024-09-19T09:03:39.950481+0000","last_clean":"2024-09-19T09:03:39.950481+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:03:39.950481+0000","last_undegraded":"2024-09-19T09:03:39.950481+0000","last_fullsized":"2024-09-19T09:03:39.950481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953709+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:03:39.953709+0000","last_peered":"2024-09-19T09:03:39.953709+0000","last_clean":"2024-09-19T09:03:39.953709+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:03:39.953709+0000","last_undegraded":"2024-09-19T09:03:39.953709+0000","last_fullsized":"2024-09-19T09:03:39.953709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954288+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:03:39.954288+0000","last_peered":"2024-09-19T09:03:39.954288+0000","last_clean":"2024-09-19T09:03:39.954288+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:03:39.954288+0000","last_undegraded":"2024-09-19T09:03:39.954288+0000","last_fullsized":"2024-09-19T09:03:39.954288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":129,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:52.667710+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:03:52.667710+0000","last_peered":"2024-09-19T09:03:52.667710+0000","last_clean":"2024-09-19T09:03:52.667710+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:03:52.667710+0000","last_undegraded":"2024-09-19T09:03:52.667710+0000","last_fullsized":"2024-09-19T09:03:52.667710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967297+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:03:39.967297+0000","last_peered":"2024-09-19T09:03:39.967297+0000","last_clean":"2024-09-19T09:03:39.967297+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:03:39.967297+0000","last_undegraded":"2024-09-19T09:03:39.967297+0000","last_fullsized":"2024-09-19T09:03:39.967297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953419+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:03:39.953419+0000","last_peered":"2024-09-19T09:03:39.953419+0000","last_clean":"2024-09-19T09:03:39.953419+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:03:39.953419+0000","last_undegraded":"2024-09-19T09:03:39.953419+0000","last_fullsized":"2024-09-19T09:03:39.953419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966193+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:03:39.966193+0000","last_peered":"2024-09-19T09:03:39.966193+0000","last_clean":"2024-09-19T09:03:39.966193+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:03:39.966193+0000","last_undegraded":"2024-09-19T09:03:39.966193+0000","last_fullsized":"2024-09-19T09:03:39.966193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'36","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:53.855466+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:03:53.855466+0000","last_peered":"2024-09-19T09:03:53.855466+0000","last_clean":"2024-09-19T09:03:53.855466+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:03:53.855466+0000","last_undegraded":"2024-09-19T09:03:53.855466+0000","last_fullsized":"2024-09-19T09:03:53.855466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71153,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":180,"num_write":37,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.961829+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:03:39.961829+0000","last_peered":"2024-09-19T09:03:39.961829+0000","last_clean":"2024-09-19T09:03:39.961829+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:03:39.961829+0000","last_undegraded":"2024-09-19T09:03:39.961829+0000","last_fullsized":"2024-09-19T09:03:39.961829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979339+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:03:39.979339+0000","last_peered":"2024-09-19T09:03:39.979339+0000","last_clean":"2024-09-19T09:03:39.979339+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:03:39.979339+0000","last_undegraded":"2024-09-19T09:03:39.979339+0000","last_fullsized":"2024-09-19T09:03:39.979339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966978+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:03:39.966978+0000","last_peered":"2024-09-19T09:03:39.966978+0000","last_clean":"2024-09-19T09:03:39.966978+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:03:39.966978+0000","last_undegraded":"2024-09-19T09:03:39.966978+0000","last_fullsized":"2024-09-19T09:03:39.966978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:52.841513+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:03:52.841513+0000","last_peered":"2024-09-19T09:03:52.841513+0000","last_clean":"2024-09-19T09:03:52.841513+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:03:52.841513+0000","last_undegraded":"2024-09-19T09:03:52.841513+0000","last_fullsized":"2024-09-19T09:03:52.841513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962145+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:03:39.962145+0000","last_peered":"2024-09-19T09:03:39.962145+0000","last_clean":"2024-09-19T09:03:39.962145+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:03:39.962145+0000","last_undegraded":"2024-09-19T09:03:39.962145+0000","last_fullsized":"2024-09-19T09:03:39.962145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959818+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:03:39.959818+0000","last_peered":"2024-09-19T09:03:39.959818+0000","last_clean":"2024-09-19T09:03:39.959818+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:03:39.959818+0000","last_undegraded":"2024-09-19T09:03:39.959818+0000","last_fullsized":"2024-09-19T09:03:39.959818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957934+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:03:39.957934+0000","last_peered":"2024-09-19T09:03:39.957934+0000","last_clean":"2024-09-19T09:03:39.957934+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:03:39.957934+0000","last_undegraded":"2024-09-19T09:03:39.957934+0000","last_fullsized":"2024-09-19T09:03:39.957934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964690+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:03:39.964690+0000","last_peered":"2024-09-19T09:03:39.964690+0000","last_clean":"2024-09-19T09:03:39.964690+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:03:39.964690+0000","last_undegraded":"2024-09-19T09:03:39.964690+0000","last_fullsized":"2024-09-19T09:03:39.964690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962180+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:03:39.962180+0000","last_peered":"2024-09-19T09:03:39.962180+0000","last_clean":"2024-09-19T09:03:39.962180+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:03:39.962180+0000","last_undegraded":"2024-09-19T09:03:39.962180+0000","last_fullsized":"2024-09-19T09:03:39.962180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964213+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:03:39.964213+0000","last_peered":"2024-09-19T09:03:39.964213+0000","last_clean":"2024-09-19T09:03:39.964213+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:03:39.964213+0000","last_undegraded":"2024-09-19T09:03:39.964213+0000","last_fullsized":"2024-09-19T09:03:39.964213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688290+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688290+0000","last_peered":"2024-09-19T09:02:11.688290+0000","last_clean":"2024-09-19T09:02:11.688290+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688290+0000","last_undegraded":"2024-09-19T09:02:11.688290+0000","last_fullsized":"2024-09-19T09:02:11.688290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947301+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:03:39.947301+0000","last_peered":"2024-09-19T09:03:39.947301+0000","last_clean":"2024-09-19T09:03:39.947301+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:03:39.947301+0000","last_undegraded":"2024-09-19T09:03:39.947301+0000","last_fullsized":"2024-09-19T09:03:39.947301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953996+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:03:39.953996+0000","last_peered":"2024-09-19T09:03:39.953996+0000","last_clean":"2024-09-19T09:03:39.953996+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:03:39.953996+0000","last_undegraded":"2024-09-19T09:03:39.953996+0000","last_fullsized":"2024-09-19T09:03:39.953996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:51.839503+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:03:51.839503+0000","last_peered":"2024-09-19T09:03:51.839503+0000","last_clean":"2024-09-19T09:03:51.839503+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:03:51.839503+0000","last_undegraded":"2024-09-19T09:03:51.839503+0000","last_fullsized":"2024-09-19T09:03:51.839503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955511+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:03:39.955511+0000","last_peered":"2024-09-19T09:03:39.955511+0000","last_clean":"2024-09-19T09:03:39.955511+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:03:39.955511+0000","last_undegraded":"2024-09-19T09:03:39.955511+0000","last_fullsized":"2024-09-19T09:03:39.955511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957047+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:03:39.957047+0000","last_peered":"2024-09-19T09:03:39.957047+0000","last_clean":"2024-09-19T09:03:39.957047+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:03:39.957047+0000","last_undegraded":"2024-09-19T09:03:39.957047+0000","last_fullsized":"2024-09-19T09:03:39.957047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954576+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:03:39.954576+0000","last_peered":"2024-09-19T09:03:39.954576+0000","last_clean":"2024-09-19T09:03:39.954576+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:03:39.954576+0000","last_undegraded":"2024-09-19T09:03:39.954576+0000","last_fullsized":"2024-09-19T09:03:39.954576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953774+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:03:39.953774+0000","last_peered":"2024-09-19T09:03:39.953774+0000","last_clean":"2024-09-19T09:03:39.953774+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:03:39.953774+0000","last_undegraded":"2024-09-19T09:03:39.953774+0000","last_fullsized":"2024-09-19T09:03:39.953774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'13","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:43.675473+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:03:43.675473+0000","last_peered":"2024-09-19T09:03:43.675473+0000","last_clean":"2024-09-19T09:03:43.675473+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:03:43.675473+0000","last_undegraded":"2024-09-19T09:03:43.675473+0000","last_fullsized":"2024-09-19T09:03:43.675473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947181+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:03:39.947181+0000","last_peered":"2024-09-19T09:03:39.947181+0000","last_clean":"2024-09-19T09:03:39.947181+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:03:39.947181+0000","last_undegraded":"2024-09-19T09:03:39.947181+0000","last_fullsized":"2024-09-19T09:03:39.947181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950637+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:03:39.950637+0000","last_peered":"2024-09-19T09:03:39.950637+0000","last_clean":"2024-09-19T09:03:39.950637+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:03:39.950637+0000","last_undegraded":"2024-09-19T09:03:39.950637+0000","last_fullsized":"2024-09-19T09:03:39.950637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941644+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:03:39.941644+0000","last_peered":"2024-09-19T09:03:39.941644+0000","last_clean":"2024-09-19T09:03:39.941644+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:03:39.941644+0000","last_undegraded":"2024-09-19T09:03:39.941644+0000","last_fullsized":"2024-09-19T09:03:39.941644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959045+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:03:39.959045+0000","last_peered":"2024-09-19T09:03:39.959045+0000","last_clean":"2024-09-19T09:03:39.959045+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:03:39.959045+0000","last_undegraded":"2024-09-19T09:03:39.959045+0000","last_fullsized":"2024-09-19T09:03:39.959045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686917+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686917+0000","last_peered":"2024-09-19T09:02:11.686917+0000","last_clean":"2024-09-19T09:02:11.686917+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686917+0000","last_undegraded":"2024-09-19T09:02:11.686917+0000","last_fullsized":"2024-09-19T09:02:11.686917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955275+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:03:39.955275+0000","last_peered":"2024-09-19T09:03:39.955275+0000","last_clean":"2024-09-19T09:03:39.955275+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:03:39.955275+0000","last_undegraded":"2024-09-19T09:03:39.955275+0000","last_fullsized":"2024-09-19T09:03:39.955275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964988+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:03:39.964988+0000","last_peered":"2024-09-19T09:03:39.964988+0000","last_clean":"2024-09-19T09:03:39.964988+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:03:39.964988+0000","last_undegraded":"2024-09-19T09:03:39.964988+0000","last_fullsized":"2024-09-19T09:03:39.964988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965901+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:03:39.965901+0000","last_peered":"2024-09-19T09:03:39.965901+0000","last_clean":"2024-09-19T09:03:39.965901+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:03:39.965901+0000","last_undegraded":"2024-09-19T09:03:39.965901+0000","last_fullsized":"2024-09-19T09:03:39.965901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967486+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:03:39.967486+0000","last_peered":"2024-09-19T09:03:39.967486+0000","last_clean":"2024-09-19T09:03:39.967486+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:03:39.967486+0000","last_undegraded":"2024-09-19T09:03:39.967486+0000","last_fullsized":"2024-09-19T09:03:39.967486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960510+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:03:39.960510+0000","last_peered":"2024-09-19T09:03:39.960510+0000","last_clean":"2024-09-19T09:03:39.960510+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:03:39.960510+0000","last_undegraded":"2024-09-19T09:03:39.960510+0000","last_fullsized":"2024-09-19T09:03:39.960510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953415+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:03:39.953415+0000","last_peered":"2024-09-19T09:03:39.953415+0000","last_clean":"2024-09-19T09:03:39.953415+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:03:39.953415+0000","last_undegraded":"2024-09-19T09:03:39.953415+0000","last_fullsized":"2024-09-19T09:03:39.953415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.693212+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.693212+0000","last_peered":"2024-09-19T09:02:11.693212+0000","last_clean":"2024-09-19T09:02:11.693212+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.693212+0000","last_undegraded":"2024-09-19T09:02:11.693212+0000","last_fullsized":"2024-09-19T09:02:11.693212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75690,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":654,"num_read_kb":407,"num_write":180,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":227070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874281,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1089856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005102,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40956,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704196,"statfs":{"total":95995035648,"available":95953096704,"internally_reserved":0,"allocated":1486848,"data_stored":1019844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626493,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1019528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40380,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704772,"statfs":{"total":95995035648,"available":95953686528,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":500036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607638,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":497793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":73396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":72731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:03:57.864 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:03:57.864 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:03:58.124 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:58.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:58 smithi001 ceph-mon[30939]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 -- 172.21.15.1:0/2216694980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318100a80 msgr2=0x7fd318100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 --2- 172.21.15.1:0/2216694980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318100a80 0x7fd318100ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd300009930 tx=0x7fd30002a420 comp rx=0 tx=0).stop 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 -- 172.21.15.1:0/2216694980 shutdown_connections 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 --2- 172.21.15.1:0/2216694980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd318101420 0x7fd31810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 --2- 172.21.15.1:0/2216694980 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318100a80 0x7fd318100ee0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 --2- 172.21.15.1:0/2216694980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd318106a80 0x7fd318106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 -- 172.21.15.1:0/2216694980 >> 172.21.15.1:0/2216694980 conn(0x7fd3180fc7a0 msgr2=0x7fd3180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 -- 172.21.15.1:0/2216694980 shutdown_connections 2024-09-19T09:03:58.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.578+0000 7fd31d671640 1 -- 172.21.15.1:0/2216694980 wait complete. 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd31d671640 1 Processor -- start 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd31d671640 1 -- start start 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd31d671640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd318100a80 0x7fd318198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd31d671640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318101420 0x7fd318198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd31d671640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd318106a80 0x7fd31819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd31d671640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd318110fe0 con 0x7fd318101420 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd31d671640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd318110e60 con 0x7fd318106a80 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd31d671640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd318111160 con 0x7fd318100a80 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3167fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318101420 0x7fd318198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3167fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318101420 0x7fd318198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44578/0 (socket says 172.21.15.1:44578) 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3167fc640 1 -- 172.21.15.1:0/556958894 learned_addr learned my addr 172.21.15.1:0/556958894 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:03:58.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd316ffd640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd318100a80 0x7fd318198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3177fe640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd318106a80 0x7fd31819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3167fc640 1 -- 172.21.15.1:0/556958894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd318100a80 msgr2=0x7fd318198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3167fc640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd318100a80 0x7fd318198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3167fc640 1 -- 172.21.15.1:0/556958894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd318106a80 msgr2=0x7fd31819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3167fc640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd318106a80 0x7fd31819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3167fc640 1 -- 172.21.15.1:0/556958894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31819d5c0 con 0x7fd318101420 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.579+0000 7fd3177fe640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd318106a80 0x7fd31819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.580+0000 7fd3167fc640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318101420 0x7fd318198b50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd300009230 tx=0x7fd300004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.580+0000 7fd30ffff640 1 -- 172.21.15.1:0/556958894 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30003f030 con 0x7fd318101420 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.580+0000 7fd30ffff640 1 -- 172.21.15.1:0/556958894 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd300003af0 con 0x7fd318101420 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.580+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31819d850 con 0x7fd318101420 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.580+0000 7fd30ffff640 1 -- 172.21.15.1:0/556958894 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300035070 con 0x7fd318101420 2024-09-19T09:03:58.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.580+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3181a5190 con 0x7fd318101420 2024-09-19T09:03:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.581+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3181021c0 con 0x7fd318101420 2024-09-19T09:03:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.582+0000 7fd30ffff640 1 -- 172.21.15.1:0/556958894 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fd300042030 con 0x7fd318101420 2024-09-19T09:03:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.583+0000 7fd30ffff640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd3040a32d0 0x7fd3040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.583+0000 7fd316ffd640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd3040a32d0 0x7fd3040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.583+0000 7fd30ffff640 1 -- 172.21.15.1:0/556958894 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd3000f0360 con 0x7fd318101420 2024-09-19T09:03:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.584+0000 7fd316ffd640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd3040a32d0 0x7fd3040a5790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd30800bbe0 tx=0x7fd30800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:58.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.587+0000 7fd30ffff640 1 -- 172.21.15.1:0/556958894 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd3000bcfc0 con 0x7fd318101420 2024-09-19T09:03:58.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:58 smithi022 ceph-mon[35107]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:58.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.760+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 --> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd318062630 con 0x7fd3040a32d0 2024-09-19T09:03:58.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.766+0000 7fd30ffff640 1 -- 172.21.15.1:0/556958894 <== mgr.14150 v2:172.21.15.1:6800/554641341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258838 (secure 0 0 0) 0x7fd318062630 con 0x7fd3040a32d0 2024-09-19T09:03:58.770 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:03:58.771 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:03:58.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd3040a32d0 msgr2=0x7fd3040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd3040a32d0 0x7fd3040a5790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd30800bbe0 tx=0x7fd30800b390 comp rx=0 tx=0).stop 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318101420 msgr2=0x7fd318198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318101420 0x7fd318198b50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd300009230 tx=0x7fd300004270 comp rx=0 tx=0).stop 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 shutdown_connections 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd318106a80 0x7fd31819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd318101420 0x7fd318198b50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd3040a32d0 0x7fd3040a5790 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 --2- 172.21.15.1:0/556958894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd318100a80 0x7fd318198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 >> 172.21.15.1:0/556958894 conn(0x7fd3180fc7a0 msgr2=0x7fd31806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 shutdown_connections 2024-09-19T09:03:58.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:03:58.769+0000 7fd31d671640 1 -- 172.21.15.1:0/556958894 wait complete. 2024-09-19T09:03:58.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:58 smithi064 ceph-mon[35179]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:59.514 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-19T09:03:57.965105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666292,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":780,"num_read_kb":516,"num_write":363,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":403280,"kb_used_data":12432,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124538544,"statfs":{"total":1151940427776,"available":1151527469056,"internally_reserved":0,"allocated":12730368,"data_stored":7118556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":400012604},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8286,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":42,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002880"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967625+0000","last_change":"2024-09-19T09:02:01.620630+0000","last_active":"2024-09-19T09:03:39.967625+0000","last_peered":"2024-09-19T09:03:39.967625+0000","last_clean":"2024-09-19T09:03:39.967625+0000","last_became_active":"2024-09-19T09:02:01.620275+0000","last_became_peered":"2024-09-19T09:02:01.620275+0000","last_unstale":"2024-09-19T09:03:39.967625+0000","last_undegraded":"2024-09-19T09:03:39.967625+0000","last_fullsized":"2024-09-19T09:03:39.967625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:19.215194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951240+0000","last_change":"2024-09-19T09:02:01.613187+0000","last_active":"2024-09-19T09:03:39.951240+0000","last_peered":"2024-09-19T09:03:39.951240+0000","last_clean":"2024-09-19T09:03:39.951240+0000","last_became_active":"2024-09-19T09:02:01.612459+0000","last_became_peered":"2024-09-19T09:02:01.612459+0000","last_unstale":"2024-09-19T09:03:39.951240+0000","last_undegraded":"2024-09-19T09:03:39.951240+0000","last_fullsized":"2024-09-19T09:03:39.951240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:03.537811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960322+0000","last_change":"2024-09-19T09:02:01.620641+0000","last_active":"2024-09-19T09:03:39.960322+0000","last_peered":"2024-09-19T09:03:39.960322+0000","last_clean":"2024-09-19T09:03:39.960322+0000","last_became_active":"2024-09-19T09:02:01.619481+0000","last_became_peered":"2024-09-19T09:02:01.619481+0000","last_unstale":"2024-09-19T09:03:39.960322+0000","last_undegraded":"2024-09-19T09:03:39.960322+0000","last_fullsized":"2024-09-19T09:03:39.960322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:12.805428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950848+0000","last_change":"2024-09-19T09:02:01.621665+0000","last_active":"2024-09-19T09:03:39.950848+0000","last_peered":"2024-09-19T09:03:39.950848+0000","last_clean":"2024-09-19T09:03:39.950848+0000","last_became_active":"2024-09-19T09:02:01.621380+0000","last_became_peered":"2024-09-19T09:02:01.621380+0000","last_unstale":"2024-09-19T09:03:39.950848+0000","last_undegraded":"2024-09-19T09:03:39.950848+0000","last_fullsized":"2024-09-19T09:03:39.950848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:19.895086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.936295+0000","last_change":"2024-09-19T09:02:01.609127+0000","last_active":"2024-09-19T09:03:39.936295+0000","last_peered":"2024-09-19T09:03:39.936295+0000","last_clean":"2024-09-19T09:03:39.936295+0000","last_became_active":"2024-09-19T09:02:01.608743+0000","last_became_peered":"2024-09-19T09:02:01.608743+0000","last_unstale":"2024-09-19T09:03:39.936295+0000","last_undegraded":"2024-09-19T09:03:39.936295+0000","last_fullsized":"2024-09-19T09:03:39.936295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.709985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.956562+0000","last_change":"2024-09-19T09:02:01.613709+0000","last_active":"2024-09-19T09:03:39.956562+0000","last_peered":"2024-09-19T09:03:39.956562+0000","last_clean":"2024-09-19T09:03:39.956562+0000","last_became_active":"2024-09-19T09:02:01.613334+0000","last_became_peered":"2024-09-19T09:02:01.613334+0000","last_unstale":"2024-09-19T09:03:39.956562+0000","last_undegraded":"2024-09-19T09:03:39.956562+0000","last_fullsized":"2024-09-19T09:03:39.956562+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:22.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965237+0000","last_change":"2024-09-19T09:02:11.722501+0000","last_active":"2024-09-19T09:03:39.965237+0000","last_peered":"2024-09-19T09:03:39.965237+0000","last_clean":"2024-09-19T09:03:39.965237+0000","last_became_active":"2024-09-19T09:02:11.722174+0000","last_became_peered":"2024-09-19T09:02:11.722174+0000","last_unstale":"2024-09-19T09:03:39.965237+0000","last_undegraded":"2024-09-19T09:03:39.965237+0000","last_fullsized":"2024-09-19T09:03:39.965237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:35.138242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957157+0000","last_change":"2024-09-19T09:02:01.617151+0000","last_active":"2024-09-19T09:03:39.957157+0000","last_peered":"2024-09-19T09:03:39.957157+0000","last_clean":"2024-09-19T09:03:39.957157+0000","last_became_active":"2024-09-19T09:02:01.616755+0000","last_became_peered":"2024-09-19T09:02:01.616755+0000","last_unstale":"2024-09-19T09:03:39.957157+0000","last_undegraded":"2024-09-19T09:03:39.957157+0000","last_fullsized":"2024-09-19T09:03:39.957157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:38.707678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966943+0000","last_change":"2024-09-19T09:02:01.615561+0000","last_active":"2024-09-19T09:03:39.966943+0000","last_peered":"2024-09-19T09:03:39.966943+0000","last_clean":"2024-09-19T09:03:39.966943+0000","last_became_active":"2024-09-19T09:02:01.614814+0000","last_became_peered":"2024-09-19T09:02:01.614814+0000","last_unstale":"2024-09-19T09:03:39.966943+0000","last_undegraded":"2024-09-19T09:03:39.966943+0000","last_fullsized":"2024-09-19T09:03:39.966943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:25.130702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.958176+0000","last_change":"2024-09-19T09:02:01.615697+0000","last_active":"2024-09-19T09:03:39.958176+0000","last_peered":"2024-09-19T09:03:39.958176+0000","last_clean":"2024-09-19T09:03:39.958176+0000","last_became_active":"2024-09-19T09:02:01.615367+0000","last_became_peered":"2024-09-19T09:02:01.615367+0000","last_unstale":"2024-09-19T09:03:39.958176+0000","last_undegraded":"2024-09-19T09:03:39.958176+0000","last_fullsized":"2024-09-19T09:03:39.958176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:01.630749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964976+0000","last_change":"2024-09-19T09:02:01.618718+0000","last_active":"2024-09-19T09:03:39.964976+0000","last_peered":"2024-09-19T09:03:39.964976+0000","last_clean":"2024-09-19T09:03:39.964976+0000","last_became_active":"2024-09-19T09:02:01.618364+0000","last_became_peered":"2024-09-19T09:02:01.618364+0000","last_unstale":"2024-09-19T09:03:39.964976+0000","last_undegraded":"2024-09-19T09:03:39.964976+0000","last_fullsized":"2024-09-19T09:03:39.964976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:19.828650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941887+0000","last_change":"2024-09-19T09:02:01.621107+0000","last_active":"2024-09-19T09:03:39.941887+0000","last_peered":"2024-09-19T09:03:39.941887+0000","last_clean":"2024-09-19T09:03:39.941887+0000","last_became_active":"2024-09-19T09:02:01.620717+0000","last_became_peered":"2024-09-19T09:02:01.620717+0000","last_unstale":"2024-09-19T09:03:39.941887+0000","last_undegraded":"2024-09-19T09:03:39.941887+0000","last_fullsized":"2024-09-19T09:03:39.941887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:07.393260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.948226+0000","last_change":"2024-09-19T09:02:01.616212+0000","last_active":"2024-09-19T09:03:39.948226+0000","last_peered":"2024-09-19T09:03:39.948226+0000","last_clean":"2024-09-19T09:03:39.948226+0000","last_became_active":"2024-09-19T09:02:01.615914+0000","last_became_peered":"2024-09-19T09:02:01.615914+0000","last_unstale":"2024-09-19T09:03:39.948226+0000","last_undegraded":"2024-09-19T09:03:39.948226+0000","last_fullsized":"2024-09-19T09:03:39.948226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:00.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.951997+0000","last_change":"2024-09-19T09:02:01.610233+0000","last_active":"2024-09-19T09:03:39.951997+0000","last_peered":"2024-09-19T09:03:39.951997+0000","last_clean":"2024-09-19T09:03:39.951997+0000","last_became_active":"2024-09-19T09:02:01.609000+0000","last_became_peered":"2024-09-19T09:02:01.609000+0000","last_unstale":"2024-09-19T09:03:39.951997+0000","last_undegraded":"2024-09-19T09:03:39.951997+0000","last_fullsized":"2024-09-19T09:03:39.951997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:04.276785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950575+0000","last_change":"2024-09-19T09:02:01.613870+0000","last_active":"2024-09-19T09:03:39.950575+0000","last_peered":"2024-09-19T09:03:39.950575+0000","last_clean":"2024-09-19T09:03:39.950575+0000","last_became_active":"2024-09-19T09:02:01.613032+0000","last_became_peered":"2024-09-19T09:02:01.613032+0000","last_unstale":"2024-09-19T09:03:39.950575+0000","last_undegraded":"2024-09-19T09:03:39.950575+0000","last_fullsized":"2024-09-19T09:03:39.950575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:08.827049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.963547+0000","last_change":"2024-09-19T09:02:01.609825+0000","last_active":"2024-09-19T09:03:39.963547+0000","last_peered":"2024-09-19T09:03:39.963547+0000","last_clean":"2024-09-19T09:03:39.963547+0000","last_became_active":"2024-09-19T09:02:01.609354+0000","last_became_peered":"2024-09-19T09:02:01.609354+0000","last_unstale":"2024-09-19T09:03:39.963547+0000","last_undegraded":"2024-09-19T09:03:39.963547+0000","last_fullsized":"2024-09-19T09:03:39.963547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:54.918984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967695+0000","last_change":"2024-09-19T09:02:01.623078+0000","last_active":"2024-09-19T09:03:39.967695+0000","last_peered":"2024-09-19T09:03:39.967695+0000","last_clean":"2024-09-19T09:03:39.967695+0000","last_became_active":"2024-09-19T09:02:01.622188+0000","last_became_peered":"2024-09-19T09:02:01.622188+0000","last_unstale":"2024-09-19T09:03:39.967695+0000","last_undegraded":"2024-09-19T09:03:39.967695+0000","last_fullsized":"2024-09-19T09:03:39.967695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:39.657060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962356+0000","last_change":"2024-09-19T09:02:01.605779+0000","last_active":"2024-09-19T09:03:39.962356+0000","last_peered":"2024-09-19T09:03:39.962356+0000","last_clean":"2024-09-19T09:03:39.962356+0000","last_became_active":"2024-09-19T09:02:01.605467+0000","last_became_peered":"2024-09-19T09:02:01.605467+0000","last_unstale":"2024-09-19T09:03:39.962356+0000","last_undegraded":"2024-09-19T09:03:39.962356+0000","last_fullsized":"2024-09-19T09:03:39.962356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:53.145251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957485+0000","last_change":"2024-09-19T09:02:01.620553+0000","last_active":"2024-09-19T09:03:39.957485+0000","last_peered":"2024-09-19T09:03:39.957485+0000","last_clean":"2024-09-19T09:03:39.957485+0000","last_became_active":"2024-09-19T09:02:01.619542+0000","last_became_peered":"2024-09-19T09:02:01.619542+0000","last_unstale":"2024-09-19T09:03:39.957485+0000","last_undegraded":"2024-09-19T09:03:39.957485+0000","last_fullsized":"2024-09-19T09:03:39.957485+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.526870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957966+0000","last_change":"2024-09-19T09:02:01.616217+0000","last_active":"2024-09-19T09:03:39.957966+0000","last_peered":"2024-09-19T09:03:39.957966+0000","last_clean":"2024-09-19T09:03:39.957966+0000","last_became_active":"2024-09-19T09:02:01.615899+0000","last_became_peered":"2024-09-19T09:02:01.615899+0000","last_unstale":"2024-09-19T09:03:39.957966+0000","last_undegraded":"2024-09-19T09:03:39.957966+0000","last_fullsized":"2024-09-19T09:03:39.957966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:30.872452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979621+0000","last_change":"2024-09-19T09:02:01.619329+0000","last_active":"2024-09-19T09:03:39.979621+0000","last_peered":"2024-09-19T09:03:39.979621+0000","last_clean":"2024-09-19T09:03:39.979621+0000","last_became_active":"2024-09-19T09:02:01.619033+0000","last_became_peered":"2024-09-19T09:02:01.619033+0000","last_unstale":"2024-09-19T09:03:39.979621+0000","last_undegraded":"2024-09-19T09:03:39.979621+0000","last_fullsized":"2024-09-19T09:03:39.979621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:09.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965614+0000","last_change":"2024-09-19T09:02:01.613233+0000","last_active":"2024-09-19T09:03:39.965614+0000","last_peered":"2024-09-19T09:03:39.965614+0000","last_clean":"2024-09-19T09:03:39.965614+0000","last_became_active":"2024-09-19T09:02:01.612801+0000","last_became_peered":"2024-09-19T09:02:01.612801+0000","last_unstale":"2024-09-19T09:03:39.965614+0000","last_undegraded":"2024-09-19T09:03:39.965614+0000","last_fullsized":"2024-09-19T09:03:39.965614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:18.011136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955089+0000","last_change":"2024-09-19T09:02:01.621415+0000","last_active":"2024-09-19T09:03:39.955089+0000","last_peered":"2024-09-19T09:03:39.955089+0000","last_clean":"2024-09-19T09:03:39.955089+0000","last_became_active":"2024-09-19T09:02:01.621061+0000","last_became_peered":"2024-09-19T09:02:01.621061+0000","last_unstale":"2024-09-19T09:03:39.955089+0000","last_undegraded":"2024-09-19T09:03:39.955089+0000","last_fullsized":"2024-09-19T09:03:39.955089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:05.359565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952591+0000","last_change":"2024-09-19T09:02:01.617883+0000","last_active":"2024-09-19T09:03:39.952591+0000","last_peered":"2024-09-19T09:03:39.952591+0000","last_clean":"2024-09-19T09:03:39.952591+0000","last_became_active":"2024-09-19T09:02:01.616592+0000","last_became_peered":"2024-09-19T09:02:01.616592+0000","last_unstale":"2024-09-19T09:03:39.952591+0000","last_undegraded":"2024-09-19T09:03:39.952591+0000","last_fullsized":"2024-09-19T09:03:39.952591+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:17.377414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950831+0000","last_change":"2024-09-19T09:02:11.698380+0000","last_active":"2024-09-19T09:03:39.950831+0000","last_peered":"2024-09-19T09:03:39.950831+0000","last_clean":"2024-09-19T09:03:39.950831+0000","last_became_active":"2024-09-19T09:02:11.698041+0000","last_became_peered":"2024-09-19T09:02:11.698041+0000","last_unstale":"2024-09-19T09:03:39.950831+0000","last_undegraded":"2024-09-19T09:03:39.950831+0000","last_fullsized":"2024-09-19T09:03:39.950831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:21.341120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966529+0000","last_change":"2024-09-19T09:02:01.615991+0000","last_active":"2024-09-19T09:03:39.966529+0000","last_peered":"2024-09-19T09:03:39.966529+0000","last_clean":"2024-09-19T09:03:39.966529+0000","last_became_active":"2024-09-19T09:02:01.613575+0000","last_became_peered":"2024-09-19T09:02:01.613575+0000","last_unstale":"2024-09-19T09:03:39.966529+0000","last_undegraded":"2024-09-19T09:03:39.966529+0000","last_fullsized":"2024-09-19T09:03:39.966529+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:12.496204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952375+0000","last_change":"2024-09-19T09:02:01.619060+0000","last_active":"2024-09-19T09:03:39.952375+0000","last_peered":"2024-09-19T09:03:39.952375+0000","last_clean":"2024-09-19T09:03:39.952375+0000","last_became_active":"2024-09-19T09:02:01.617947+0000","last_became_peered":"2024-09-19T09:02:01.617947+0000","last_unstale":"2024-09-19T09:03:39.952375+0000","last_undegraded":"2024-09-19T09:03:39.952375+0000","last_fullsized":"2024-09-19T09:03:39.952375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.583215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950943+0000","last_change":"2024-09-19T09:02:01.620642+0000","last_active":"2024-09-19T09:03:39.950943+0000","last_peered":"2024-09-19T09:03:39.950943+0000","last_clean":"2024-09-19T09:03:39.950943+0000","last_became_active":"2024-09-19T09:02:01.620314+0000","last_became_peered":"2024-09-19T09:02:01.620314+0000","last_unstale":"2024-09-19T09:03:39.950943+0000","last_undegraded":"2024-09-19T09:03:39.950943+0000","last_fullsized":"2024-09-19T09:03:39.950943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:25.349694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955565+0000","last_change":"2024-09-19T09:02:01.610852+0000","last_active":"2024-09-19T09:03:39.955565+0000","last_peered":"2024-09-19T09:03:39.955565+0000","last_clean":"2024-09-19T09:03:39.955565+0000","last_became_active":"2024-09-19T09:02:01.609661+0000","last_became_peered":"2024-09-19T09:02:01.609661+0000","last_unstale":"2024-09-19T09:03:39.955565+0000","last_undegraded":"2024-09-19T09:03:39.955565+0000","last_fullsized":"2024-09-19T09:03:39.955565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:08.489148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957500+0000","last_change":"2024-09-19T09:02:01.623145+0000","last_active":"2024-09-19T09:03:39.957500+0000","last_peered":"2024-09-19T09:03:39.957500+0000","last_clean":"2024-09-19T09:03:39.957500+0000","last_became_active":"2024-09-19T09:02:01.622802+0000","last_became_peered":"2024-09-19T09:02:01.622802+0000","last_unstale":"2024-09-19T09:03:39.957500+0000","last_undegraded":"2024-09-19T09:03:39.957500+0000","last_fullsized":"2024-09-19T09:03:39.957500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:27.706368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955901+0000","last_change":"2024-09-19T09:02:01.622097+0000","last_active":"2024-09-19T09:03:39.955901+0000","last_peered":"2024-09-19T09:03:39.955901+0000","last_clean":"2024-09-19T09:03:39.955901+0000","last_became_active":"2024-09-19T09:02:01.621645+0000","last_became_peered":"2024-09-19T09:02:01.621645+0000","last_unstale":"2024-09-19T09:03:39.955901+0000","last_undegraded":"2024-09-19T09:03:39.955901+0000","last_fullsized":"2024-09-19T09:03:39.955901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:26.645783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959198+0000","last_change":"2024-09-19T09:02:01.612880+0000","last_active":"2024-09-19T09:03:39.959198+0000","last_peered":"2024-09-19T09:03:39.959198+0000","last_clean":"2024-09-19T09:03:39.959198+0000","last_became_active":"2024-09-19T09:02:01.612501+0000","last_became_peered":"2024-09-19T09:02:01.612501+0000","last_unstale":"2024-09-19T09:03:39.959198+0000","last_undegraded":"2024-09-19T09:03:39.959198+0000","last_fullsized":"2024-09-19T09:03:39.959198+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:06.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.952610+0000","last_change":"2024-09-19T09:02:11.722540+0000","last_active":"2024-09-19T09:03:39.952610+0000","last_peered":"2024-09-19T09:03:39.952610+0000","last_clean":"2024-09-19T09:03:39.952610+0000","last_became_active":"2024-09-19T09:02:11.722219+0000","last_became_peered":"2024-09-19T09:02:11.722219+0000","last_unstale":"2024-09-19T09:03:39.952610+0000","last_undegraded":"2024-09-19T09:03:39.952610+0000","last_fullsized":"2024-09-19T09:03:39.952610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:33.755557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:53.670220+0000","last_change":"2024-09-19T09:01:59.571397+0000","last_active":"2024-09-19T09:03:53.670220+0000","last_peered":"2024-09-19T09:03:53.670220+0000","last_clean":"2024-09-19T09:03:53.670220+0000","last_became_active":"2024-09-19T09:01:59.570531+0000","last_became_peered":"2024-09-19T09:01:59.570531+0000","last_unstale":"2024-09-19T09:03:53.670220+0000","last_undegraded":"2024-09-19T09:03:53.670220+0000","last_fullsized":"2024-09-19T09:03:53.670220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.172910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950481+0000","last_change":"2024-09-19T09:02:11.692423+0000","last_active":"2024-09-19T09:03:39.950481+0000","last_peered":"2024-09-19T09:03:39.950481+0000","last_clean":"2024-09-19T09:03:39.950481+0000","last_became_active":"2024-09-19T09:02:11.691995+0000","last_became_peered":"2024-09-19T09:02:11.691995+0000","last_unstale":"2024-09-19T09:03:39.950481+0000","last_undegraded":"2024-09-19T09:03:39.950481+0000","last_fullsized":"2024-09-19T09:03:39.950481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:15.417534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683803+0000","last_change":"2024-09-19T09:01:59.577198+0000","last_active":"2024-09-19T09:02:11.683803+0000","last_peered":"2024-09-19T09:02:11.683803+0000","last_clean":"2024-09-19T09:02:11.683803+0000","last_became_active":"2024-09-19T09:01:59.576797+0000","last_became_peered":"2024-09-19T09:01:59.576797+0000","last_unstale":"2024-09-19T09:02:11.683803+0000","last_undegraded":"2024-09-19T09:02:11.683803+0000","last_fullsized":"2024-09-19T09:02:11.683803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:58.781557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721120+0000","last_change":"2024-09-19T09:01:59.567993+0000","last_active":"2024-09-19T09:02:11.721120+0000","last_peered":"2024-09-19T09:02:11.721120+0000","last_clean":"2024-09-19T09:02:11.721120+0000","last_became_active":"2024-09-19T09:01:59.567576+0000","last_became_peered":"2024-09-19T09:01:59.567576+0000","last_unstale":"2024-09-19T09:02:11.721120+0000","last_undegraded":"2024-09-19T09:02:11.721120+0000","last_fullsized":"2024-09-19T09:02:11.721120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:15.600367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953709+0000","last_change":"2024-09-19T09:02:01.615462+0000","last_active":"2024-09-19T09:03:39.953709+0000","last_peered":"2024-09-19T09:03:39.953709+0000","last_clean":"2024-09-19T09:03:39.953709+0000","last_became_active":"2024-09-19T09:02:01.614962+0000","last_became_peered":"2024-09-19T09:02:01.614962+0000","last_unstale":"2024-09-19T09:03:39.953709+0000","last_undegraded":"2024-09-19T09:03:39.953709+0000","last_fullsized":"2024-09-19T09:03:39.953709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:26.205123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685770+0000","last_change":"2024-09-19T09:01:59.574399+0000","last_active":"2024-09-19T09:02:11.685770+0000","last_peered":"2024-09-19T09:02:11.685770+0000","last_clean":"2024-09-19T09:02:11.685770+0000","last_became_active":"2024-09-19T09:01:59.572619+0000","last_became_peered":"2024-09-19T09:01:59.572619+0000","last_unstale":"2024-09-19T09:02:11.685770+0000","last_undegraded":"2024-09-19T09:02:11.685770+0000","last_fullsized":"2024-09-19T09:02:11.685770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:33.579314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954288+0000","last_change":"2024-09-19T09:02:01.604684+0000","last_active":"2024-09-19T09:03:39.954288+0000","last_peered":"2024-09-19T09:03:39.954288+0000","last_clean":"2024-09-19T09:03:39.954288+0000","last_became_active":"2024-09-19T09:02:01.604238+0000","last_became_peered":"2024-09-19T09:02:01.604238+0000","last_unstale":"2024-09-19T09:03:39.954288+0000","last_undegraded":"2024-09-19T09:03:39.954288+0000","last_fullsized":"2024-09-19T09:03:39.954288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:09.143855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":129,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:52.667710+0000","last_change":"2024-09-19T09:01:59.576053+0000","last_active":"2024-09-19T09:03:52.667710+0000","last_peered":"2024-09-19T09:03:52.667710+0000","last_clean":"2024-09-19T09:03:52.667710+0000","last_became_active":"2024-09-19T09:01:59.575618+0000","last_became_peered":"2024-09-19T09:01:59.575618+0000","last_unstale":"2024-09-19T09:03:52.667710+0000","last_undegraded":"2024-09-19T09:03:52.667710+0000","last_fullsized":"2024-09-19T09:03:52.667710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:25.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967297+0000","last_change":"2024-09-19T09:02:01.608273+0000","last_active":"2024-09-19T09:03:39.967297+0000","last_peered":"2024-09-19T09:03:39.967297+0000","last_clean":"2024-09-19T09:03:39.967297+0000","last_became_active":"2024-09-19T09:02:01.607818+0000","last_became_peered":"2024-09-19T09:02:01.607818+0000","last_unstale":"2024-09-19T09:03:39.967297+0000","last_undegraded":"2024-09-19T09:03:39.967297+0000","last_fullsized":"2024-09-19T09:03:39.967297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:56.868789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688716+0000","last_change":"2024-09-19T09:01:59.575833+0000","last_active":"2024-09-19T09:02:11.688716+0000","last_peered":"2024-09-19T09:02:11.688716+0000","last_clean":"2024-09-19T09:02:11.688716+0000","last_became_active":"2024-09-19T09:01:59.574136+0000","last_became_peered":"2024-09-19T09:01:59.574136+0000","last_unstale":"2024-09-19T09:02:11.688716+0000","last_undegraded":"2024-09-19T09:02:11.688716+0000","last_fullsized":"2024-09-19T09:02:11.688716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:39.432007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953419+0000","last_change":"2024-09-19T09:02:01.612184+0000","last_active":"2024-09-19T09:03:39.953419+0000","last_peered":"2024-09-19T09:03:39.953419+0000","last_clean":"2024-09-19T09:03:39.953419+0000","last_became_active":"2024-09-19T09:02:01.611868+0000","last_became_peered":"2024-09-19T09:02:01.611868+0000","last_unstale":"2024-09-19T09:03:39.953419+0000","last_undegraded":"2024-09-19T09:03:39.953419+0000","last_fullsized":"2024-09-19T09:03:39.953419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:44.362647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687517+0000","last_change":"2024-09-19T09:02:00.003097+0000","last_active":"2024-09-19T09:02:11.687517+0000","last_peered":"2024-09-19T09:02:11.687517+0000","last_clean":"2024-09-19T09:02:11.687517+0000","last_became_active":"2024-09-19T09:02:00.002700+0000","last_became_peered":"2024-09-19T09:02:00.002700+0000","last_unstale":"2024-09-19T09:02:11.687517+0000","last_undegraded":"2024-09-19T09:02:11.687517+0000","last_fullsized":"2024-09-19T09:02:11.687517+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:13.843943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966193+0000","last_change":"2024-09-19T09:02:01.614673+0000","last_active":"2024-09-19T09:03:39.966193+0000","last_peered":"2024-09-19T09:03:39.966193+0000","last_clean":"2024-09-19T09:03:39.966193+0000","last_became_active":"2024-09-19T09:02:01.614335+0000","last_became_peered":"2024-09-19T09:02:01.614335+0000","last_unstale":"2024-09-19T09:03:39.966193+0000","last_undegraded":"2024-09-19T09:03:39.966193+0000","last_fullsized":"2024-09-19T09:03:39.966193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:32.859066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'36","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:53.855466+0000","last_change":"2024-09-19T09:01:59.574973+0000","last_active":"2024-09-19T09:03:53.855466+0000","last_peered":"2024-09-19T09:03:53.855466+0000","last_clean":"2024-09-19T09:03:53.855466+0000","last_became_active":"2024-09-19T09:01:59.574629+0000","last_became_peered":"2024-09-19T09:01:59.574629+0000","last_unstale":"2024-09-19T09:03:53.855466+0000","last_undegraded":"2024-09-19T09:03:53.855466+0000","last_fullsized":"2024-09-19T09:03:53.855466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:23.775317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71153,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":180,"num_write":37,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.961829+0000","last_change":"2024-09-19T09:02:01.616581+0000","last_active":"2024-09-19T09:03:39.961829+0000","last_peered":"2024-09-19T09:03:39.961829+0000","last_clean":"2024-09-19T09:03:39.961829+0000","last_became_active":"2024-09-19T09:02:01.616043+0000","last_became_peered":"2024-09-19T09:02:01.616043+0000","last_unstale":"2024-09-19T09:03:39.961829+0000","last_undegraded":"2024-09-19T09:03:39.961829+0000","last_fullsized":"2024-09-19T09:03:39.961829+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:55.687889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697294+0000","last_change":"2024-09-19T09:02:11.696804+0000","last_active":"2024-09-19T09:02:11.697294+0000","last_peered":"2024-09-19T09:02:11.697294+0000","last_clean":"2024-09-19T09:02:11.697294+0000","last_became_active":"2024-09-19T09:02:11.688063+0000","last_became_peered":"2024-09-19T09:02:11.688063+0000","last_unstale":"2024-09-19T09:02:11.697294+0000","last_undegraded":"2024-09-19T09:02:11.697294+0000","last_fullsized":"2024-09-19T09:02:11.697294+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:48.475118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.979339+0000","last_change":"2024-09-19T09:02:01.614907+0000","last_active":"2024-09-19T09:03:39.979339+0000","last_peered":"2024-09-19T09:03:39.979339+0000","last_clean":"2024-09-19T09:03:39.979339+0000","last_became_active":"2024-09-19T09:02:01.614553+0000","last_became_peered":"2024-09-19T09:02:01.614553+0000","last_unstale":"2024-09-19T09:03:39.979339+0000","last_undegraded":"2024-09-19T09:03:39.979339+0000","last_fullsized":"2024-09-19T09:03:39.979339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:19.206884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686417+0000","last_change":"2024-09-19T09:01:59.572663+0000","last_active":"2024-09-19T09:02:11.686417+0000","last_peered":"2024-09-19T09:02:11.686417+0000","last_clean":"2024-09-19T09:02:11.686417+0000","last_became_active":"2024-09-19T09:01:59.572325+0000","last_became_peered":"2024-09-19T09:01:59.572325+0000","last_unstale":"2024-09-19T09:02:11.686417+0000","last_undegraded":"2024-09-19T09:02:11.686417+0000","last_fullsized":"2024-09-19T09:02:11.686417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:41.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.966978+0000","last_change":"2024-09-19T09:02:01.612047+0000","last_active":"2024-09-19T09:03:39.966978+0000","last_peered":"2024-09-19T09:03:39.966978+0000","last_clean":"2024-09-19T09:03:39.966978+0000","last_became_active":"2024-09-19T09:02:01.611633+0000","last_became_peered":"2024-09-19T09:02:01.611633+0000","last_unstale":"2024-09-19T09:03:39.966978+0000","last_undegraded":"2024-09-19T09:03:39.966978+0000","last_fullsized":"2024-09-19T09:03:39.966978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:17.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:52.841513+0000","last_change":"2024-09-19T09:01:59.572806+0000","last_active":"2024-09-19T09:03:52.841513+0000","last_peered":"2024-09-19T09:03:52.841513+0000","last_clean":"2024-09-19T09:03:52.841513+0000","last_became_active":"2024-09-19T09:01:59.571602+0000","last_became_peered":"2024-09-19T09:01:59.571602+0000","last_unstale":"2024-09-19T09:03:52.841513+0000","last_undegraded":"2024-09-19T09:03:52.841513+0000","last_fullsized":"2024-09-19T09:03:52.841513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:06.127084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962145+0000","last_change":"2024-09-19T09:02:01.617574+0000","last_active":"2024-09-19T09:03:39.962145+0000","last_peered":"2024-09-19T09:03:39.962145+0000","last_clean":"2024-09-19T09:03:39.962145+0000","last_became_active":"2024-09-19T09:02:01.616966+0000","last_became_peered":"2024-09-19T09:02:01.616966+0000","last_unstale":"2024-09-19T09:03:39.962145+0000","last_undegraded":"2024-09-19T09:03:39.962145+0000","last_fullsized":"2024-09-19T09:03:39.962145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:37.098473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689226+0000","last_change":"2024-09-19T09:02:00.003109+0000","last_active":"2024-09-19T09:02:11.689226+0000","last_peered":"2024-09-19T09:02:11.689226+0000","last_clean":"2024-09-19T09:02:11.689226+0000","last_became_active":"2024-09-19T09:02:00.002461+0000","last_became_peered":"2024-09-19T09:02:00.002461+0000","last_unstale":"2024-09-19T09:02:11.689226+0000","last_undegraded":"2024-09-19T09:02:11.689226+0000","last_fullsized":"2024-09-19T09:02:11.689226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:21.375600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959818+0000","last_change":"2024-09-19T09:02:11.691526+0000","last_active":"2024-09-19T09:03:39.959818+0000","last_peered":"2024-09-19T09:03:39.959818+0000","last_clean":"2024-09-19T09:03:39.959818+0000","last_became_active":"2024-09-19T09:02:11.691102+0000","last_became_peered":"2024-09-19T09:02:11.691102+0000","last_unstale":"2024-09-19T09:03:39.959818+0000","last_undegraded":"2024-09-19T09:03:39.959818+0000","last_fullsized":"2024-09-19T09:03:39.959818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:46.457410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689104+0000","last_change":"2024-09-19T09:01:59.573812+0000","last_active":"2024-09-19T09:02:11.689104+0000","last_peered":"2024-09-19T09:02:11.689104+0000","last_clean":"2024-09-19T09:02:11.689104+0000","last_became_active":"2024-09-19T09:01:59.573449+0000","last_became_peered":"2024-09-19T09:01:59.573449+0000","last_unstale":"2024-09-19T09:02:11.689104+0000","last_undegraded":"2024-09-19T09:02:11.689104+0000","last_fullsized":"2024-09-19T09:02:11.689104+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:47.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957934+0000","last_change":"2024-09-19T09:02:01.613998+0000","last_active":"2024-09-19T09:03:39.957934+0000","last_peered":"2024-09-19T09:03:39.957934+0000","last_clean":"2024-09-19T09:03:39.957934+0000","last_became_active":"2024-09-19T09:02:01.613505+0000","last_became_peered":"2024-09-19T09:02:01.613505+0000","last_unstale":"2024-09-19T09:03:39.957934+0000","last_undegraded":"2024-09-19T09:03:39.957934+0000","last_fullsized":"2024-09-19T09:03:39.957934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:22.047029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.721383+0000","last_change":"2024-09-19T09:01:59.570301+0000","last_active":"2024-09-19T09:02:11.721383+0000","last_peered":"2024-09-19T09:02:11.721383+0000","last_clean":"2024-09-19T09:02:11.721383+0000","last_became_active":"2024-09-19T09:01:59.569914+0000","last_became_peered":"2024-09-19T09:01:59.569914+0000","last_unstale":"2024-09-19T09:02:11.721383+0000","last_undegraded":"2024-09-19T09:02:11.721383+0000","last_fullsized":"2024-09-19T09:02:11.721383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:30.932539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964690+0000","last_change":"2024-09-19T09:02:01.613394+0000","last_active":"2024-09-19T09:03:39.964690+0000","last_peered":"2024-09-19T09:03:39.964690+0000","last_clean":"2024-09-19T09:03:39.964690+0000","last_became_active":"2024-09-19T09:02:01.613063+0000","last_became_peered":"2024-09-19T09:02:01.613063+0000","last_unstale":"2024-09-19T09:03:39.964690+0000","last_undegraded":"2024-09-19T09:03:39.964690+0000","last_fullsized":"2024-09-19T09:03:39.964690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:39.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687634+0000","last_change":"2024-09-19T09:01:59.572159+0000","last_active":"2024-09-19T09:02:11.687634+0000","last_peered":"2024-09-19T09:02:11.687634+0000","last_clean":"2024-09-19T09:02:11.687634+0000","last_became_active":"2024-09-19T09:01:59.571820+0000","last_became_peered":"2024-09-19T09:01:59.571820+0000","last_unstale":"2024-09-19T09:02:11.687634+0000","last_undegraded":"2024-09-19T09:02:11.687634+0000","last_fullsized":"2024-09-19T09:02:11.687634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:10.676750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.962180+0000","last_change":"2024-09-19T09:02:01.617990+0000","last_active":"2024-09-19T09:03:39.962180+0000","last_peered":"2024-09-19T09:03:39.962180+0000","last_clean":"2024-09-19T09:03:39.962180+0000","last_became_active":"2024-09-19T09:02:01.617634+0000","last_became_peered":"2024-09-19T09:02:01.617634+0000","last_unstale":"2024-09-19T09:03:39.962180+0000","last_undegraded":"2024-09-19T09:03:39.962180+0000","last_fullsized":"2024-09-19T09:03:39.962180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:56.943027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687392+0000","last_change":"2024-09-19T09:02:00.003482+0000","last_active":"2024-09-19T09:02:11.687392+0000","last_peered":"2024-09-19T09:02:11.687392+0000","last_clean":"2024-09-19T09:02:11.687392+0000","last_became_active":"2024-09-19T09:02:00.002764+0000","last_became_peered":"2024-09-19T09:02:00.002764+0000","last_unstale":"2024-09-19T09:02:11.687392+0000","last_undegraded":"2024-09-19T09:02:11.687392+0000","last_fullsized":"2024-09-19T09:02:11.687392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:18.471600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964213+0000","last_change":"2024-09-19T09:02:01.618029+0000","last_active":"2024-09-19T09:03:39.964213+0000","last_peered":"2024-09-19T09:03:39.964213+0000","last_clean":"2024-09-19T09:03:39.964213+0000","last_became_active":"2024-09-19T09:02:01.615843+0000","last_became_peered":"2024-09-19T09:02:01.615843+0000","last_unstale":"2024-09-19T09:03:39.964213+0000","last_undegraded":"2024-09-19T09:03:39.964213+0000","last_fullsized":"2024-09-19T09:03:39.964213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:25.137544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688290+0000","last_change":"2024-09-19T09:00:51.325121+0000","last_active":"2024-09-19T09:02:11.688290+0000","last_peered":"2024-09-19T09:02:11.688290+0000","last_clean":"2024-09-19T09:02:11.688290+0000","last_became_active":"2024-09-19T09:00:51.324568+0000","last_became_peered":"2024-09-19T09:00:51.324568+0000","last_unstale":"2024-09-19T09:02:11.688290+0000","last_undegraded":"2024-09-19T09:02:11.688290+0000","last_fullsized":"2024-09-19T09:02:11.688290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:57:30.365893+0000","last_clean_scrub_stamp":"2024-09-19T08:57:30.365893+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:57.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697317+0000","last_change":"2024-09-19T09:01:59.570234+0000","last_active":"2024-09-19T09:02:11.697317+0000","last_peered":"2024-09-19T09:02:11.697317+0000","last_clean":"2024-09-19T09:02:11.697317+0000","last_became_active":"2024-09-19T09:01:59.569789+0000","last_became_peered":"2024-09-19T09:01:59.569789+0000","last_unstale":"2024-09-19T09:02:11.697317+0000","last_undegraded":"2024-09-19T09:02:11.697317+0000","last_fullsized":"2024-09-19T09:02:11.697317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:57.489543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947301+0000","last_change":"2024-09-19T09:02:01.617921+0000","last_active":"2024-09-19T09:03:39.947301+0000","last_peered":"2024-09-19T09:03:39.947301+0000","last_clean":"2024-09-19T09:03:39.947301+0000","last_became_active":"2024-09-19T09:02:01.617554+0000","last_became_peered":"2024-09-19T09:02:01.617554+0000","last_unstale":"2024-09-19T09:03:39.947301+0000","last_undegraded":"2024-09-19T09:03:39.947301+0000","last_fullsized":"2024-09-19T09:03:39.947301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:35.434501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688075+0000","last_change":"2024-09-19T09:01:59.576963+0000","last_active":"2024-09-19T09:02:11.688075+0000","last_peered":"2024-09-19T09:02:11.688075+0000","last_clean":"2024-09-19T09:02:11.688075+0000","last_became_active":"2024-09-19T09:01:59.576616+0000","last_became_peered":"2024-09-19T09:01:59.576616+0000","last_unstale":"2024-09-19T09:02:11.688075+0000","last_undegraded":"2024-09-19T09:02:11.688075+0000","last_fullsized":"2024-09-19T09:02:11.688075+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:48.840692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953996+0000","last_change":"2024-09-19T09:02:01.622476+0000","last_active":"2024-09-19T09:03:39.953996+0000","last_peered":"2024-09-19T09:03:39.953996+0000","last_clean":"2024-09-19T09:03:39.953996+0000","last_became_active":"2024-09-19T09:02:01.622200+0000","last_became_peered":"2024-09-19T09:02:01.622200+0000","last_unstale":"2024-09-19T09:03:39.953996+0000","last_undegraded":"2024-09-19T09:03:39.953996+0000","last_fullsized":"2024-09-19T09:03:39.953996+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:21.353762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":128,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:51.839503+0000","last_change":"2024-09-19T09:02:00.002604+0000","last_active":"2024-09-19T09:03:51.839503+0000","last_peered":"2024-09-19T09:03:51.839503+0000","last_clean":"2024-09-19T09:03:51.839503+0000","last_became_active":"2024-09-19T09:02:00.002229+0000","last_became_peered":"2024-09-19T09:02:00.002229+0000","last_unstale":"2024-09-19T09:03:51.839503+0000","last_undegraded":"2024-09-19T09:03:51.839503+0000","last_fullsized":"2024-09-19T09:03:51.839503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:30.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955511+0000","last_change":"2024-09-19T09:02:01.614494+0000","last_active":"2024-09-19T09:03:39.955511+0000","last_peered":"2024-09-19T09:03:39.955511+0000","last_clean":"2024-09-19T09:03:39.955511+0000","last_became_active":"2024-09-19T09:02:01.614149+0000","last_became_peered":"2024-09-19T09:02:01.614149+0000","last_unstale":"2024-09-19T09:03:39.955511+0000","last_undegraded":"2024-09-19T09:03:39.955511+0000","last_fullsized":"2024-09-19T09:03:39.955511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:50.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.688412+0000","last_change":"2024-09-19T09:01:59.575139+0000","last_active":"2024-09-19T09:02:11.688412+0000","last_peered":"2024-09-19T09:02:11.688412+0000","last_clean":"2024-09-19T09:02:11.688412+0000","last_became_active":"2024-09-19T09:01:59.574791+0000","last_became_peered":"2024-09-19T09:01:59.574791+0000","last_unstale":"2024-09-19T09:02:11.688412+0000","last_undegraded":"2024-09-19T09:02:11.688412+0000","last_fullsized":"2024-09-19T09:02:11.688412+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:14.772628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.957047+0000","last_change":"2024-09-19T09:02:11.688006+0000","last_active":"2024-09-19T09:03:39.957047+0000","last_peered":"2024-09-19T09:03:39.957047+0000","last_clean":"2024-09-19T09:03:39.957047+0000","last_became_active":"2024-09-19T09:02:11.687506+0000","last_became_peered":"2024-09-19T09:02:11.687506+0000","last_unstale":"2024-09-19T09:03:39.957047+0000","last_undegraded":"2024-09-19T09:03:39.957047+0000","last_fullsized":"2024-09-19T09:03:39.957047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:32.384516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.685880+0000","last_change":"2024-09-19T09:02:00.002972+0000","last_active":"2024-09-19T09:02:11.685880+0000","last_peered":"2024-09-19T09:02:11.685880+0000","last_clean":"2024-09-19T09:02:11.685880+0000","last_became_active":"2024-09-19T09:02:00.002656+0000","last_became_peered":"2024-09-19T09:02:00.002656+0000","last_unstale":"2024-09-19T09:02:11.685880+0000","last_undegraded":"2024-09-19T09:02:11.685880+0000","last_fullsized":"2024-09-19T09:02:11.685880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:50.359427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.954576+0000","last_change":"2024-09-19T09:02:01.610461+0000","last_active":"2024-09-19T09:03:39.954576+0000","last_peered":"2024-09-19T09:03:39.954576+0000","last_clean":"2024-09-19T09:03:39.954576+0000","last_became_active":"2024-09-19T09:02:01.610103+0000","last_became_peered":"2024-09-19T09:02:01.610103+0000","last_unstale":"2024-09-19T09:03:39.954576+0000","last_undegraded":"2024-09-19T09:03:39.954576+0000","last_fullsized":"2024-09-19T09:03:39.954576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:26.724870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689117+0000","last_change":"2024-09-19T09:02:00.003169+0000","last_active":"2024-09-19T09:02:11.689117+0000","last_peered":"2024-09-19T09:02:11.689117+0000","last_clean":"2024-09-19T09:02:11.689117+0000","last_became_active":"2024-09-19T09:02:00.002655+0000","last_became_peered":"2024-09-19T09:02:00.002655+0000","last_unstale":"2024-09-19T09:02:11.689117+0000","last_undegraded":"2024-09-19T09:02:11.689117+0000","last_fullsized":"2024-09-19T09:02:11.689117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:32.494896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953774+0000","last_change":"2024-09-19T09:02:01.615963+0000","last_active":"2024-09-19T09:03:39.953774+0000","last_peered":"2024-09-19T09:03:39.953774+0000","last_clean":"2024-09-19T09:03:39.953774+0000","last_became_active":"2024-09-19T09:02:01.615650+0000","last_became_peered":"2024-09-19T09:02:01.615650+0000","last_unstale":"2024-09-19T09:03:39.953774+0000","last_undegraded":"2024-09-19T09:03:39.953774+0000","last_fullsized":"2024-09-19T09:03:39.953774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:25.968085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'13","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:43.675473+0000","last_change":"2024-09-19T09:01:59.569773+0000","last_active":"2024-09-19T09:03:43.675473+0000","last_peered":"2024-09-19T09:03:43.675473+0000","last_clean":"2024-09-19T09:03:43.675473+0000","last_became_active":"2024-09-19T09:01:59.569248+0000","last_became_peered":"2024-09-19T09:01:59.569248+0000","last_unstale":"2024-09-19T09:03:43.675473+0000","last_undegraded":"2024-09-19T09:03:43.675473+0000","last_fullsized":"2024-09-19T09:03:43.675473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:29.388498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.947181+0000","last_change":"2024-09-19T09:02:01.614065+0000","last_active":"2024-09-19T09:03:39.947181+0000","last_peered":"2024-09-19T09:03:39.947181+0000","last_clean":"2024-09-19T09:03:39.947181+0000","last_became_active":"2024-09-19T09:02:01.613675+0000","last_became_peered":"2024-09-19T09:02:01.613675+0000","last_unstale":"2024-09-19T09:03:39.947181+0000","last_undegraded":"2024-09-19T09:03:39.947181+0000","last_fullsized":"2024-09-19T09:03:39.947181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:17.138424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.697524+0000","last_change":"2024-09-19T09:01:59.567055+0000","last_active":"2024-09-19T09:02:11.697524+0000","last_peered":"2024-09-19T09:02:11.697524+0000","last_clean":"2024-09-19T09:02:11.697524+0000","last_became_active":"2024-09-19T09:01:59.566565+0000","last_became_peered":"2024-09-19T09:01:59.566565+0000","last_unstale":"2024-09-19T09:02:11.697524+0000","last_undegraded":"2024-09-19T09:02:11.697524+0000","last_fullsized":"2024-09-19T09:02:11.697524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:30.866807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.950637+0000","last_change":"2024-09-19T09:02:11.690071+0000","last_active":"2024-09-19T09:03:39.950637+0000","last_peered":"2024-09-19T09:03:39.950637+0000","last_clean":"2024-09-19T09:03:39.950637+0000","last_became_active":"2024-09-19T09:02:11.689498+0000","last_became_peered":"2024-09-19T09:02:11.689498+0000","last_unstale":"2024-09-19T09:03:39.950637+0000","last_undegraded":"2024-09-19T09:03:39.950637+0000","last_fullsized":"2024-09-19T09:03:39.950637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:12.293542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.689500+0000","last_change":"2024-09-19T09:02:00.003091+0000","last_active":"2024-09-19T09:02:11.689500+0000","last_peered":"2024-09-19T09:02:11.689500+0000","last_clean":"2024-09-19T09:02:11.689500+0000","last_became_active":"2024-09-19T09:02:00.002770+0000","last_became_peered":"2024-09-19T09:02:00.002770+0000","last_unstale":"2024-09-19T09:02:11.689500+0000","last_undegraded":"2024-09-19T09:02:11.689500+0000","last_fullsized":"2024-09-19T09:02:11.689500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:13.925383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.941644+0000","last_change":"2024-09-19T09:02:01.617441+0000","last_active":"2024-09-19T09:03:39.941644+0000","last_peered":"2024-09-19T09:03:39.941644+0000","last_clean":"2024-09-19T09:03:39.941644+0000","last_became_active":"2024-09-19T09:02:01.617084+0000","last_became_peered":"2024-09-19T09:02:01.617084+0000","last_unstale":"2024-09-19T09:03:39.941644+0000","last_undegraded":"2024-09-19T09:03:39.941644+0000","last_fullsized":"2024-09-19T09:03:39.941644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:59.012701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683133+0000","last_change":"2024-09-19T09:01:59.568584+0000","last_active":"2024-09-19T09:02:11.683133+0000","last_peered":"2024-09-19T09:02:11.683133+0000","last_clean":"2024-09-19T09:02:11.683133+0000","last_became_active":"2024-09-19T09:01:59.568142+0000","last_became_peered":"2024-09-19T09:01:59.568142+0000","last_unstale":"2024-09-19T09:02:11.683133+0000","last_undegraded":"2024-09-19T09:02:11.683133+0000","last_fullsized":"2024-09-19T09:02:11.683133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:40.005072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.959045+0000","last_change":"2024-09-19T09:02:01.618980+0000","last_active":"2024-09-19T09:03:39.959045+0000","last_peered":"2024-09-19T09:03:39.959045+0000","last_clean":"2024-09-19T09:03:39.959045+0000","last_became_active":"2024-09-19T09:02:01.618170+0000","last_became_peered":"2024-09-19T09:02:01.618170+0000","last_unstale":"2024-09-19T09:03:39.959045+0000","last_undegraded":"2024-09-19T09:03:39.959045+0000","last_fullsized":"2024-09-19T09:03:39.959045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:42.822319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.686917+0000","last_change":"2024-09-19T09:01:59.573559+0000","last_active":"2024-09-19T09:02:11.686917+0000","last_peered":"2024-09-19T09:02:11.686917+0000","last_clean":"2024-09-19T09:02:11.686917+0000","last_became_active":"2024-09-19T09:01:59.573204+0000","last_became_peered":"2024-09-19T09:01:59.573204+0000","last_unstale":"2024-09-19T09:02:11.686917+0000","last_undegraded":"2024-09-19T09:02:11.686917+0000","last_fullsized":"2024-09-19T09:02:11.686917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:20.249215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.955275+0000","last_change":"2024-09-19T09:02:01.611921+0000","last_active":"2024-09-19T09:03:39.955275+0000","last_peered":"2024-09-19T09:03:39.955275+0000","last_clean":"2024-09-19T09:03:39.955275+0000","last_became_active":"2024-09-19T09:02:01.611561+0000","last_became_peered":"2024-09-19T09:02:01.611561+0000","last_unstale":"2024-09-19T09:03:39.955275+0000","last_undegraded":"2024-09-19T09:03:39.955275+0000","last_fullsized":"2024-09-19T09:03:39.955275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:24.025737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687202+0000","last_change":"2024-09-19T09:01:59.572364+0000","last_active":"2024-09-19T09:02:11.687202+0000","last_peered":"2024-09-19T09:02:11.687202+0000","last_clean":"2024-09-19T09:02:11.687202+0000","last_became_active":"2024-09-19T09:01:59.572031+0000","last_became_peered":"2024-09-19T09:01:59.572031+0000","last_unstale":"2024-09-19T09:02:11.687202+0000","last_undegraded":"2024-09-19T09:02:11.687202+0000","last_fullsized":"2024-09-19T09:02:11.687202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:57.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.964988+0000","last_change":"2024-09-19T09:02:01.618949+0000","last_active":"2024-09-19T09:03:39.964988+0000","last_peered":"2024-09-19T09:03:39.964988+0000","last_clean":"2024-09-19T09:03:39.964988+0000","last_became_active":"2024-09-19T09:02:01.617490+0000","last_became_peered":"2024-09-19T09:02:01.617490+0000","last_unstale":"2024-09-19T09:03:39.964988+0000","last_undegraded":"2024-09-19T09:03:39.964988+0000","last_fullsized":"2024-09-19T09:03:39.964988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:20.719364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.965901+0000","last_change":"2024-09-19T09:02:01.612067+0000","last_active":"2024-09-19T09:03:39.965901+0000","last_peered":"2024-09-19T09:03:39.965901+0000","last_clean":"2024-09-19T09:03:39.965901+0000","last_became_active":"2024-09-19T09:02:01.611749+0000","last_became_peered":"2024-09-19T09:02:01.611749+0000","last_unstale":"2024-09-19T09:03:39.965901+0000","last_undegraded":"2024-09-19T09:03:39.965901+0000","last_fullsized":"2024-09-19T09:03:39.965901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.096041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.687589+0000","last_change":"2024-09-19T09:01:59.572084+0000","last_active":"2024-09-19T09:02:11.687589+0000","last_peered":"2024-09-19T09:02:11.687589+0000","last_clean":"2024-09-19T09:02:11.687589+0000","last_became_active":"2024-09-19T09:01:59.571660+0000","last_became_peered":"2024-09-19T09:01:59.571660+0000","last_unstale":"2024-09-19T09:02:11.687589+0000","last_undegraded":"2024-09-19T09:02:11.687589+0000","last_fullsized":"2024-09-19T09:02:11.687589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:18.767614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.967486+0000","last_change":"2024-09-19T09:02:01.607886+0000","last_active":"2024-09-19T09:03:39.967486+0000","last_peered":"2024-09-19T09:03:39.967486+0000","last_clean":"2024-09-19T09:03:39.967486+0000","last_became_active":"2024-09-19T09:02:01.607513+0000","last_became_peered":"2024-09-19T09:02:01.607513+0000","last_unstale":"2024-09-19T09:03:39.967486+0000","last_undegraded":"2024-09-19T09:03:39.967486+0000","last_fullsized":"2024-09-19T09:03:39.967486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:22.737838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.699956+0000","last_change":"2024-09-19T09:02:11.699484+0000","last_active":"2024-09-19T09:02:11.699956+0000","last_peered":"2024-09-19T09:02:11.699956+0000","last_clean":"2024-09-19T09:02:11.699956+0000","last_became_active":"2024-09-19T09:02:11.692320+0000","last_became_peered":"2024-09-19T09:02:11.692320+0000","last_unstale":"2024-09-19T09:02:11.699956+0000","last_undegraded":"2024-09-19T09:02:11.699956+0000","last_fullsized":"2024-09-19T09:02:11.699956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:21.217494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.960510+0000","last_change":"2024-09-19T09:02:01.616543+0000","last_active":"2024-09-19T09:03:39.960510+0000","last_peered":"2024-09-19T09:03:39.960510+0000","last_clean":"2024-09-19T09:03:39.960510+0000","last_became_active":"2024-09-19T09:02:01.616196+0000","last_became_peered":"2024-09-19T09:02:01.616196+0000","last_unstale":"2024-09-19T09:03:39.960510+0000","last_undegraded":"2024-09-19T09:03:39.960510+0000","last_fullsized":"2024-09-19T09:03:39.960510+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:14.167700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.683618+0000","last_change":"2024-09-19T09:02:00.002554+0000","last_active":"2024-09-19T09:02:11.683618+0000","last_peered":"2024-09-19T09:02:11.683618+0000","last_clean":"2024-09-19T09:02:11.683618+0000","last_became_active":"2024-09-19T09:02:00.002176+0000","last_became_peered":"2024-09-19T09:02:00.002176+0000","last_unstale":"2024-09-19T09:02:11.683618+0000","last_undegraded":"2024-09-19T09:02:11.683618+0000","last_fullsized":"2024-09-19T09:02:11.683618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.883228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:03:39.953415+0000","last_change":"2024-09-19T09:02:11.691044+0000","last_active":"2024-09-19T09:03:39.953415+0000","last_peered":"2024-09-19T09:03:39.953415+0000","last_clean":"2024-09-19T09:03:39.953415+0000","last_became_active":"2024-09-19T09:02:11.690680+0000","last_became_peered":"2024-09-19T09:02:11.690680+0000","last_unstale":"2024-09-19T09:03:39.953415+0000","last_undegraded":"2024-09-19T09:03:39.953415+0000","last_fullsized":"2024-09-19T09:03:39.953415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:02:00.589539+0000","last_clean_scrub_stamp":"2024-09-19T09:02:00.589539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:23.375378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T09:02:11.693212+0000","last_change":"2024-09-19T09:01:59.569063+0000","last_active":"2024-09-19T09:02:11.693212+0000","last_peered":"2024-09-19T09:02:11.693212+0000","last_clean":"2024-09-19T09:02:11.693212+0000","last_became_active":"2024-09-19T09:01:59.568680+0000","last_became_peered":"2024-09-19T09:01:59.568680+0000","last_unstale":"2024-09-19T09:02:11.693212+0000","last_undegraded":"2024-09-19T09:02:11.693212+0000","last_fullsized":"2024-09-19T09:02:11.693212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:01:58.556115+0000","last_clean_scrub_stamp":"2024-09-19T09:01:58.556115+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:58.846540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75690,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":654,"num_read_kb":407,"num_write":180,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":227070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645347,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":427256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874281,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1585152,"data_stored":1089856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005102,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40956,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704196,"statfs":{"total":95995035648,"available":95953096704,"internally_reserved":0,"allocated":1486848,"data_stored":1019844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626493,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":426847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1019528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":427284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40380,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704772,"statfs":{"total":95995035648,"available":95953686528,"internally_reserved":0,"allocated":897024,"data_stored":427158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":500036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607638,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":497793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704768,"statfs":{"total":95995035648,"available":95953682432,"internally_reserved":0,"allocated":901120,"data_stored":428118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":73396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":72731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:03:59.518 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:59.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:59 smithi022 ceph-mon[35107]: pgmap v334: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-19T09:03:59.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:03:59 smithi022 ceph-mon[35107]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:59.776 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:59.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:59 smithi001 ceph-mon[30939]: pgmap v334: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-19T09:03:59.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:03:59 smithi001 ceph-mon[30939]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:03:59.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:59 smithi064 ceph-mon[35179]: pgmap v334: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-19T09:03:59.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:03:59 smithi064 ceph-mon[35179]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:04:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 -- 172.21.15.1:0/1694311570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4102570 msgr2=0x7ff1d41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/1694311570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4102570 0x7ff1d41029b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009900 tx=0x7ff1c802a480 comp rx=0 tx=0).stop 2024-09-19T09:04:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 -- 172.21.15.1:0/1694311570 shutdown_connections 2024-09-19T09:04:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/1694311570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1d4102ef0 0x7ff1d410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/1694311570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4102570 0x7ff1d41029b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/1694311570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d4100e20 0x7ff1d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 -- 172.21.15.1:0/1694311570 >> 172.21.15.1:0/1694311570 conn(0x7ff1d40fc7d0 msgr2=0x7ff1d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 -- 172.21.15.1:0/1694311570 shutdown_connections 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 -- 172.21.15.1:0/1694311570 wait complete. 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.246+0000 7ff1dbca7640 1 Processor -- start 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1dbca7640 1 -- start start 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1dbca7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4100e20 0x7ff1d4197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1dbca7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d4102570 0x7ff1d4197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1dbca7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1d4102ef0 0x7ff1d419be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1dbca7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41110a0 con 0x7ff1d4100e20 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1dbca7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4110f20 con 0x7ff1d4102570 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1dbca7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4111220 con 0x7ff1d4102ef0 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4100e20 0x7ff1d4197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4100e20 0x7ff1d4197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44600/0 (socket says 172.21.15.1:44600) 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 -- 172.21.15.1:0/509838287 learned_addr learned my addr 172.21.15.1:0/509838287 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1da244640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1d4102ef0 0x7ff1d419be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9242640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d4102570 0x7ff1d4197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 -- 172.21.15.1:0/509838287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1d4102ef0 msgr2=0x7ff1d419be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1d4102ef0 0x7ff1d419be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 -- 172.21.15.1:0/509838287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d4102570 msgr2=0x7ff1d4197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d4102570 0x7ff1d4197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 -- 172.21.15.1:0/509838287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d419c510 con 0x7ff1d4100e20 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1da244640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1d4102ef0 0x7ff1d419be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9242640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d4102570 0x7ff1d4197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.247+0000 7ff1d9a43640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4100e20 0x7ff1d4197560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000d950 tx=0x7ff1d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.248+0000 7ff1c6ffd640 1 -- 172.21.15.1:0/509838287 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0017070 con 0x7ff1d4100e20 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.248+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d419c800 con 0x7ff1d4100e20 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.248+0000 7ff1c6ffd640 1 -- 172.21.15.1:0/509838287 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff1d0009c30 con 0x7ff1d4100e20 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.248+0000 7ff1c6ffd640 1 -- 172.21.15.1:0/509838287 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000f740 con 0x7ff1d4100e20 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.248+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d41a40e0 con 0x7ff1d4100e20 2024-09-19T09:04:00.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.249+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d4101200 con 0x7ff1d4100e20 2024-09-19T09:04:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.251+0000 7ff1c6ffd640 1 -- 172.21.15.1:0/509838287 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7ff1d0010a80 con 0x7ff1d4100e20 2024-09-19T09:04:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.251+0000 7ff1c6ffd640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff1c00a32d0 0x7ff1c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.251+0000 7ff1d9242640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff1c00a32d0 0x7ff1c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.252+0000 7ff1c6ffd640 1 -- 172.21.15.1:0/509838287 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff1d00cf790 con 0x7ff1d4100e20 2024-09-19T09:04:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.252+0000 7ff1d9242640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff1c00a32d0 0x7ff1c00a5790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8031580 tx=0x7ff1c8032c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:00.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.255+0000 7ff1c6ffd640 1 -- 172.21.15.1:0/509838287 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1d0009de0 con 0x7ff1d4100e20 2024-09-19T09:04:00.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.467+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1d4109090 con 0x7ff1d4100e20 2024-09-19T09:04:00.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.468+0000 7ff1c6ffd640 1 -- 172.21.15.1:0/509838287 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7ff1d009c330 con 0x7ff1d4100e20 2024-09-19T09:04:00.470 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:04:00.470 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:04:00.470 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.470+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff1c00a32d0 msgr2=0x7ff1c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.470+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff1c00a32d0 0x7ff1c00a5790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8031580 tx=0x7ff1c8032c40 comp rx=0 tx=0).stop 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.470+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4100e20 msgr2=0x7ff1d4197560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.470+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4100e20 0x7ff1d4197560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000d950 tx=0x7ff1d000de10 comp rx=0 tx=0).stop 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.471+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 shutdown_connections 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.471+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff1c00a32d0 0x7ff1c00a5790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.471+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1d4102ef0 0x7ff1d419be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.471+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1d4102570 0x7ff1d4197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.471+0000 7ff1dbca7640 1 --2- 172.21.15.1:0/509838287 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1d4100e20 0x7ff1d4197560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.471+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 >> 172.21.15.1:0/509838287 conn(0x7ff1d40fc7d0 msgr2=0x7ff1d4105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.471+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 shutdown_connections 2024-09-19T09:04:00.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:00.471+0000 7ff1dbca7640 1 -- 172.21.15.1:0/509838287 wait complete. 2024-09-19T09:04:01.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:01.454 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:01.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:01 smithi022 ceph-mon[35107]: pgmap v335: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:01.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:01 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/509838287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:01.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:01 smithi001 ceph-mon[30939]: pgmap v335: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:01.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:01 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/509838287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:01 smithi064 ceph-mon[35179]: pgmap v335: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:01.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:01 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/509838287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 -- 172.21.15.1:0/751842266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102570 msgr2=0x7f8cb41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 --2- 172.21.15.1:0/751842266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102570 0x7f8cb41029b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009900 tx=0x7f8ca802a480 comp rx=0 tx=0).stop 2024-09-19T09:04:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 -- 172.21.15.1:0/751842266 shutdown_connections 2024-09-19T09:04:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 --2- 172.21.15.1:0/751842266 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb4102ef0 0x7f8cb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 --2- 172.21.15.1:0/751842266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102570 0x7f8cb41029b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 --2- 172.21.15.1:0/751842266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cb4100e20 0x7f8cb4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 -- 172.21.15.1:0/751842266 >> 172.21.15.1:0/751842266 conn(0x7f8cb40fc7d0 msgr2=0x7f8cb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 -- 172.21.15.1:0/751842266 shutdown_connections 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 -- 172.21.15.1:0/751842266 wait complete. 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 Processor -- start 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.889+0000 7f8cbc623640 1 -- start start 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cbc623640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cb4100e20 0x7f8cb410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cbc623640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb4102570 0x7f8cb410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cbc623640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102ef0 0x7f8cb410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cbc623640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb41121c0 con 0x7f8cb4102ef0 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cbc623640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4112040 con 0x7f8cb4100e20 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cbc623640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4112340 con 0x7f8cb4102570 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cba3bf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cb4100e20 0x7f8cb410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cb9bbe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb4102570 0x7f8cb410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cba3bf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cb4100e20 0x7f8cb410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:38294/0 (socket says 172.21.15.1:38294) 2024-09-19T09:04:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cba3bf640 1 -- 172.21.15.1:0/2329419875 learned_addr learned my addr 172.21.15.1:0/2329419875 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:01.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cbabc0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102ef0 0x7f8cb410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cba3bf640 1 -- 172.21.15.1:0/2329419875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb4102570 msgr2=0x7f8cb410ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cba3bf640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb4102570 0x7f8cb410ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cba3bf640 1 -- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102ef0 msgr2=0x7f8cb410ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cba3bf640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102ef0 0x7f8cb410ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cba3bf640 1 -- 172.21.15.1:0/2329419875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb41a6b00 con 0x7f8cb4100e20 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cbabc0640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102ef0 0x7f8cb410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.890+0000 7f8cb9bbe640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb4102570 0x7f8cb410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.891+0000 7f8cba3bf640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cb4100e20 0x7f8cb410e4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400db80 tx=0x7f8ca400b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.891+0000 7f8cb37fe640 1 -- 172.21.15.1:0/2329419875 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4017070 con 0x7f8cb4100e20 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.891+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb41a6df0 con 0x7f8cb4100e20 2024-09-19T09:04:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.891+0000 7f8cb37fe640 1 -- 172.21.15.1:0/2329419875 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ca4003b70 con 0x7f8cb4100e20 2024-09-19T09:04:01.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.891+0000 7f8cb37fe640 1 -- 172.21.15.1:0/2329419875 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40106c0 con 0x7f8cb4100e20 2024-09-19T09:04:01.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.891+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb41a7250 con 0x7f8cb4100e20 2024-09-19T09:04:01.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.892+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb4101200 con 0x7f8cb4100e20 2024-09-19T09:04:01.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.893+0000 7f8cb37fe640 1 -- 172.21.15.1:0/2329419875 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f8ca4004a40 con 0x7f8cb4100e20 2024-09-19T09:04:01.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.894+0000 7f8cb37fe640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8c9c0a32d0 0x7f8c9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.894+0000 7f8cb37fe640 1 -- 172.21.15.1:0/2329419875 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8ca40cfae0 con 0x7f8cb4100e20 2024-09-19T09:04:01.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.894+0000 7f8cb9bbe640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8c9c0a32d0 0x7f8c9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.894+0000 7f8cb9bbe640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8c9c0a32d0 0x7f8c9c0a5790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009230 tx=0x7f8ca80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:01.897+0000 7f8cb37fe640 1 -- 172.21.15.1:0/2329419875 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ca4020070 con 0x7f8cb4100e20 2024-09-19T09:04:02.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.109+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cb41a7480 con 0x7f8cb4100e20 2024-09-19T09:04:02.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.110+0000 7f8cb37fe640 1 -- 172.21.15.1:0/2329419875 <== mon.2 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f8ca409c620 con 0x7f8cb4100e20 2024-09-19T09:04:02.111 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:04:02.111 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:04:02.112 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:04:02.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8c9c0a32d0 msgr2=0x7f8c9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8c9c0a32d0 0x7f8c9c0a5790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009230 tx=0x7f8ca80058d0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cb4100e20 msgr2=0x7f8cb410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cb4100e20 0x7f8cb410e4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400db80 tx=0x7f8ca400b630 comp rx=0 tx=0).stop 2024-09-19T09:04:02.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 shutdown_connections 2024-09-19T09:04:02.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cb4102ef0 0x7f8cb410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8c9c0a32d0 0x7f8c9c0a5790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cb4102570 0x7f8cb410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 --2- 172.21.15.1:0/2329419875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cb4100e20 0x7f8cb410e4d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 >> 172.21.15.1:0/2329419875 conn(0x7f8cb40fc7d0 msgr2=0x7f8cb41068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:02.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 shutdown_connections 2024-09-19T09:04:02.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:02.112+0000 7f8cbc623640 1 -- 172.21.15.1:0/2329419875 wait complete. 2024-09-19T09:04:02.709 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:02 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2329419875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:02.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:02 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2329419875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:02.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:02 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2329419875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:02.863 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:04:03.127 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:03.515 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:03 smithi001 ceph-mon[30939]: pgmap v336: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T09:04:03.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 -- 172.21.15.1:0/3930667408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 msgr2=0x7fc4c810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/3930667408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 0x7fc4c810d950 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0009cd0 tx=0x7fc4c002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 -- 172.21.15.1:0/3930667408 shutdown_connections 2024-09-19T09:04:03.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/3930667408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 0x7fc4c810d950 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/3930667408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4c8100a80 0x7fc4c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/3930667408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8106a80 0x7fc4c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 -- 172.21.15.1:0/3930667408 >> 172.21.15.1:0/3930667408 conn(0x7fc4c80fc7a0 msgr2=0x7fc4c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:03.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 -- 172.21.15.1:0/3930667408 shutdown_connections 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.595+0000 7fc4cdb65640 1 -- 172.21.15.1:0/3930667408 wait complete. 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.596+0000 7fc4cdb65640 1 Processor -- start 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.596+0000 7fc4cdb65640 1 -- start start 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.596+0000 7fc4cdb65640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8100a80 0x7fc4c8198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.596+0000 7fc4cdb65640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 0x7fc4c8198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.596+0000 7fc4cdb65640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4c8106a80 0x7fc4c819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.596+0000 7fc4cdb65640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8111060 con 0x7fc4c8101420 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.596+0000 7fc4cdb65640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8110ee0 con 0x7fc4c8106a80 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.596+0000 7fc4cdb65640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c81111e0 con 0x7fc4c8100a80 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 0x7fc4c8198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 0x7fc4c8198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34288/0 (socket says 172.21.15.1:34288) 2024-09-19T09:04:03.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 -- 172.21.15.1:0/2616737924 learned_addr learned my addr 172.21.15.1:0/2616737924 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c77fe640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8100a80 0x7fc4c8198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c7fff640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4c8106a80 0x7fc4c819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 -- 172.21.15.1:0/2616737924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8100a80 msgr2=0x7fc4c8198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8100a80 0x7fc4c8198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 -- 172.21.15.1:0/2616737924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4c8106a80 msgr2=0x7fc4c819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4c8106a80 0x7fc4c819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 -- 172.21.15.1:0/2616737924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c819d5c0 con 0x7fc4c8101420 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c7fff640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4c8106a80 0x7fc4c819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c6ffd640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 0x7fc4c8198b50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00b4a0 tx=0x7fc4bc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c4ff9640 1 -- 172.21.15.1:0/2616737924 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc015020 con 0x7fc4c8101420 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c819d8b0 con 0x7fc4c8101420 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c4ff9640 1 -- 172.21.15.1:0/2616737924 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4bc011d30 con 0x7fc4c8101420 2024-09-19T09:04:03.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4c4ff9640 1 -- 172.21.15.1:0/2616737924 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00f2e0 con 0x7fc4c8101420 2024-09-19T09:04:03.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.597+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c81a5190 con 0x7fc4c8101420 2024-09-19T09:04:03.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.598+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c8100f60 con 0x7fc4c8101420 2024-09-19T09:04:03.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.600+0000 7fc4c4ff9640 1 -- 172.21.15.1:0/2616737924 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fc4bc018020 con 0x7fc4c8101420 2024-09-19T09:04:03.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.600+0000 7fc4c4ff9640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc4b00a32d0 0x7fc4b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:03.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.600+0000 7fc4c77fe640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc4b00a32d0 0x7fc4b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:03.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.600+0000 7fc4c4ff9640 1 -- 172.21.15.1:0/2616737924 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc4bc0cf320 con 0x7fc4c8101420 2024-09-19T09:04:03.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.601+0000 7fc4c77fe640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc4b00a32d0 0x7fc4b00a5790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009990 tx=0x7fc4b8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:03.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.604+0000 7fc4c4ff9640 1 -- 172.21.15.1:0/2616737924 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4bc01f020 con 0x7fc4c8101420 2024-09-19T09:04:03.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:03 smithi022 ceph-mon[35107]: pgmap v336: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T09:04:03.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.781+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4c8109a90 con 0x7fc4c8101420 2024-09-19T09:04:03.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.783+0000 7fc4c4ff9640 1 -- 172.21.15.1:0/2616737924 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7fc4bc09bf70 con 0x7fc4c8101420 2024-09-19T09:04:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:04:03.784 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:04:03.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc4b00a32d0 msgr2=0x7fc4b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc4b00a32d0 0x7fc4b00a5790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009990 tx=0x7fc4b8009110 comp rx=0 tx=0).stop 2024-09-19T09:04:03.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 msgr2=0x7fc4c8198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 0x7fc4c8198b50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00b4a0 tx=0x7fc4bc00b8a0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 shutdown_connections 2024-09-19T09:04:03.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4c8106a80 0x7fc4c819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4c8101420 0x7fc4c8198b50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc4b00a32d0 0x7fc4b00a5790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 --2- 172.21.15.1:0/2616737924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4c8100a80 0x7fc4c8198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 >> 172.21.15.1:0/2616737924 conn(0x7fc4c80fc7a0 msgr2=0x7fc4c806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:03.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 shutdown_connections 2024-09-19T09:04:03.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:03.785+0000 7fc4cdb65640 1 -- 172.21.15.1:0/2616737924 wait complete. 2024-09-19T09:04:03.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:03 smithi064 ceph-mon[35179]: pgmap v336: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T09:04:04.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T09:04:04.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:04 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2616737924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:04:04.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:04 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2616737924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:04:04.742 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:04.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:04 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2616737924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:04:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 -- 172.21.15.1:0/1139166829 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 msgr2=0x7f25441020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 --2- 172.21.15.1:0/1139166829 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 0x7f25441020b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2534009ca0 tx=0x7f253402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 -- 172.21.15.1:0/1139166829 shutdown_connections 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 --2- 172.21.15.1:0/1139166829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25441025f0 0x7f2544108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 --2- 172.21.15.1:0/1139166829 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 0x7f25441020b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 --2- 172.21.15.1:0/1139166829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2544100a40 0x7f2544100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 -- 172.21.15.1:0/1139166829 >> 172.21.15.1:0/1139166829 conn(0x7f25440fc1c0 msgr2=0x7f25440fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 -- 172.21.15.1:0/1139166829 shutdown_connections 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.413+0000 7f254adc4640 1 -- 172.21.15.1:0/1139166829 wait complete. 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f254adc4640 1 Processor -- start 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f254adc4640 1 -- start start 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f254adc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2544100a40 0x7f2544197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f254adc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 0x7f25441984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f254adc4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25441025f0 0x7f254419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f254adc4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f254410c820 con 0x7f2544101c30 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f254adc4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f254410c6a0 con 0x7f2544100a40 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f254adc4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f254410c9a0 con 0x7f25441025f0 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2543fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 0x7f25441984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2543fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 0x7f25441984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34294/0 (socket says 172.21.15.1:34294) 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2543fff640 1 -- 172.21.15.1:0/3374130757 learned_addr learned my addr 172.21.15.1:0/3374130757 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2548b60640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2544100a40 0x7f2544197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2543fff640 1 -- 172.21.15.1:0/3374130757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25441025f0 msgr2=0x7f254419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2549361640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25441025f0 0x7f254419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2543fff640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25441025f0 0x7f254419f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2543fff640 1 -- 172.21.15.1:0/3374130757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2544100a40 msgr2=0x7f2544197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2543fff640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2544100a40 0x7f2544197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2543fff640 1 -- 172.21.15.1:0/3374130757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254419fbb0 con 0x7f2544101c30 2024-09-19T09:04:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2548b60640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2544100a40 0x7f2544197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.414+0000 7f2549361640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25441025f0 0x7f254419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.415+0000 7f2543fff640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 0x7f25441984d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2534009dc0 tx=0x7f253402f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.415+0000 7f2541ffb640 1 -- 172.21.15.1:0/3374130757 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253402fe40 con 0x7f2544101c30 2024-09-19T09:04:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.415+0000 7f2541ffb640 1 -- 172.21.15.1:0/3374130757 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2534030ac0 con 0x7f2544101c30 2024-09-19T09:04:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.415+0000 7f2541ffb640 1 -- 172.21.15.1:0/3374130757 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534046cf0 con 0x7f2544101c30 2024-09-19T09:04:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.415+0000 7f254adc4640 1 -- 172.21.15.1:0/3374130757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254419fe40 con 0x7f2544101c30 2024-09-19T09:04:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.415+0000 7f254adc4640 1 -- 172.21.15.1:0/3374130757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25441a0300 con 0x7f2544101c30 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.417+0000 7f2541ffb640 1 -- 172.21.15.1:0/3374130757 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f2534030c70 con 0x7f2544101c30 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f254dc41740 1 Processor -- start 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f254dc41740 1 -- start start 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f254dc41740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f213bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f254dc41740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 0x55b4f2140da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f254dc41740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f2143830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f254dc41740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b4f209f2f0 con 0x55b4f213b9a0 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f254dc41740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2047270 con 0x55b4f2141370 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f254dc41740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b4f209b2b0 con 0x55b4f213c2e0 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2549361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f213bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2549361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f213bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34296/0 (socket says 172.21.15.1:34296) 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2549361640 1 -- 172.21.15.1:0/319335990 learned_addr learned my addr 172.21.15.1:0/319335990 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2543fff640 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f2143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2548b60640 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 0x55b4f2140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2549361640 1 -- 172.21.15.1:0/319335990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 msgr2=0x55b4f2140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2549361640 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 0x55b4f2140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2549361640 1 -- 172.21.15.1:0/319335990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 msgr2=0x55b4f2143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2549361640 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f2143830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2541ffb640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25300a32d0 0x7f25300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.418+0000 7f2549361640 1 -- 172.21.15.1:0/319335990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4f2046340 con 0x55b4f213b9a0 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.419+0000 7f2548b60640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25300a32d0 0x7f25300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.419+0000 7f2541ffb640 1 -- 172.21.15.1:0/3374130757 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f25340f1210 con 0x7f2544101c30 2024-09-19T09:04:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.419+0000 7f2549361640 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f213bda0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f253c00bae0 tx=0x7f253c00d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4232673a6d65cf43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.419+0000 7f253affd640 1 -- 172.21.15.1:0/319335990 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c017420 con 0x55b4f213b9a0 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.419+0000 7f253affd640 1 -- 172.21.15.1:0/319335990 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f253c017ac0 con 0x55b4f213b9a0 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.419+0000 7f253affd640 1 -- 172.21.15.1:0/319335990 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c00fb40 con 0x55b4f213b9a0 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 -- 172.21.15.1:0/319335990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 msgr2=0x55b4f213bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f213bda0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f253c00bae0 tx=0x7f253c00d340 comp rx=0 tx=0).stop 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f2548b60640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25300a32d0 0x7f25300a5790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55b4f213cd10 tx=0x7f252c00b420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 -- 172.21.15.1:0/319335990 shutdown_connections 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f2143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 0x55b4f2140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 --2- 172.21.15.1:0/319335990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f213bda0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 -- 172.21.15.1:0/319335990 >> 172.21.15.1:0/319335990 conn(0x55b4f2137010 msgr2=0x55b4f2137410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 -- 172.21.15.1:0/319335990 shutdown_connections 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 -- 172.21.15.1:0/319335990 wait complete. 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 -- start start 2024-09-19T09:04:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.420+0000 7f254dc41740 1 Processor -- start 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f254dc41740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f2145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f254dc41740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 0x55b4f2146100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f254dc41740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f214d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f254dc41740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2144340 con 0x55b4f213b9a0 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f254dc41740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b4f2028290 con 0x55b4f213c2e0 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f254dc41740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b4f21444c0 con 0x55b4f2141370 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f254dc41740 10 client.0 _ll_register_callbacks cb 0x55b4f2059140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f2145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f2145bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34312/0 (socket says 172.21.15.1:34312) 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 -- 172.21.15.1:0/3295837450 learned_addr learned my addr 172.21.15.1:0/3295837450 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2543fff640 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 0x55b4f2146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2549361640 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f214d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 -- 172.21.15.1:0/3295837450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 msgr2=0x55b4f214d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f214d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 -- 172.21.15.1:0/3295837450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 msgr2=0x55b4f2146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 0x55b4f2146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 -- 172.21.15.1:0/3295837450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4f1db2210 con 0x55b4f213b9a0 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2548b60640 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f2145bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f252c005c40 tx=0x7f252c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d575891b59261fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.421+0000 7f2523fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f2523fff640 1 -- 172.21.15.1:0/3295837450 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c00eab0 con 0x55b4f213b9a0 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 1 -- 172.21.15.1:0/3295837450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f253c017ac0 con 0x55b4f213b9a0 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f2523fff640 1 -- 172.21.15.1:0/3295837450 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f252c00ec50 con 0x55b4f213b9a0 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f2523fff640 1 -- 172.21.15.1:0/3295837450 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f252c00ee50 con 0x55b4f213b9a0 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 10 client.15303 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 1 -- 172.21.15.1:0/3295837450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b4f1e7e620 con 0x55b4f213b9a0 2024-09-19T09:04:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f2523fff640 1 -- 172.21.15.1:0/3295837450 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f253c017ac0 con 0x55b4f213b9a0 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f2523fff640 1 -- 172.21.15.1:0/3295837450 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f252c0326b0 con 0x55b4f213b9a0 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 10 client.15303 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 10 client.15303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 20 client.15303 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b4f21518e0 0x55b4f2153d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 4 client.15303 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.422+0000 7f254dc41740 1 -- 172.21.15.1:0/3295837450 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4f20aca20 con 0x55b4f21518e0 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.423+0000 7f2543fff640 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b4f21518e0 0x55b4f2153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.423+0000 7f2523fff640 10 client.15303 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.423+0000 7f2543fff640 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b4f21518e0 0x55b4f2153d30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c8e67ff80782ab server_cookie=ced27530fad157cd in_seq=0 out_seq=0 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f2523fff640 1 -- 172.21.15.1:0/3295837450 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4f20aca20 con 0x55b4f21518e0 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f2523fff640 10 client.15303 handle_command_reply: tid=0 2024-09-19T09:04:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 client.15303 shutdown 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 -- 172.21.15.1:0/3295837450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 msgr2=0x55b4f2145bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f2145bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f252c005c40 tx=0x7f252c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 -- 172.21.15.1:0/3295837450 shutdown_connections 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b4f21518e0 0x55b4f2153d30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f214d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 0x55b4f2146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 --2- 172.21.15.1:0/3295837450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f2145bc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 -- 172.21.15.1:0/3295837450 >> 172.21.15.1:0/3295837450 conn(0x55b4f2137010 msgr2=0x55b4f2138820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f2523fff640 0 client.15303 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 -- 172.21.15.1:0/3295837450 shutdown_connections 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 1 -- 172.21.15.1:0/3295837450 wait complete. 2024-09-19T09:04:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.424+0000 7f254dc41740 20 client.15303 trim_cache size 0 max 16384 2024-09-19T09:04:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f254dc41740 1 Processor -- start 2024-09-19T09:04:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f254dc41740 1 -- start start 2024-09-19T09:04:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f254dc41740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f21360b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f254dc41740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 0x55b4f214d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f254dc41740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f2138400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f254dc41740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25441ab9f0 con 0x55b4f213b9a0 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f254dc41740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25441a92c0 con 0x55b4f213c2e0 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f254dc41740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25441a7110 con 0x55b4f2141370 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f21360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f21360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34320/0 (socket says 172.21.15.1:34320) 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 -- 172.21.15.1:0/92107184 learned_addr learned my addr 172.21.15.1:0/92107184 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2543fff640 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 0x55b4f214d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2549361640 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f2138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 -- 172.21.15.1:0/92107184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 msgr2=0x55b4f2138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f2138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 -- 172.21.15.1:0/92107184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 msgr2=0x55b4f214d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 0x55b4f214d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 -- 172.21.15.1:0/92107184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4f2145700 con 0x55b4f213b9a0 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2549361640 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f2138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.441+0000 7f2548b60640 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f21360b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f252c0058c0 tx=0x7f252c00b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126b9fd265e53ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f253a7fc640 1 -- 172.21.15.1:0/92107184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c032d40 con 0x55b4f213b9a0 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f253a7fc640 1 -- 172.21.15.1:0/92107184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f252c00e780 con 0x55b4f213b9a0 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f253a7fc640 1 -- 172.21.15.1:0/92107184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c01c990 con 0x55b4f213b9a0 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 -- 172.21.15.1:0/92107184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 msgr2=0x55b4f21360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f21360b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f252c0058c0 tx=0x7f252c00b620 comp rx=0 tx=0).stop 2024-09-19T09:04:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 -- 172.21.15.1:0/92107184 shutdown_connections 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f2141370 0x55b4f2138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f213c2e0 0x55b4f214d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 --2- 172.21.15.1:0/92107184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f21360b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 -- 172.21.15.1:0/92107184 >> 172.21.15.1:0/92107184 conn(0x55b4f2137010 msgr2=0x55b4f21359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 -- 172.21.15.1:0/92107184 shutdown_connections 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.442+0000 7f254dc41740 1 -- 172.21.15.1:0/92107184 wait complete. 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 1 -- start start 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 1 Processor -- start 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f214a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 0x55b4f214aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f214bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25441a7780 con 0x55b4f213b9a0 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25441a8bf0 con 0x55b4f2141370 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25441a7e50 con 0x55b4f213c2e0 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f254dc41740 10 client.0 _ll_register_callbacks cb 0x7f252c00ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f2548b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f214a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f2548b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f214a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34332/0 (socket says 172.21.15.1:34332) 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.443+0000 7f2548b60640 1 -- 172.21.15.1:0/1427584002 learned_addr learned my addr 172.21.15.1:0/1427584002 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2549361640 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f214bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2548b60640 1 -- 172.21.15.1:0/1427584002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 msgr2=0x55b4f214aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2543fff640 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 0x55b4f214aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2548b60640 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 0x55b4f214aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2548b60640 1 -- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 msgr2=0x55b4f214bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2548b60640 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f214bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2548b60640 1 -- 172.21.15.1:0/1427584002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4f214c4f0 con 0x55b4f213b9a0 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2549361640 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f214bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2548b60640 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f214a990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f252c00f010 tx=0x7f252c032650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a743b49a00b09a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2523fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2523fff640 1 -- 172.21.15.1:0/1427584002 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c032840 con 0x55b4f213b9a0 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f254dc41740 1 -- 172.21.15.1:0/1427584002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f252c00e780 con 0x55b4f213b9a0 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2523fff640 1 -- 172.21.15.1:0/1427584002 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f252c01c920 con 0x55b4f213b9a0 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2523fff640 1 -- 172.21.15.1:0/1427584002 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f252c04d050 con 0x55b4f213b9a0 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f254dc41740 10 client.15309 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f254dc41740 1 -- 172.21.15.1:0/1427584002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b4f21bc670 con 0x55b4f213b9a0 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.444+0000 7f2523fff640 1 -- 172.21.15.1:0/1427584002 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f252c00e780 con 0x55b4f213b9a0 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f2523fff640 1 -- 172.21.15.1:0/1427584002 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f252c03c460 con 0x55b4f213b9a0 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f254dc41740 10 client.15309 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f254dc41740 10 client.15309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f254dc41740 20 client.15309 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f254dc41740 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b4f21bcf60 0x55b4f21bf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f254dc41740 4 client.15309 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f254dc41740 1 -- 172.21.15.1:0/1427584002 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b4f20a6d70 con 0x55b4f21bcf60 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f2543fff640 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b4f21bcf60 0x55b4f21bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f2543fff640 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b4f21bcf60 0x55b4f21bf380 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48fb32a8a38a2faa server_cookie=5d0642d998064709 in_seq=0 out_seq=0 2024-09-19T09:04:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.445+0000 7f2523fff640 10 client.15309 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f2523fff640 1 -- 172.21.15.1:0/1427584002 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4f20a6d70 con 0x55b4f21bcf60 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f2523fff640 10 client.15309 handle_command_reply: tid=0 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 client.15309 shutdown 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 -- 172.21.15.1:0/1427584002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 msgr2=0x55b4f214a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f214a990 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f252c00f010 tx=0x7f252c032650 comp rx=0 tx=0).stop 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 -- 172.21.15.1:0/1427584002 shutdown_connections 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b4f21bcf60 0x55b4f21bf380 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b4f2141370 0x55b4f214bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b4f213c2e0 0x55b4f214aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 --2- 172.21.15.1:0/1427584002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b4f213b9a0 0x55b4f214a990 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 -- 172.21.15.1:0/1427584002 >> 172.21.15.1:0/1427584002 conn(0x55b4f2137010 msgr2=0x55b4f21361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f2523fff640 0 client.15309 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 -- 172.21.15.1:0/1427584002 shutdown_connections 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 1 -- 172.21.15.1:0/1427584002 wait complete. 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.456+0000 7f254dc41740 20 client.15309 trim_cache size 0 max 16384 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:04:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:04:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 -- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25300a32d0 msgr2=0x7f25300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25300a32d0 0x7f25300a5790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55b4f213cd10 tx=0x7f252c00b420 comp rx=0 tx=0).stop 2024-09-19T09:04:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 -- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 msgr2=0x7f25441984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 0x7f25441984d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2534009dc0 tx=0x7f253402f840 comp rx=0 tx=0).stop 2024-09-19T09:04:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 -- 172.21.15.1:0/3374130757 shutdown_connections 2024-09-19T09:04:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25300a32d0 0x7f25300a5790 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25441025f0 0x7f254419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2544101c30 0x7f25441984d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 --2- 172.21.15.1:0/3374130757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2544100a40 0x7f2544197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 -- 172.21.15.1:0/3374130757 >> 172.21.15.1:0/3374130757 conn(0x7f25440fc1c0 msgr2=0x7f25440fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 -- 172.21.15.1:0/3374130757 shutdown_connections 2024-09-19T09:04:05.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:05.457+0000 7f254adc4640 1 -- 172.21.15.1:0/3374130757 wait complete. 2024-09-19T09:04:05.708 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:05 smithi022 ceph-mon[35107]: pgmap v337: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T09:04:05.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:05 smithi001 ceph-mon[30939]: pgmap v337: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T09:04:05.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:05 smithi064 ceph-mon[35179]: pgmap v337: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-19T09:04:05.982 INFO:teuthology.orchestra.run.smithi001.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T09:04:05.983 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T09:04:05.983 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T09:04:05.983 DEBUG:tasks.quiescer:Yielding 2024-09-19T09:04:05.983 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T09:04:05.999 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:04:05.999 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:04:05.999 INFO:tasks.workunit:timeout=3h 2024-09-19T09:04:05.999 INFO:tasks.workunit:cleanup=True 2024-09-19T09:04:06.000 DEBUG:teuthology.orchestra.run.smithi001:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:04:06.000 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:06.018 INFO:teuthology.orchestra.run.smithi001.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:04:06.018 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:04:06.018 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 6ch/108d Inode: 1099511628283 Links: 2 2024-09-19T09:04:06.019 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:04:06.019 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:04:06.019 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 09:02:20.282667726 +0000 2024-09-19T09:04:06.019 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 09:02:20.282667726 +0000 2024-09-19T09:04:06.019 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 09:03:42.760033252 +0000 2024-09-19T09:04:06.019 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 09:02:20.282667726 +0000 2024-09-19T09:04:06.019 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:04:06.019 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:04:06.094 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:04:06.151 INFO:tasks.workunit.client.0.smithi001.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:04:06.271 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:06.695 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:06 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:06.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 -- 172.21.15.1:0/99944289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102ef0 msgr2=0x7f222410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 --2- 172.21.15.1:0/99944289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102ef0 0x7f222410da40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f221c009ca0 tx=0x7f221c02a950 comp rx=0 tx=0).stop 2024-09-19T09:04:06.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 -- 172.21.15.1:0/99944289 shutdown_connections 2024-09-19T09:04:06.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 --2- 172.21.15.1:0/99944289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102ef0 0x7f222410da40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 --2- 172.21.15.1:0/99944289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2224102570 0x7f22241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 --2- 172.21.15.1:0/99944289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2224100e20 0x7f2224101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 -- 172.21.15.1:0/99944289 >> 172.21.15.1:0/99944289 conn(0x7f22240fc7d0 msgr2=0x7f22240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 -- 172.21.15.1:0/99944289 shutdown_connections 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.695+0000 7f222b4af640 1 -- 172.21.15.1:0/99944289 wait complete. 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222b4af640 1 Processor -- start 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222b4af640 1 -- start start 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222b4af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2224100e20 0x7f22240fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222b4af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102570 0x7f22240fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222b4af640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2224102ef0 0x7f22240fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222b4af640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22241110a0 con 0x7f2224102570 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222b4af640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2224110f20 con 0x7f2224102ef0 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222b4af640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2224111220 con 0x7f2224100e20 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f2228a4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102570 0x7f22240fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f2228a4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102570 0x7f22240fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34360/0 (socket says 172.21.15.1:34360) 2024-09-19T09:04:06.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f2228a4a640 1 -- 172.21.15.1:0/3608028041 learned_addr learned my addr 172.21.15.1:0/3608028041 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f222924b640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2224100e20 0x7f22240fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f2228a4a640 1 -- 172.21.15.1:0/3608028041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2224100e20 msgr2=0x7f22240fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f2228a4a640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2224100e20 0x7f22240fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f2228a4a640 1 -- 172.21.15.1:0/3608028041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2224102ef0 msgr2=0x7f22240fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f2228a4a640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2224102ef0 0x7f22240fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.696+0000 7f2228a4a640 1 -- 172.21.15.1:0/3608028041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22241a6aa0 con 0x7f2224102570 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.697+0000 7f2228a4a640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102570 0x7f22240fd1c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f221400e9f0 tx=0x7f221400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.697+0000 7f221a7fc640 1 -- 172.21.15.1:0/3608028041 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221400cd80 con 0x7f2224102570 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.697+0000 7f221a7fc640 1 -- 172.21.15.1:0/3608028041 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2214010930 con 0x7f2224102570 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.697+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22241a6d90 con 0x7f2224102570 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.697+0000 7f221a7fc640 1 -- 172.21.15.1:0/3608028041 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214018b00 con 0x7f2224102570 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.697+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22241a7240 con 0x7f2224102570 2024-09-19T09:04:06.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.698+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2224101200 con 0x7f2224102570 2024-09-19T09:04:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.699+0000 7f221a7fc640 1 -- 172.21.15.1:0/3608028041 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f2214018ca0 con 0x7f2224102570 2024-09-19T09:04:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.700+0000 7f221a7fc640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f22100a3350 0x7f22100a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.700+0000 7f222924b640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f22100a3350 0x7f22100a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.700+0000 7f221a7fc640 1 -- 172.21.15.1:0/3608028041 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f22140d0110 con 0x7f2224102570 2024-09-19T09:04:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.701+0000 7f222924b640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f22100a3350 0x7f22100a5810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f222000bbe0 tx=0x7f222000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.708+0000 7f221a7fc640 1 -- 172.21.15.1:0/3608028041 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f221409ccb0 con 0x7f2224102570 2024-09-19T09:04:06.813 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:06 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:06.840 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:06 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:06.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.941+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f222410a0d0 con 0x7f2224102570 2024-09-19T09:04:06.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.942+0000 7f221a7fc640 1 -- 172.21.15.1:0/3608028041 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f221409c5b0 con 0x7f2224102570 2024-09-19T09:04:06.942 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:04:06.942 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:04:06.943 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:04:06.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f22100a3350 msgr2=0x7f22100a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f22100a3350 0x7f22100a5810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f222000bbe0 tx=0x7f222000b390 comp rx=0 tx=0).stop 2024-09-19T09:04:06.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102570 msgr2=0x7f22240fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102570 0x7f22240fd1c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f221400e9f0 tx=0x7f221400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 shutdown_connections 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2224102ef0 0x7f22240fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2224102570 0x7f22240fd1c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f22100a3350 0x7f22100a5810 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 --2- 172.21.15.1:0/3608028041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2224100e20 0x7f22240fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 >> 172.21.15.1:0/3608028041 conn(0x7f22240fc7d0 msgr2=0x7f222406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 shutdown_connections 2024-09-19T09:04:06.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:06.944+0000 7f222b4af640 1 -- 172.21.15.1:0/3608028041 wait complete. 2024-09-19T09:04:07.723 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:07 smithi001 ceph-mon[30939]: pgmap v338: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T09:04:07.723 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:07 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3608028041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:07.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:02:02.334504+0000', 'modified': '2024-09-19T09:03:43.446158+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24500, 'mds_1': 24493, 'mds_2': 24482}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6835/728335709', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6834', 'nonce': 728335709}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 728335709}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6835/1194065600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 1194065600}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 1194065600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.64:6837/1600726820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6836', 'nonce': 1600726820}, {'type': 'v1', 'addr': '172.21.15.64:6837', 'nonce': 1600726820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.22:6837/866445696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6836', 'nonce': 866445696}, {'type': 'v1', 'addr': '172.21.15.22:6837', 'nonce': 866445696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.64:6839/2311666322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6838', 'nonce': 2311666322}, {'type': 'v1', 'addr': '172.21.15.64:6839', 'nonce': 2311666322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24500': {'gid': 24500, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6839/1767594317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 1767594317}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 1767594317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24500, 'qdb_cluster': [24500, 24493, 24482]} 2024-09-19T09:04:07.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T09:04:07.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:04:07.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:07 smithi064 ceph-mon[35179]: pgmap v338: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T09:04:07.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:07 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3608028041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:07.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:07 smithi022 ceph-mon[35107]: pgmap v338: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-19T09:04:07.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:07 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3608028041' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:08.651 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:08 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:04:08.651 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.651 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.651 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.651 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:08 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 -- 172.21.15.1:0/2647865352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710100a80 msgr2=0x7f8710100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 --2- 172.21.15.1:0/2647865352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710100a80 0x7f8710100ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8704009930 tx=0x7f870402a420 comp rx=0 tx=0).stop 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 -- 172.21.15.1:0/2647865352 shutdown_connections 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 --2- 172.21.15.1:0/2647865352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8710101420 0x7f871010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 --2- 172.21.15.1:0/2647865352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710100a80 0x7f8710100ee0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 --2- 172.21.15.1:0/2647865352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8710106a80 0x7f8710106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 -- 172.21.15.1:0/2647865352 >> 172.21.15.1:0/2647865352 conn(0x7f87100fc7a0 msgr2=0x7f87100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 -- 172.21.15.1:0/2647865352 shutdown_connections 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 -- 172.21.15.1:0/2647865352 wait complete. 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.734+0000 7f8714a37640 1 Processor -- start 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f8714a37640 1 -- start start 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f8714a37640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8710100a80 0x7f871019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f8714a37640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8710101420 0x7f871019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f8714a37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710106a80 0x7f871019f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f8714a37640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8710110fb0 con 0x7f8710106a80 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f8714a37640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8710110e30 con 0x7f8710101420 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f8714a37640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8710111130 con 0x7f8710100a80 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710106a80 0x7f871019f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710106a80 0x7f871019f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34376/0 (socket says 172.21.15.1:34376) 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 -- 172.21.15.1:0/2347082035 learned_addr learned my addr 172.21.15.1:0/2347082035 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870e59c640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8710100a80 0x7f871019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8710101420 0x7f871019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 -- 172.21.15.1:0/2347082035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8710100a80 msgr2=0x7f871019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8710100a80 0x7f871019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 -- 172.21.15.1:0/2347082035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8710101420 msgr2=0x7f871019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8710101420 0x7f871019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 -- 172.21.15.1:0/2347082035 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871019f6f0 con 0x7f8710106a80 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.735+0000 7f870ed9d640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710106a80 0x7f871019f010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f870800eaa0 tx=0x7f870800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.736+0000 7f86ff7fe640 1 -- 172.21.15.1:0/2347082035 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870800cdb0 con 0x7f8710106a80 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.736+0000 7f86ff7fe640 1 -- 172.21.15.1:0/2347082035 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8708004b20 con 0x7f8710106a80 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.736+0000 7f86ff7fe640 1 -- 172.21.15.1:0/2347082035 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708011760 con 0x7f8710106a80 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.736+0000 7f8714a37640 1 -- 172.21.15.1:0/2347082035 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871019f9e0 con 0x7f8710106a80 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.736+0000 7f8714a37640 1 -- 172.21.15.1:0/2347082035 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87101a72c0 con 0x7f8710106a80 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.738+0000 7f86ff7fe640 1 -- 172.21.15.1:0/2347082035 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f8708004cd0 con 0x7f8710106a80 2024-09-19T09:04:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.738+0000 7f8716e10740 1 Processor -- start 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f8716e10740 1 -- start start 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f8716e10740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7e9d0 0x562cc1e7edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f8716e10740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e89670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f8716e10740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e8bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f8716e10740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cc1de5090 con 0x562cc1e89bb0 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f8716e10740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562cc1d8ca70 con 0x562cc1e7f2f0 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f8716e10740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cc1de1050 con 0x562cc1e7e9d0 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e8bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e89670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e8bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34390/0 (socket says 172.21.15.1:34390) 2024-09-19T09:04:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870dd9b640 1 -- 172.21.15.1:0/1388927520 learned_addr learned my addr 172.21.15.1:0/1388927520 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f86ff7fe640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f86f80a32d0 0x7f86f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870dd9b640 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7e9d0 0x562cc1e7edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870ed9d640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f86f80a32d0 0x7f86f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870e59c640 1 -- 172.21.15.1:0/1388927520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7e9d0 msgr2=0x562cc1e7edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870e59c640 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7e9d0 0x562cc1e7edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870e59c640 1 -- 172.21.15.1:0/1388927520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 msgr2=0x562cc1e8bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870e59c640 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e8bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870e59c640 1 -- 172.21.15.1:0/1388927520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc1d99130 con 0x562cc1e7f2f0 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f870dd9b640 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7e9d0 0x562cc1e7edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.739+0000 7f86ff7fe640 1 -- 172.21.15.1:0/2347082035 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f87080cfc80 con 0x7f8710106a80 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.740+0000 7f870e59c640 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e89670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8700005fd0 tx=0x7f87000107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=869e44f9e70e33e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.740+0000 7f870ed9d640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f86f80a32d0 0x7f86f80a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8708098630 tx=0x7f870800cf50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.740+0000 7f86fcff9640 1 -- 172.21.15.1:0/1388927520 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870001c480 con 0x562cc1e7f2f0 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.740+0000 7f86fcff9640 1 -- 172.21.15.1:0/1388927520 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f870001cb20 con 0x562cc1e7f2f0 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.740+0000 7f86fcff9640 1 -- 172.21.15.1:0/1388927520 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700011c50 con 0x562cc1e7f2f0 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 -- 172.21.15.1:0/1388927520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 msgr2=0x562cc1e89670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e89670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8700005fd0 tx=0x7f87000107a0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 -- 172.21.15.1:0/1388927520 shutdown_connections 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e8bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e89670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 --2- 172.21.15.1:0/1388927520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7e9d0 0x562cc1e7edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 -- 172.21.15.1:0/1388927520 >> 172.21.15.1:0/1388927520 conn(0x562cc1e7af60 msgr2=0x562cc1e7b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 -- 172.21.15.1:0/1388927520 shutdown_connections 2024-09-19T09:04:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 -- 172.21.15.1:0/1388927520 wait complete. 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 -- start start 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.741+0000 7f8716e10740 1 Processor -- start 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f8716e10740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e7e9d0 0x562cc1e89390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f8716e10740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e866e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f8716e10740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e89bb0 0x562cc1e86c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f8716e10740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cc1e8c780 con 0x562cc1e7e9d0 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f8716e10740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562cc1d9ff20 con 0x562cc1e7f2f0 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f8716e10740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cc1e8c900 con 0x562cc1e89bb0 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f8716e10740 10 client.0 _ll_register_callbacks cb 0x562cc1d69030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e7e9d0 0x562cc1e89390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e7e9d0 0x562cc1e89390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34396/0 (socket says 172.21.15.1:34396) 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 -- 172.21.15.1:0/2122427871 learned_addr learned my addr 172.21.15.1:0/2122427871 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870e59c640 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e866e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e89bb0 0x562cc1e86c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 -- 172.21.15.1:0/2122427871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e89bb0 msgr2=0x562cc1e86c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e89bb0 0x562cc1e86c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 -- 172.21.15.1:0/2122427871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 msgr2=0x562cc1e866e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e866e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 -- 172.21.15.1:0/2122427871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc1b562b0 con 0x562cc1e7e9d0 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e7e9d0 0x562cc1e89390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8704009230 tx=0x7f870402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e9e2c91cac3361 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f86f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2122427871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704041020 con 0x562cc1e7e9d0 2024-09-19T09:04:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f8716e10740 1 -- 172.21.15.1:0/2122427871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f870001cb20 con 0x562cc1e7e9d0 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2122427871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8704005500 con 0x562cc1e7e9d0 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.742+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2122427871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8704035040 con 0x562cc1e7e9d0 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f8716e10740 10 client.15327 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f8716e10740 1 -- 172.21.15.1:0/2122427871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562cc1e98030 con 0x562cc1e7e9d0 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2122427871 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f870001cb20 con 0x562cc1e7e9d0 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2122427871 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8704031b60 con 0x562cc1e7e9d0 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f8716e10740 10 client.15327 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f8716e10740 10 client.15327 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f8716e10740 20 client.15327 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f8716e10740 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x562cc1e9a5f0 0x562cc1e9ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f8716e10740 4 client.15327 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f8716e10740 1 -- 172.21.15.1:0/2122427871 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cc1df2600 con 0x562cc1e9a5f0 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.743+0000 7f870e59c640 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x562cc1e9a5f0 0x562cc1e9ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.744+0000 7f870e59c640 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x562cc1e9a5f0 0x562cc1e9ba60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67d099a3c0ecc67e server_cookie=37812e1ba5f06454 in_seq=0 out_seq=0 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.744+0000 7f86f5ffb640 10 client.15327 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2122427871 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cc1df2600 con 0x562cc1e9a5f0 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f86f5ffb640 10 client.15327 handle_command_reply: tid=0 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 client.15327 shutdown 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 -- 172.21.15.1:0/2122427871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e7e9d0 msgr2=0x562cc1e89390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e7e9d0 0x562cc1e89390 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8704009230 tx=0x7f870402a420 comp rx=0 tx=0).stop 2024-09-19T09:04:08.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 -- 172.21.15.1:0/2122427871 shutdown_connections 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x562cc1e9a5f0 0x562cc1e9ba60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e89bb0 0x562cc1e86c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7f2f0 0x562cc1e866e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f86f5ffb640 0 client.15327 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 --2- 172.21.15.1:0/2122427871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e7e9d0 0x562cc1e89390 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 -- 172.21.15.1:0/2122427871 >> 172.21.15.1:0/2122427871 conn(0x562cc1e7af60 msgr2=0x562cc1e80c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 -- 172.21.15.1:0/2122427871 shutdown_connections 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 1 -- 172.21.15.1:0/2122427871 wait complete. 2024-09-19T09:04:08.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.745+0000 7f8716e10740 20 client.15327 trim_cache size 0 max 16384 2024-09-19T09:04:08.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f8716e10740 1 Processor -- start 2024-09-19T09:04:08.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f8716e10740 1 -- start start 2024-09-19T09:04:08.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f8716e10740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 0x562cc1e9ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f8716e10740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1e85fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f8716e10740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e79ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f8716e10740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cc1e99da0 con 0x562cc1e89bb0 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f8716e10740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562cc1e9a470 con 0x562cc1e7e9d0 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f8716e10740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cc1e9ab40 con 0x562cc1e7f2f0 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e79ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e79ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34402/0 (socket says 172.21.15.1:34402) 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f870dd9b640 1 -- 172.21.15.1:0/2128188240 learned_addr learned my addr 172.21.15.1:0/2128188240 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f870e59c640 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1e85fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 0x562cc1e9ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.765+0000 7f870e59c640 1 -- 172.21.15.1:0/2128188240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 msgr2=0x562cc1e9ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f870e59c640 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 0x562cc1e9ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f870e59c640 1 -- 172.21.15.1:0/2128188240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 msgr2=0x562cc1e79ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f870e59c640 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e79ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f870e59c640 1 -- 172.21.15.1:0/2128188240 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc1e89700 con 0x562cc1e7f2f0 2024-09-19T09:04:08.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e79ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:08.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f870e59c640 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1e85fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8700010ca0 tx=0x7f87000117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=566e968292fda87a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f86f7fff640 1 -- 172.21.15.1:0/2128188240 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870002c070 con 0x562cc1e7f2f0 2024-09-19T09:04:08.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f86f7fff640 1 -- 172.21.15.1:0/2128188240 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8700011d20 con 0x562cc1e7f2f0 2024-09-19T09:04:08.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.766+0000 7f86f7fff640 1 -- 172.21.15.1:0/2128188240 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870001c480 con 0x562cc1e7f2f0 2024-09-19T09:04:08.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 -- 172.21.15.1:0/2128188240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 msgr2=0x562cc1e85fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1e85fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8700010ca0 tx=0x7f87000117b0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 -- 172.21.15.1:0/2128188240 shutdown_connections 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e79ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1e85fc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 --2- 172.21.15.1:0/2128188240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 0x562cc1e9ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 -- 172.21.15.1:0/2128188240 >> 172.21.15.1:0/2128188240 conn(0x562cc1e7af60 msgr2=0x562cc1e797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 -- 172.21.15.1:0/2128188240 shutdown_connections 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 -- 172.21.15.1:0/2128188240 wait complete. 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 -- start start 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.767+0000 7f8716e10740 1 Processor -- start 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f8716e10740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 0x562cc1ea40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f8716e10740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1ea4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f8716e10740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e9f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f8716e10740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cc1e9b8e0 con 0x562cc1e89bb0 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f8716e10740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562cc1e9b210 con 0x562cc1e7e9d0 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f8716e10740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cc1e9bfb0 con 0x562cc1e7f2f0 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f8716e10740 10 client.0 _ll_register_callbacks cb 0x7f8704009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e9f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e9f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34406/0 (socket says 172.21.15.1:34406) 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 -- 172.21.15.1:0/2689362706 learned_addr learned my addr 172.21.15.1:0/2689362706 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870e59c640 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1ea4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 0x562cc1ea40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 -- 172.21.15.1:0/2689362706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 msgr2=0x562cc1ea4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1ea4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 -- 172.21.15.1:0/2689362706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 msgr2=0x562cc1ea40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 0x562cc1ea40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 -- 172.21.15.1:0/2689362706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc1e9fe20 con 0x562cc1e89bb0 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f870dd9b640 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e9f5f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f870402aa10 tx=0x7f8704031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b8f7da2e4e35a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.768+0000 7f86f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2689362706 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704041040 con 0x562cc1e89bb0 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2689362706 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8704003b40 con 0x562cc1e89bb0 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 1 -- 172.21.15.1:0/2689362706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8700011d20 con 0x562cc1e89bb0 2024-09-19T09:04:08.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2689362706 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8704003d40 con 0x562cc1e89bb0 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 10 client.15333 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 1 -- 172.21.15.1:0/2689362706 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562cc1f04960 con 0x562cc1e89bb0 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2689362706 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8704004bc0 con 0x562cc1e89bb0 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2689362706 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f870403d6c0 con 0x562cc1e89bb0 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 10 client.15333 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 10 client.15333 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 20 client.15333 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x562cc1f09400 0x562cc1f08110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 4 client.15333 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.769+0000 7f8716e10740 1 -- 172.21.15.1:0/2689362706 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "status"}) -- 0x7f8700011d20 con 0x562cc1f09400 2024-09-19T09:04:08.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.770+0000 7f870e59c640 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x562cc1f09400 0x562cc1f08110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.770+0000 7f86f5ffb640 10 client.15333 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.770+0000 7f870e59c640 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x562cc1f09400 0x562cc1f08110 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a9a3e56fe7ee3dd server_cookie=d8271ac7fe058405 in_seq=0 out_seq=0 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f86f5ffb640 1 -- 172.21.15.1:0/2689362706 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x7f8700011d20 con 0x562cc1f09400 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f86f5ffb640 10 client.15333 handle_command_reply: tid=0 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 client.15333 shutdown 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 -- 172.21.15.1:0/2689362706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 msgr2=0x562cc1e9f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e9f5f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f870402aa10 tx=0x7f8704031400 comp rx=0 tx=0).stop 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 -- 172.21.15.1:0/2689362706 shutdown_connections 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x562cc1f09400 0x562cc1f08110 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc1e89bb0 0x562cc1e9f5f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc1e7f2f0 0x562cc1ea4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 --2- 172.21.15.1:0/2689362706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc1e7e9d0 0x562cc1ea40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f86f5ffb640 0 client.15333 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:04:08.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 -- 172.21.15.1:0/2689362706 >> 172.21.15.1:0/2689362706 conn(0x562cc1e7af60 msgr2=0x562cc1e885a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 -- 172.21.15.1:0/2689362706 shutdown_connections 2024-09-19T09:04:08.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 1 -- 172.21.15.1:0/2689362706 wait complete. 2024-09-19T09:04:08.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.771+0000 7f8716e10740 20 client.15333 trim_cache size 0 max 16384 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 2, 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24482, 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 118.27879273400001, 2024-09-19T09:04:08.780 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 24, 2024-09-19T09:04:08.781 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:04:08.781 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:04:08.781 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 147.349410304 2024-09-19T09:04:08.781 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 -- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f86f80a32d0 msgr2=0x7f86f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f86f80a32d0 0x7f86f80a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8708098630 tx=0x7f870800cf50 comp rx=0 tx=0).stop 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 -- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710106a80 msgr2=0x7f871019f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710106a80 0x7f871019f010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f870800eaa0 tx=0x7f870800ef60 comp rx=0 tx=0).stop 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 -- 172.21.15.1:0/2347082035 shutdown_connections 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8710106a80 0x7f871019f010 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8710101420 0x7f871019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f86f80a32d0 0x7f86f80a5790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 --2- 172.21.15.1:0/2347082035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8710100a80 0x7f871019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 -- 172.21.15.1:0/2347082035 >> 172.21.15.1:0/2347082035 conn(0x7f87100fc7a0 msgr2=0x7f871006a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 -- 172.21.15.1:0/2347082035 shutdown_connections 2024-09-19T09:04:08.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:08.772+0000 7f8714a37640 1 -- 172.21.15.1:0/2347082035 wait complete. 2024-09-19T09:04:08.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:08 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:04:08.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:08 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:08 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:04:08.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:08.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:08 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:09.476 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:04:09.771 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:09.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:09 smithi001 ceph-mon[30939]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:04:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:09 smithi022 ceph-mon[35107]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:04:10.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:09 smithi064 ceph-mon[35179]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:04:10.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 -- 172.21.15.1:0/555070505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8100e20 msgr2=0x7f01f8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 --2- 172.21.15.1:0/555070505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8100e20 0x7f01f8101200 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009900 tx=0x7f01f402a480 comp rx=0 tx=0).stop 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 -- 172.21.15.1:0/555070505 shutdown_connections 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 --2- 172.21.15.1:0/555070505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f8102ef0 0x7f01f810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 --2- 172.21.15.1:0/555070505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01f8102570 0x7f01f81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 --2- 172.21.15.1:0/555070505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8100e20 0x7f01f8101200 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 -- 172.21.15.1:0/555070505 >> 172.21.15.1:0/555070505 conn(0x7f01f80fc7d0 msgr2=0x7f01f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 -- 172.21.15.1:0/555070505 shutdown_connections 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.248+0000 7f01ff376640 1 -- 172.21.15.1:0/555070505 wait complete. 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01ff376640 1 Processor -- start 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01ff376640 1 -- start start 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01ff376640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f8100e20 0x7f01f81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01ff376640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01f8102570 0x7f01f8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01ff376640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8102ef0 0x7f01f819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01ff376640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81110a0 con 0x7f01f8102ef0 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01ff376640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01f8110f20 con 0x7f01f8100e20 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01ff376640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f01f8111220 con 0x7f01f8102570 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01fd913640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8102ef0 0x7f01f819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01fd913640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8102ef0 0x7f01f819ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34412/0 (socket says 172.21.15.1:34412) 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01fd913640 1 -- 172.21.15.1:0/3699947957 learned_addr learned my addr 172.21.15.1:0/3699947957 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.249+0000 7f01fd112640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f8100e20 0x7f01f81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01fc911640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01f8102570 0x7f01f8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01fd913640 1 -- 172.21.15.1:0/3699947957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01f8102570 msgr2=0x7f01f8198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01fd913640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01f8102570 0x7f01f8198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01fd913640 1 -- 172.21.15.1:0/3699947957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f8100e20 msgr2=0x7f01f81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01fd913640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f8100e20 0x7f01f81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01fd913640 1 -- 172.21.15.1:0/3699947957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f819d590 con 0x7f01f8102ef0 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01fd913640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8102ef0 0x7f01f819ceb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009fd0 tx=0x7f01f000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01ee7fc640 1 -- 172.21.15.1:0/3699947957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0017070 con 0x7f01f8102ef0 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01ee7fc640 1 -- 172.21.15.1:0/3699947957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01f0004020 con 0x7f01f8102ef0 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01ee7fc640 1 -- 172.21.15.1:0/3699947957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f00106c0 con 0x7f01f8102ef0 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01ff376640 1 -- 172.21.15.1:0/3699947957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f819d880 con 0x7f01f8102ef0 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.250+0000 7f01ff376640 1 -- 172.21.15.1:0/3699947957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f81a5160 con 0x7f01f8102ef0 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.253+0000 7f020174f740 1 Processor -- start 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.254+0000 7f01ee7fc640 1 -- 172.21.15.1:0/3699947957 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f01f00041d0 con 0x7f01f8102ef0 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.254+0000 7f020174f740 1 -- start start 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f020174f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fbf0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f020174f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbffa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f020174f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fc023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f020174f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555e9fb57090 con 0x555e9fbf11d0 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f020174f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555e9fafea70 con 0x555e9fbfffc0 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f020174f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555e9fb53050 con 0x555e9fbf08b0 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f01fd112640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f01fc911640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fc023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f01fd112640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbffa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34416/0 (socket says 172.21.15.1:34416) 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f01fd112640 1 -- 172.21.15.1:0/3631385750 learned_addr learned my addr 172.21.15.1:0/3631385750 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f01fc911640 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fbf0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.255+0000 7f01ee7fc640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01e40a32d0 0x7f01e40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01fd913640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01e40a32d0 0x7f01e40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01fc911640 1 -- 172.21.15.1:0/3631385750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 msgr2=0x555e9fbf0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01fc911640 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fbf0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01fc911640 1 -- 172.21.15.1:0/3631385750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 msgr2=0x555e9fbffa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:10.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01fc911640 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbffa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01fc911640 1 -- 172.21.15.1:0/3631385750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9fb0b130 con 0x555e9fbfffc0 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01fd112640 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01ee7fc640 1 -- 172.21.15.1:0/3699947957 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f01f00cf7f0 con 0x7f01f8102ef0 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01fc911640 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fc023b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01f80fee70 tx=0x7f01e800e410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4311f0199147723 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01e37fe640 1 -- 172.21.15.1:0/3631385750 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8013e40 con 0x555e9fbfffc0 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01e37fe640 1 -- 172.21.15.1:0/3631385750 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e800b8a0 con 0x555e9fbfffc0 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.256+0000 7f01e37fe640 1 -- 172.21.15.1:0/3631385750 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8005310 con 0x555e9fbfffc0 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f01fd913640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01e40a32d0 0x7f01e40a5790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f01f0096730 tx=0x7f01f0097890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 -- 172.21.15.1:0/3631385750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 msgr2=0x555e9fc023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fc023b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01f80fee70 tx=0x7f01e800e410 comp rx=0 tx=0).stop 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 -- 172.21.15.1:0/3631385750 shutdown_connections 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fc023b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 --2- 172.21.15.1:0/3631385750 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fbf0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 -- 172.21.15.1:0/3631385750 >> 172.21.15.1:0/3631385750 conn(0x555e9fbecf60 msgr2=0x555e9fbed340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 -- 172.21.15.1:0/3631385750 shutdown_connections 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 -- 172.21.15.1:0/3631385750 wait complete. 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 -- start start 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.257+0000 7f020174f740 1 Processor -- start 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f020174f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fbff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f020174f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbfcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f020174f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fbfd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f020174f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555e9fc02b90 con 0x555e9fbf11d0 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f020174f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555e9fb11f20 con 0x555e9fbfffc0 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f020174f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555e9fc02d10 con 0x555e9fbf08b0 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f020174f740 10 client.0 _ll_register_callbacks cb 0x555e9fadb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:10.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fd112640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbfcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fd112640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbfcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34422/0 (socket says 172.21.15.1:34422) 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fd112640 1 -- 172.21.15.1:0/1236818546 learned_addr learned my addr 172.21.15.1:0/1236818546 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fc911640 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fbff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fc911640 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fbfd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fd112640 1 -- 172.21.15.1:0/1236818546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 msgr2=0x555e9fbff8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fd112640 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fbff8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fd112640 1 -- 172.21.15.1:0/1236818546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 msgr2=0x555e9fbfd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fd112640 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fbfd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fd112640 1 -- 172.21.15.1:0/1236818546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e9f8c82b0 con 0x555e9fbf11d0 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.258+0000 7f01fc911640 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fbfd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f01fd112640 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbfcc20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005940 tx=0x7f01f4031950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7394d62c92dd758 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f01e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1236818546 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4035040 con 0x555e9fbf11d0 2024-09-19T09:04:10.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 1 -- 172.21.15.1:0/1236818546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e800b8a0 con 0x555e9fbf11d0 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1236818546 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f01f4005040 con 0x555e9fbf11d0 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1236818546 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f01f404c070 con 0x555e9fbf11d0 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 10 client.15345 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 1 -- 172.21.15.1:0/1236818546 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555e9fc0e550 con 0x555e9fbf11d0 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1236818546 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e800b8a0 con 0x555e9fbf11d0 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1236818546 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f01f40035f0 con 0x555e9fbf11d0 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 10 client.15345 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 10 client.15345 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 20 client.15345 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:10.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x555e9fc10b40 0x555e9fc11fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 4 client.15345 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.259+0000 7f020174f740 1 -- 172.21.15.1:0/1236818546 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e9fb64600 con 0x555e9fc10b40 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.260+0000 7f01fc911640 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x555e9fc10b40 0x555e9fc11fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.260+0000 7f01fc911640 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x555e9fc10b40 0x555e9fc11fb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aed2a970559e182 server_cookie=e13525864b9423e0 in_seq=0 out_seq=0 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.260+0000 7f01e0ff9640 10 client.15345 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1236818546 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e9fb64600 con 0x555e9fc10b40 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f01e0ff9640 10 client.15345 handle_command_reply: tid=0 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 client.15345 shutdown 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 -- 172.21.15.1:0/1236818546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 msgr2=0x555e9fbfcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbfcc20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005940 tx=0x7f01f4031950 comp rx=0 tx=0).stop 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 -- 172.21.15.1:0/1236818546 shutdown_connections 2024-09-19T09:04:10.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x555e9fc10b40 0x555e9fc11fb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbfffc0 0x555e9fbfd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf11d0 0x555e9fbfcc20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 --2- 172.21.15.1:0/1236818546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fbff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 -- 172.21.15.1:0/1236818546 >> 172.21.15.1:0/1236818546 conn(0x555e9fbecf60 msgr2=0x555e9fbf2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f01e0ff9640 0 client.15345 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:04:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 -- 172.21.15.1:0/1236818546 shutdown_connections 2024-09-19T09:04:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 1 -- 172.21.15.1:0/1236818546 wait complete. 2024-09-19T09:04:10.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.261+0000 7f020174f740 20 client.15345 trim_cache size 0 max 16384 2024-09-19T09:04:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.279+0000 7f020174f740 1 Processor -- start 2024-09-19T09:04:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.279+0000 7f020174f740 1 -- start start 2024-09-19T09:04:10.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f020174f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf08b0 0x555e9fc11fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f020174f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fbed340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f020174f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbfffc0 0x555e9fbf9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f020174f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555e9fc102f0 con 0x555e9fbf08b0 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f020174f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555e9fc109c0 con 0x555e9fbf11d0 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f020174f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555e9fc11090 con 0x555e9fbfffc0 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf08b0 0x555e9fc11fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf08b0 0x555e9fc11fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34430/0 (socket says 172.21.15.1:34430) 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 -- 172.21.15.1:0/4009398068 learned_addr learned my addr 172.21.15.1:0/4009398068 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fd112640 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fbed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbfffc0 0x555e9fbf9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 -- 172.21.15.1:0/4009398068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbfffc0 msgr2=0x555e9fbf9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbfffc0 0x555e9fbf9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 -- 172.21.15.1:0/4009398068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 msgr2=0x555e9fbed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fbed340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fc911640 1 -- 172.21.15.1:0/4009398068 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9fbee0d0 con 0x555e9fbf08b0 2024-09-19T09:04:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.280+0000 7f01fd112640 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fbed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:10.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.281+0000 7f01fc911640 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf08b0 0x555e9fc11fb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005d70 tx=0x7f01e8015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137fc077826b1eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:10.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.281+0000 7f01e2ffd640 1 -- 172.21.15.1:0/4009398068 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8013150 con 0x555e9fbf08b0 2024-09-19T09:04:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.281+0000 7f01e2ffd640 1 -- 172.21.15.1:0/4009398068 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e800bda0 con 0x555e9fbf08b0 2024-09-19T09:04:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.281+0000 7f01e2ffd640 1 -- 172.21.15.1:0/4009398068 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e802ca80 con 0x555e9fbf08b0 2024-09-19T09:04:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.281+0000 7f020174f740 1 -- 172.21.15.1:0/4009398068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf08b0 msgr2=0x555e9fc11fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.281+0000 7f020174f740 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf08b0 0x555e9fc11fb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005d70 tx=0x7f01e8015040 comp rx=0 tx=0).stop 2024-09-19T09:04:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 -- 172.21.15.1:0/4009398068 shutdown_connections 2024-09-19T09:04:10.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbfffc0 0x555e9fbf9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fbed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 --2- 172.21.15.1:0/4009398068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbf08b0 0x555e9fc11fb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 -- 172.21.15.1:0/4009398068 >> 172.21.15.1:0/4009398068 conn(0x555e9fbecf60 msgr2=0x555e9fbfbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 -- 172.21.15.1:0/4009398068 shutdown_connections 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 -- 172.21.15.1:0/4009398068 wait complete. 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 -- start start 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.282+0000 7f020174f740 1 Processor -- start 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f020174f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fc13750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f020174f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fc13c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f020174f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbfffc0 0x555e9fc79240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f020174f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555e9fc11e30 con 0x555e9fbfffc0 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f020174f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555e9fc11760 con 0x555e9fbf11d0 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f020174f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555e9fc12500 con 0x555e9fbf08b0 2024-09-19T09:04:10.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f020174f740 10 client.0 _ll_register_callbacks cb 0x7f01f4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fc13750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fc13750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:58650/0 (socket says 172.21.15.1:58650) 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 -- 172.21.15.1:0/1481863548 learned_addr learned my addr 172.21.15.1:0/1481863548 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbfffc0 0x555e9fc79240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fd112640 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fc13c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 -- 172.21.15.1:0/1481863548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 msgr2=0x555e9fc13750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fc13750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 -- 172.21.15.1:0/1481863548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 msgr2=0x555e9fc13c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fc13c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 -- 172.21.15.1:0/1481863548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e9fc79780 con 0x555e9fbfffc0 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01fc911640 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbfffc0 0x555e9fc79240 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f01e800ea50 tx=0x7f01e8005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9131aaa3e2af9fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.283+0000 7f01e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:10.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1481863548 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e802c410 con 0x555e9fbfffc0 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1481863548 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f01e802c5b0 con 0x555e9fbfffc0 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 1 -- 172.21.15.1:0/1481863548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e800bda0 con 0x555e9fbfffc0 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1481863548 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f01e802c7b0 con 0x555e9fbfffc0 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 10 client.15351 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 1 -- 172.21.15.1:0/1481863548 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555e9fc7a940 con 0x555e9fbfffc0 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1481863548 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e800bda0 con 0x555e9fbfffc0 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1481863548 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f01e8033020 con 0x555e9fbfffc0 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 10 client.15351 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 10 client.15351 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 20 client.15351 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x555e9fc7ee00 0x555e9fc7db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 4 client.15351 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:04:10.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.284+0000 7f020174f740 1 -- 172.21.15.1:0/1481863548 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "status"}) -- 0x555e9fb5eb10 con 0x555e9fc7ee00 2024-09-19T09:04:10.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f01fd112640 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x555e9fc7ee00 0x555e9fc7db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f01e0ff9640 10 client.15351 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f01fd112640 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x555e9fc7ee00 0x555e9fc7db10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=65443ccfb0d97299 server_cookie=2c2a13814c2556e3 in_seq=0 out_seq=0 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f01e0ff9640 1 -- 172.21.15.1:0/1481863548 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555e9fb5eb10 con 0x555e9fc7ee00 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f01e0ff9640 10 client.15351 handle_command_reply: tid=0 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 client.15351 shutdown 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 -- 172.21.15.1:0/1481863548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbfffc0 msgr2=0x555e9fc79240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbfffc0 0x555e9fc79240 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f01e800ea50 tx=0x7f01e8005e20 comp rx=0 tx=0).stop 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 -- 172.21.15.1:0/1481863548 shutdown_connections 2024-09-19T09:04:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x555e9fc7ee00 0x555e9fc7db10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555e9fbfffc0 0x555e9fc79240 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e9fbf11d0 0x555e9fc13c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 --2- 172.21.15.1:0/1481863548 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555e9fbf08b0 0x555e9fc13750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f020174f740 1 -- 172.21.15.1:0/1481863548 >> 172.21.15.1:0/1481863548 conn(0x555e9fbecf60 msgr2=0x555e9fbf7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.285+0000 7f01e0ff9640 0 client.15351 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f020174f740 1 -- 172.21.15.1:0/1481863548 shutdown_connections 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f020174f740 1 -- 172.21.15.1:0/1481863548 wait complete. 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f020174f740 20 client.15351 trim_cache size 0 max 16384 2024-09-19T09:04:10.291 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 1, 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24493, 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 120.799131272, 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 24, 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 146.31120778799999 2024-09-19T09:04:10.292 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:04:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 -- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01e40a32d0 msgr2=0x7f01e40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01e40a32d0 0x7f01e40a5790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f01f0096730 tx=0x7f01f0097890 comp rx=0 tx=0).stop 2024-09-19T09:04:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 -- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8102ef0 msgr2=0x7f01f819ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8102ef0 0x7f01f819ceb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009fd0 tx=0x7f01f000b260 comp rx=0 tx=0).stop 2024-09-19T09:04:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 -- 172.21.15.1:0/3699947957 shutdown_connections 2024-09-19T09:04:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f01f8102ef0 0x7f01f819ceb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f01e40a32d0 0x7f01e40a5790 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f01f8102570 0x7f01f8198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 --2- 172.21.15.1:0/3699947957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01f8100e20 0x7f01f81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.286+0000 7f01ff376640 1 -- 172.21.15.1:0/3699947957 >> 172.21.15.1:0/3699947957 conn(0x7f01f80fc7d0 msgr2=0x7f01f8069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.287+0000 7f01ff376640 1 -- 172.21.15.1:0/3699947957 shutdown_connections 2024-09-19T09:04:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:10.287+0000 7f01ff376640 1 -- 172.21.15.1:0/3699947957 wait complete. 2024-09-19T09:04:10.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:10.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:10.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:10.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:10.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:10.902 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:04:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:11.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:11.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:11.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:11.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:11.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:04:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.672+0000 7f71818ac640 1 -- 172.21.15.1:0/1807746922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c102790 msgr2=0x7f717c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.672+0000 7f71818ac640 1 --2- 172.21.15.1:0/1807746922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c102790 0x7f717c1067e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7164009900 tx=0x7f716402a410 comp rx=0 tx=0).stop 2024-09-19T09:04:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 -- 172.21.15.1:0/1807746922 shutdown_connections 2024-09-19T09:04:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 --2- 172.21.15.1:0/1807746922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f717c106f10 0x7f717c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 --2- 172.21.15.1:0/1807746922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c102790 0x7f717c1067e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 --2- 172.21.15.1:0/1807746922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717c101de0 0x7f717c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 -- 172.21.15.1:0/1807746922 >> 172.21.15.1:0/1807746922 conn(0x7f717c0fd8c0 msgr2=0x7f717c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 -- 172.21.15.1:0/1807746922 shutdown_connections 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 -- 172.21.15.1:0/1807746922 wait complete. 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 Processor -- start 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.673+0000 7f71818ac640 1 -- start start 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f71818ac640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f717c101de0 0x7f717c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f71818ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717c102790 0x7f717c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f71818ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c106f10 0x7f717c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f71818ac640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f717c112090 con 0x7f717c106f10 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f71818ac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f717c111f10 con 0x7f717c102790 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f71818ac640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f717c112210 con 0x7f717c101de0 2024-09-19T09:04:11.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c106f10 0x7f717c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c106f10 0x7f717c19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34448/0 (socket says 172.21.15.1:34448) 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 -- 172.21.15.1:0/1860612238 learned_addr learned my addr 172.21.15.1:0/1860612238 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717affd640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f717c101de0 0x7f717c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717a7fc640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717c102790 0x7f717c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 -- 172.21.15.1:0/1860612238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f717c101de0 msgr2=0x7f717c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f717c101de0 0x7f717c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 -- 172.21.15.1:0/1860612238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717c102790 msgr2=0x7f717c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717c102790 0x7f717c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 -- 172.21.15.1:0/1860612238 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c19d4c0 con 0x7f717c106f10 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.674+0000 7f717b7fe640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c106f10 0x7f717c19cde0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f716c00d750 tx=0x7f716c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.675+0000 7f71808aa640 1 -- 172.21.15.1:0/1860612238 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c017070 con 0x7f717c106f10 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.675+0000 7f71818ac640 1 -- 172.21.15.1:0/1860612238 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c19d7b0 con 0x7f717c106f10 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.675+0000 7f71808aa640 1 -- 172.21.15.1:0/1860612238 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f716c005520 con 0x7f717c106f10 2024-09-19T09:04:11.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.675+0000 7f71808aa640 1 -- 172.21.15.1:0/1860612238 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c004e00 con 0x7f717c106f10 2024-09-19T09:04:11.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.675+0000 7f71818ac640 1 -- 172.21.15.1:0/1860612238 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c1a5090 con 0x7f717c106f10 2024-09-19T09:04:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.677+0000 7f71808aa640 1 -- 172.21.15.1:0/1860612238 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f716c004fa0 con 0x7f717c106f10 2024-09-19T09:04:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.677+0000 7f7183c85740 1 Processor -- start 2024-09-19T09:04:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.677+0000 7f7183c85740 1 -- start start 2024-09-19T09:04:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f7183c85740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7f99cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f71808aa640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71680a32d0 0x7f71680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f7183c85740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f7183c85740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7fa8fc0 0x5586c7fab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f7183c85740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5586c7f00090 con 0x5586c7f9a1f0 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f7183c85740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586c7ea7a70 con 0x5586c7f998d0 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f7183c85740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5586c7efc050 con 0x5586c7fa8fc0 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717affd640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71680a32d0 0x7f71680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7fa8fc0 0x5586c7fab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34462/0 (socket says 172.21.15.1:34462) 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717a7fc640 1 -- 172.21.15.1:0/3997535921 learned_addr learned my addr 172.21.15.1:0/3997535921 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f71808aa640 1 -- 172.21.15.1:0/1860612238 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f716c0cf490 con 0x7f717c106f10 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717a7fc640 1 --2- 172.21.15.1:0/3997535921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7f99cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717b7fe640 1 -- 172.21.15.1:0/3997535921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 msgr2=0x5586c7f99cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717b7fe640 1 --2- 172.21.15.1:0/3997535921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7f99cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717b7fe640 1 -- 172.21.15.1:0/3997535921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7f9a1f0 msgr2=0x5586c7fa8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717b7fe640 1 --2- 172.21.15.1:0/3997535921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.678+0000 7f717b7fe640 1 -- 172.21.15.1:0/3997535921 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c7eb4130 con 0x5586c7fa8fc0 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.679+0000 7f717affd640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71680a32d0 0x7f71680a5790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7174005fd0 tx=0x7f7174009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.679+0000 7f717b7fe640 1 --2- 172.21.15.1:0/3997535921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7fa8fc0 0x5586c7fab3b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ccdc0 tx=0x7f716c09b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19e43f7248724acf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.679+0000 7f7171ffb640 1 -- 172.21.15.1:0/3997535921 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c020030 con 0x5586c7fa8fc0 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.679+0000 7f7171ffb640 1 -- 172.21.15.1:0/3997535921 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f716c0046c0 con 0x5586c7fa8fc0 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.679+0000 7f7171ffb640 1 -- 172.21.15.1:0/3997535921 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c097f40 con 0x5586c7fa8fc0 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 -- 172.21.15.1:0/3997535921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7fa8fc0 msgr2=0x5586c7fab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 --2- 172.21.15.1:0/3997535921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7fa8fc0 0x5586c7fab3b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ccdc0 tx=0x7f716c09b7a0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 -- 172.21.15.1:0/3997535921 shutdown_connections 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 --2- 172.21.15.1:0/3997535921 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7fa8fc0 0x5586c7fab3b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 --2- 172.21.15.1:0/3997535921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 --2- 172.21.15.1:0/3997535921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7f99cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 -- 172.21.15.1:0/3997535921 >> 172.21.15.1:0/3997535921 conn(0x5586c7f95f60 msgr2=0x5586c7f96340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 -- 172.21.15.1:0/3997535921 shutdown_connections 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 -- 172.21.15.1:0/3997535921 wait complete. 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 -- start start 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.680+0000 7f7183c85740 1 Processor -- start 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f7183c85740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fa8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f7183c85740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f7183c85740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fa6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f7183c85740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5586c7fabbf0 con 0x5586c7fa8fc0 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f7183c85740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586c7ebaf20 con 0x5586c7f998d0 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f7183c85740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5586c7fabd70 con 0x5586c7f9a1f0 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f7183c85740 10 client.0 _ll_register_callbacks cb 0x5586c7e84030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:11.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fa6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717a7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fa6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34466/0 (socket says 172.21.15.1:34466) 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 -- 172.21.15.1:0/562136820 learned_addr learned my addr 172.21.15.1:0/562136820 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717affd640 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fa8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 -- 172.21.15.1:0/562136820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 msgr2=0x5586c7fa5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 -- 172.21.15.1:0/562136820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 msgr2=0x5586c7fa8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fa8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 -- 172.21.15.1:0/562136820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c7c712b0 con 0x5586c7fa8fc0 2024-09-19T09:04:11.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717a7fc640 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f717b7fe640 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fa6210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f716c009610 tx=0x7f716c0b4d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb6d0aa0da108f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.681+0000 7f715affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f715affd640 1 -- 172.21.15.1:0/562136820 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c020050 con 0x5586c7fa8fc0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f715affd640 1 -- 172.21.15.1:0/562136820 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f716c0cd010 con 0x5586c7fa8fc0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 1 -- 172.21.15.1:0/562136820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5586c7f0d600 con 0x5586c7fa8fc0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f715affd640 1 -- 172.21.15.1:0/562136820 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f716c09b8d0 con 0x5586c7fa8fc0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 10 client.15363 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 1 -- 172.21.15.1:0/562136820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586c7fb7620 con 0x5586c7fa8fc0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f715affd640 1 -- 172.21.15.1:0/562136820 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x5586c7f0d600 con 0x5586c7fa8fc0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f715affd640 1 -- 172.21.15.1:0/562136820 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f716c09ae40 con 0x5586c7fa8fc0 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 10 client.15363 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 10 client.15363 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:04:11.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 20 client.15363 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5586c7fb8970 0x5586c7fbaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 4 client.15363 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f7183c85740 1 -- 172.21.15.1:0/562136820 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586c7f07b10 con 0x5586c7fb8970 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.682+0000 7f717affd640 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5586c7fb8970 0x5586c7fbaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.683+0000 7f715affd640 10 client.15363 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.683+0000 7f717affd640 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5586c7fb8970 0x5586c7fbaad0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=591a2463a22f12e7 server_cookie=e0c8ab2c299cb76d in_seq=0 out_seq=0 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f715affd640 1 -- 172.21.15.1:0/562136820 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586c7f07b10 con 0x5586c7fb8970 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f715affd640 10 client.15363 handle_command_reply: tid=0 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 client.15363 shutdown 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 -- 172.21.15.1:0/562136820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 msgr2=0x5586c7fa6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fa6210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f716c009610 tx=0x7f716c0b4d30 comp rx=0 tx=0).stop 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 -- 172.21.15.1:0/562136820 shutdown_connections 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5586c7fb8970 0x5586c7fbaad0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fa6210 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fa5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 --2- 172.21.15.1:0/562136820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fa8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 -- 172.21.15.1:0/562136820 >> 172.21.15.1:0/562136820 conn(0x5586c7f95f60 msgr2=0x5586c7f9bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f715affd640 0 client.15363 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 -- 172.21.15.1:0/562136820 shutdown_connections 2024-09-19T09:04:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 1 -- 172.21.15.1:0/562136820 wait complete. 2024-09-19T09:04:11.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.684+0000 7f7183c85740 20 client.15363 trim_cache size 0 max 16384 2024-09-19T09:04:11.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.702+0000 7f7183c85740 1 Processor -- start 2024-09-19T09:04:11.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.702+0000 7f7183c85740 1 -- start start 2024-09-19T09:04:11.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.702+0000 7f7183c85740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fbaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.702+0000 7f7183c85740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fb9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.702+0000 7f7183c85740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fb8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.702+0000 7f7183c85740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5586c7fb8e10 con 0x5586c7fa8fc0 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.702+0000 7f7183c85740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586c7fb94e0 con 0x5586c7f998d0 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.702+0000 7f7183c85740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5586c7fb9bb0 con 0x5586c7f9a1f0 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fb8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fb8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34480/0 (socket says 172.21.15.1:34480) 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 -- 172.21.15.1:0/2514536307 learned_addr learned my addr 172.21.15.1:0/2514536307 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717affd640 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fbaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717a7fc640 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fb9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 -- 172.21.15.1:0/2514536307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 msgr2=0x5586c7fb9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fb9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 -- 172.21.15.1:0/2514536307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 msgr2=0x5586c7fbaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fbaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 -- 172.21.15.1:0/2514536307 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c7fa8560 con 0x5586c7fa8fc0 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717affd640 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fbaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f717b7fe640 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fb8f90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f716c09ba90 tx=0x7f716c0b4da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ced733cfebe535 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f71717fa640 1 -- 172.21.15.1:0/2514536307 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c014070 con 0x5586c7fa8fc0 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f71717fa640 1 -- 172.21.15.1:0/2514536307 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f716c0b4e50 con 0x5586c7fa8fc0 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.703+0000 7f71717fa640 1 -- 172.21.15.1:0/2514536307 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c020050 con 0x5586c7fa8fc0 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 -- 172.21.15.1:0/2514536307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 msgr2=0x5586c7fb8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fb8f90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f716c09ba90 tx=0x7f716c0b4da0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 -- 172.21.15.1:0/2514536307 shutdown_connections 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fb8f90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fb9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 --2- 172.21.15.1:0/2514536307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fbaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 -- 172.21.15.1:0/2514536307 >> 172.21.15.1:0/2514536307 conn(0x5586c7f95f60 msgr2=0x5586c7f96340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:11.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 -- 172.21.15.1:0/2514536307 shutdown_connections 2024-09-19T09:04:11.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 -- 172.21.15.1:0/2514536307 wait complete. 2024-09-19T09:04:11.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.704+0000 7f7183c85740 1 -- start start 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f7183c85740 1 Processor -- start 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f7183c85740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fc3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f7183c85740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fc35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f7183c85740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fbba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f7183c85740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5586c7fba950 con 0x5586c7fa8fc0 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f7183c85740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5586c7fba280 con 0x5586c7f998d0 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f7183c85740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5586c7fbb020 con 0x5586c7f9a1f0 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f7183c85740 10 client.0 _ll_register_callbacks cb 0x7f7164009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fbba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fbba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34492/0 (socket says 172.21.15.1:34492) 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717b7fe640 1 -- 172.21.15.1:0/1859271511 learned_addr learned my addr 172.21.15.1:0/1859271511 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717affd640 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fc3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717a7fc640 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fc35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717b7fe640 1 -- 172.21.15.1:0/1859271511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 msgr2=0x5586c7fc35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717b7fe640 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fc35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717b7fe640 1 -- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 msgr2=0x5586c7fc3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717b7fe640 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fc3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717b7fe640 1 -- 172.21.15.1:0/1859271511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c7fbc260 con 0x5586c7fa8fc0 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.705+0000 7f717affd640 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fc3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f717b7fe640 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fbba30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f716c00d720 tx=0x7f716c0cd2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ab702475f3896d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f715affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f715affd640 1 -- 172.21.15.1:0/1859271511 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c07e020 con 0x5586c7fa8fc0 2024-09-19T09:04:11.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f715affd640 1 -- 172.21.15.1:0/1859271511 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f716c0977d0 con 0x5586c7fa8fc0 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 1 -- 172.21.15.1:0/1859271511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f716c0b4e50 con 0x5586c7fa8fc0 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f715affd640 1 -- 172.21.15.1:0/1859271511 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f716c014070 con 0x5586c7fa8fc0 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 10 client.15369 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 1 -- 172.21.15.1:0/1859271511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586c7fbc260 con 0x5586c7fa8fc0 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f715affd640 1 -- 172.21.15.1:0/1859271511 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f716c0b4e50 con 0x5586c7fa8fc0 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f715affd640 1 -- 172.21.15.1:0/1859271511 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f716c09ad20 con 0x5586c7fa8fc0 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 10 client.15369 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 10 client.15369 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 20 client.15369 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5586c8026f90 0x5586c8025ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 4 client.15369 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.706+0000 7f7183c85740 1 -- 172.21.15.1:0/1859271511 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "status"}) -- 0x5586c7e840e0 con 0x5586c8026f90 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.707+0000 7f717affd640 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5586c8026f90 0x5586c8025ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:11.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.707+0000 7f715affd640 10 client.15369 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.707+0000 7f717affd640 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5586c8026f90 0x5586c8025ca0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abdf19a8d8a1a357 server_cookie=b759edc604add67f in_seq=0 out_seq=0 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.707+0000 7f715affd640 1 -- 172.21.15.1:0/1859271511 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5586c7e840e0 con 0x5586c8026f90 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.707+0000 7f715affd640 10 client.15369 handle_command_reply: tid=0 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.707+0000 7f7183c85740 1 client.15369 shutdown 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.707+0000 7f7183c85740 1 -- 172.21.15.1:0/1859271511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 msgr2=0x5586c7fbba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.707+0000 7f7183c85740 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fbba30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f716c00d720 tx=0x7f716c0cd2a0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 1 -- 172.21.15.1:0/1859271511 shutdown_connections 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5586c8026f90 0x5586c8025ca0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5586c7fa8fc0 0x5586c7fbba30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5586c7f9a1f0 0x5586c7fc35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 1 --2- 172.21.15.1:0/1859271511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5586c7f998d0 0x5586c7fc3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 1 -- 172.21.15.1:0/1859271511 >> 172.21.15.1:0/1859271511 conn(0x5586c7f95f60 msgr2=0x5586c7fa73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:11.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f715affd640 0 client.15369 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 1 -- 172.21.15.1:0/1859271511 shutdown_connections 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 1 -- 172.21.15.1:0/1859271511 wait complete. 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f7183c85740 20 client.15369 trim_cache size 0 max 16384 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "98b2a8e0-7664-11ef-bceb-c7b262605968", 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24500, 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:04:11.714 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:04:11.715 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 129.05302997499999, 2024-09-19T09:04:11.715 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 24, 2024-09-19T09:04:11.715 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 80, 2024-09-19T09:04:11.715 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T09:04:11.715 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 139.12245257699999 2024-09-19T09:04:11.715 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:04:11.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 -- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71680a32d0 msgr2=0x7f71680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71680a32d0 0x7f71680a5790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7174005fd0 tx=0x7f7174009760 comp rx=0 tx=0).stop 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 -- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c106f10 msgr2=0x7f717c19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c106f10 0x7f717c19cde0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f716c00d750 tx=0x7f716c00dc10 comp rx=0 tx=0).stop 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 -- 172.21.15.1:0/1860612238 shutdown_connections 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f717c106f10 0x7f717c19cde0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717c102790 0x7f717c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71680a32d0 0x7f71680a5790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 --2- 172.21.15.1:0/1860612238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f717c101de0 0x7f717c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.708+0000 7f71818ac640 1 -- 172.21.15.1:0/1860612238 >> 172.21.15.1:0/1860612238 conn(0x7f717c0fd8c0 msgr2=0x7f717c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.709+0000 7f71818ac640 1 -- 172.21.15.1:0/1860612238 shutdown_connections 2024-09-19T09:04:11.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:11.709+0000 7f71818ac640 1 -- 172.21.15.1:0/1860612238 wait complete. 2024-09-19T09:04:12.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:11 smithi001 ceph-mon[30939]: pgmap v340: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T09:04:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:11 smithi064 ceph-mon[35179]: pgmap v340: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T09:04:12.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:11 smithi022 ceph-mon[35107]: pgmap v340: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T09:04:12.528 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T09:04:14.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:13 smithi001 ceph-mon[30939]: pgmap v341: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:04:14.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:13 smithi064 ceph-mon[35179]: pgmap v341: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:04:14.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:13 smithi022 ceph-mon[35107]: pgmap v341: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:04:16.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:15 smithi001 ceph-mon[30939]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:04:16.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:15 smithi064 ceph-mon[35179]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:04:16.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:15 smithi022 ceph-mon[35107]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:04:18.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:17 smithi001 ceph-mon[30939]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:04:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:17 smithi064 ceph-mon[35179]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:04:18.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:17 smithi022 ceph-mon[35107]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:04:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1811902005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 msgr2=0x7fc398108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1811902005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 0x7fc398108eb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc390009ca0 tx=0x7fc39002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1811902005 shutdown_connections 2024-09-19T09:04:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1811902005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 0x7fc398108eb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1811902005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc398101c60 0x7fc3981020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1811902005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc398100a70 0x7fc398100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1811902005 >> 172.21.15.1:0/1811902005 conn(0x7fc3980fc1f0 msgr2=0x7fc3980fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.561 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1811902005 shutdown_connections 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1811902005 wait complete. 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 Processor -- start 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.559+0000 7fc39eb5f640 1 -- start start 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39eb5f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc398100a70 0x7fc39806ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39eb5f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc398101c60 0x7fc39819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39eb5f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 0x7fc39819f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39eb5f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc39810c850 con 0x7fc398102620 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39eb5f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc39810c6d0 con 0x7fc398101c60 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39eb5f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc39810c9d0 con 0x7fc398100a70 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 0x7fc39819f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39c8fb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc398100a70 0x7fc39806ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.562 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 0x7fc39819f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44684/0 (socket says 172.21.15.1:44684) 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 -- 172.21.15.1:0/1493311164 learned_addr learned my addr 172.21.15.1:0/1493311164 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc397fff640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc398101c60 0x7fc39819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 -- 172.21.15.1:0/1493311164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc398100a70 msgr2=0x7fc39806ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc398100a70 0x7fc39806ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 -- 172.21.15.1:0/1493311164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc398101c60 msgr2=0x7fc39819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc398101c60 0x7fc39819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 -- 172.21.15.1:0/1493311164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39819fbd0 con 0x7fc398102620 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc397fff640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc398101c60 0x7fc39819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39d0fc640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 0x7fc39819f2c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc390006010 tx=0x7fc390031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc395ffb640 1 -- 172.21.15.1:0/1493311164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39002fa20 con 0x7fc398102620 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc395ffb640 1 -- 172.21.15.1:0/1493311164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc39002fbc0 con 0x7fc398102620 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.560+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1493311164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39819fe00 con 0x7fc398102620 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.561+0000 7fc395ffb640 1 -- 172.21.15.1:0/1493311164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390046800 con 0x7fc398102620 2024-09-19T09:04:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.561+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1493311164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3981a0310 con 0x7fc398102620 2024-09-19T09:04:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.563+0000 7fc395ffb640 1 -- 172.21.15.1:0/1493311164 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fc39002fd70 con 0x7fc398102620 2024-09-19T09:04:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.563+0000 7fc3a19d7740 1 Processor -- start 2024-09-19T09:04:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc3a19d7740 1 -- start start 2024-09-19T09:04:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7cc1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cc6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cc9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564da7c252f0 con 0x564da7cc19a0 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564da7bcd270 con 0x564da7cc22e0 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564da7c212b0 con 0x564da7cc7370 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc395ffb640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3880a3350 0x7fc3880a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7cc1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7cc1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44688/0 (socket says 172.21.15.1:44688) 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 -- 172.21.15.1:0/3584392517 learned_addr learned my addr 172.21.15.1:0/3584392517 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cc6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc39d0fc640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3880a3350 0x7fc3880a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cc9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 -- 172.21.15.1:0/3584392517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 msgr2=0x564da7cc9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cc9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc395ffb640 1 -- 172.21.15.1:0/1493311164 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc3900f0e60 con 0x7fc398102620 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 -- 172.21.15.1:0/3584392517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 msgr2=0x564da7cc6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cc6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc397fff640 1 -- 172.21.15.1:0/3584392517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da7bcc340 con 0x564da7cc19a0 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.564+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cc6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.565+0000 7fc397fff640 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7cc1da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc384013550 tx=0x7fc38400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff3d7b683df6254 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.565+0000 7fc39d0fc640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3880a3350 0x7fc3880a5810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3900b9e10 tx=0x7fc3900e5040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.565+0000 7fc382ffd640 1 -- 172.21.15.1:0/3584392517 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384019070 con 0x564da7cc19a0 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.565+0000 7fc382ffd640 1 -- 172.21.15.1:0/3584392517 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc384005520 con 0x564da7cc19a0 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.565+0000 7fc382ffd640 1 -- 172.21.15.1:0/3584392517 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840035f0 con 0x564da7cc19a0 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.565+0000 7fc3a19d7740 1 -- 172.21.15.1:0/3584392517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 msgr2=0x564da7cc1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.565+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7cc1da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc384013550 tx=0x7fc38400b6b0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 -- 172.21.15.1:0/3584392517 shutdown_connections 2024-09-19T09:04:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cc9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cc6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/3584392517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7cc1da0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 -- 172.21.15.1:0/3584392517 >> 172.21.15.1:0/3584392517 conn(0x564da7cbd010 msgr2=0x564da7cbd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 -- 172.21.15.1:0/3584392517 shutdown_connections 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 -- 172.21.15.1:0/3584392517 wait complete. 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 -- start start 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 Processor -- start 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7ccc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cd3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564da7cca340 con 0x564da7cc19a0 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564da7bae290 con 0x564da7cc22e0 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.566+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564da7cca4c0 con 0x564da7cc7370 2024-09-19T09:04:18.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc3a19d7740 10 client.0 _ll_register_callbacks cb 0x564da7bdf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44692/0 (socket says 172.21.15.1:44692) 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 -- 172.21.15.1:0/2893028299 learned_addr learned my addr 172.21.15.1:0/2893028299 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cd3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7ccc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 -- 172.21.15.1:0/2893028299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 msgr2=0x564da7cd3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cd3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 -- 172.21.15.1:0/2893028299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 msgr2=0x564da7ccc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7ccc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 -- 172.21.15.1:0/2893028299 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da7938210 con 0x564da7cc19a0 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc397fff640 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccbb90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc384016040 tx=0x7fc38400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366305876474aac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc377fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc377fff640 1 -- 172.21.15.1:0/2893028299 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384019040 con 0x564da7cc19a0 2024-09-19T09:04:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc377fff640 1 -- 172.21.15.1:0/2893028299 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc384004df0 con 0x564da7cc19a0 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc3a19d7740 1 -- 172.21.15.1:0/2893028299 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc384005520 con 0x564da7cc19a0 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.567+0000 7fc377fff640 1 -- 172.21.15.1:0/2893028299 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc384033070 con 0x564da7cc19a0 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc3a19d7740 10 client.15381 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc3a19d7740 1 -- 172.21.15.1:0/2893028299 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564da7a04620 con 0x564da7cc19a0 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc377fff640 1 -- 172.21.15.1:0/2893028299 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc384005520 con 0x564da7cc19a0 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc377fff640 1 -- 172.21.15.1:0/2893028299 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc384003b80 con 0x564da7cc19a0 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc3a19d7740 10 client.15381 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc3a19d7740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc3a19d7740 20 client.15381 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564da7cd74d0 0x564da7cd98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc3a19d7740 4 client.15381 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc3a19d7740 1 -- 172.21.15.1:0/2893028299 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564da7c32a20 con 0x564da7cd74d0 2024-09-19T09:04:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.568+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564da7cd74d0 0x564da7cd98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.569+0000 7fc377fff640 10 client.15381 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.569+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564da7cd74d0 0x564da7cd98c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0325799d1643481 server_cookie=31ff24308345fe1a in_seq=0 out_seq=0 2024-09-19T09:04:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc377fff640 1 -- 172.21.15.1:0/2893028299 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564da7c32a20 con 0x564da7cd74d0 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc377fff640 10 client.15381 handle_command_reply: tid=0 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 client.15381 shutdown 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 -- 172.21.15.1:0/2893028299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 msgr2=0x564da7ccbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccbb90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc384016040 tx=0x7fc38400b610 comp rx=0 tx=0).stop 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 -- 172.21.15.1:0/2893028299 shutdown_connections 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564da7cd74d0 0x564da7cd98c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cd3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7ccc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc377fff640 0 client.15381 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/2893028299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccbb90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 -- 172.21.15.1:0/2893028299 >> 172.21.15.1:0/2893028299 conn(0x564da7cbd010 msgr2=0x564da7cbe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 -- 172.21.15.1:0/2893028299 shutdown_connections 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 1 -- 172.21.15.1:0/2893028299 wait complete. 2024-09-19T09:04:18.575 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.570+0000 7fc3a19d7740 20 client.15381 trim_cache size 0 max 16384 2024-09-19T09:04:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc3a19d7740 1 Processor -- start 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc3a19d7740 1 -- start start 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cd30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cbc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981aba40 con 0x564da7cc19a0 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981a9310 con 0x564da7cc22e0 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981a7160 con 0x564da7cc7370 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44694/0 (socket says 172.21.15.1:44694) 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 -- 172.21.15.1:0/4043644648 learned_addr learned my addr 172.21.15.1:0/4043644648 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cd30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cbc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 -- 172.21.15.1:0/4043644648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 msgr2=0x564da7cbc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cbc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 -- 172.21.15.1:0/4043644648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 msgr2=0x564da7cd30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cd30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 -- 172.21.15.1:0/4043644648 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da7cc2f70 con 0x564da7cc19a0 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.585+0000 7fc397fff640 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccc160 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc384004900 tx=0x7fc384004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2e227096f73c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3827fc640 1 -- 172.21.15.1:0/4043644648 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38402f6c0 con 0x564da7cc19a0 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3827fc640 1 -- 172.21.15.1:0/4043644648 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc384027040 con 0x564da7cc19a0 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3827fc640 1 -- 172.21.15.1:0/4043644648 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384003a30 con 0x564da7cc19a0 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 -- 172.21.15.1:0/4043644648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 msgr2=0x564da7ccc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccc160 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc384004900 tx=0x7fc384004740 comp rx=0 tx=0).stop 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 -- 172.21.15.1:0/4043644648 shutdown_connections 2024-09-19T09:04:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc7370 0x564da7cbc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc22e0 0x564da7cd30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/4043644648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc19a0 0x564da7ccc160 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 -- 172.21.15.1:0/4043644648 >> 172.21.15.1:0/4043644648 conn(0x564da7cbd010 msgr2=0x564da7cbb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 -- 172.21.15.1:0/4043644648 shutdown_connections 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 -- 172.21.15.1:0/4043644648 wait complete. 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.586+0000 7fc3a19d7740 1 -- start start 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc3a19d7740 1 Processor -- start 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc19a0 0x564da7cd0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc22e0 0x564da7cd0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc3a19d7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc7370 0x564da7cd1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981a77d0 con 0x564da7cc22e0 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981a8c40 con 0x564da7cc7370 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc3a19d7740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981a7ea0 con 0x564da7cc19a0 2024-09-19T09:04:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc3a19d7740 10 client.0 _ll_register_callbacks cb 0x7fc38c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc39c8fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc22e0 0x564da7cd0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc39c8fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc22e0 0x564da7cd0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44710/0 (socket says 172.21.15.1:44710) 2024-09-19T09:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc39c8fb640 1 -- 172.21.15.1:0/1714242986 learned_addr learned my addr 172.21.15.1:0/1714242986 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc397fff640 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc7370 0x564da7cd1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc397fff640 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc19a0 0x564da7cd0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc39c8fb640 1 -- 172.21.15.1:0/1714242986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc19a0 msgr2=0x564da7cd0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc19a0 0x564da7cd0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc39c8fb640 1 -- 172.21.15.1:0/1714242986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc7370 msgr2=0x564da7cd1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc7370 0x564da7cd1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc39c8fb640 1 -- 172.21.15.1:0/1714242986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da7cd22a0 con 0x564da7cc22e0 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.587+0000 7fc397fff640 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc19a0 0x564da7cd0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc39c8fb640 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc22e0 0x564da7cd0c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005d00 tx=0x7fc38c0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78458160d54dcca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc377fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc377fff640 1 -- 172.21.15.1:0/1714242986 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c004230 con 0x564da7cc22e0 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc377fff640 1 -- 172.21.15.1:0/1714242986 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc38c0043d0 con 0x564da7cc22e0 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 1 -- 172.21.15.1:0/1714242986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc384027040 con 0x564da7cc22e0 2024-09-19T09:04:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc377fff640 1 -- 172.21.15.1:0/1714242986 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc38c01f6d0 con 0x564da7cc22e0 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 10 client.15387 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 1 -- 172.21.15.1:0/1714242986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564da7d42150 con 0x564da7cc22e0 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc377fff640 1 -- 172.21.15.1:0/1714242986 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc384027040 con 0x564da7cc22e0 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc377fff640 1 -- 172.21.15.1:0/1714242986 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc38c025070 con 0x564da7cc22e0 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 10 client.15387 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 20 client.15387 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564da7d42ab0 0x564da7d44ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 4 client.15387 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.588+0000 7fc3a19d7740 1 -- 172.21.15.1:0/1714242986 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564da7c2cd70 con 0x564da7d42ab0 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.589+0000 7fc397fff640 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564da7d42ab0 0x564da7d44ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.589+0000 7fc397fff640 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564da7d42ab0 0x564da7d44ed0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa71ddfd89859fcd server_cookie=748c3a337252ed2e in_seq=0 out_seq=0 2024-09-19T09:04:18.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.589+0000 7fc377fff640 10 client.15387 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.596+0000 7fc377fff640 1 -- 172.21.15.1:0/1714242986 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564da7c2cd70 con 0x564da7d42ab0 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.596+0000 7fc377fff640 10 client.15387 handle_command_reply: tid=0 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.596+0000 7fc3a19d7740 1 client.15387 shutdown 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.596+0000 7fc3a19d7740 1 -- 172.21.15.1:0/1714242986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc22e0 msgr2=0x564da7cd0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.596+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc22e0 0x564da7cd0c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005d00 tx=0x7fc38c0108e0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 1 -- 172.21.15.1:0/1714242986 shutdown_connections 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564da7d42ab0 0x564da7d44ed0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564da7cc7370 0x564da7cd1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564da7cc22e0 0x564da7cd0c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc377fff640 0 client.15387 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 1 --2- 172.21.15.1:0/1714242986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564da7cc19a0 0x564da7cd0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 1 -- 172.21.15.1:0/1714242986 >> 172.21.15.1:0/1714242986 conn(0x564da7cbd010 msgr2=0x564da7cbb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 1 -- 172.21.15.1:0/1714242986 shutdown_connections 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 1 -- 172.21.15.1:0/1714242986 wait complete. 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc3a19d7740 20 client.15387 trim_cache size 0 max 16384 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:04:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:04:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3880a3350 msgr2=0x7fc3880a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3880a3350 0x7fc3880a5810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc3900b9e10 tx=0x7fc3900e5040 comp rx=0 tx=0).stop 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 msgr2=0x7fc39819f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 0x7fc39819f2c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc390006010 tx=0x7fc390031ee0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1493311164 shutdown_connections 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc398102620 0x7fc39819f2c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc398101c60 0x7fc39819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3880a3350 0x7fc3880a5810 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 --2- 172.21.15.1:0/1493311164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc398100a70 0x7fc39806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.597+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1493311164 >> 172.21.15.1:0/1493311164 conn(0x7fc3980fc1f0 msgr2=0x7fc398104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.598+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1493311164 shutdown_connections 2024-09-19T09:04:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:18.598+0000 7fc39eb5f640 1 -- 172.21.15.1:0/1493311164 wait complete. 2024-09-19T09:04:20.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:19 smithi001 ceph-mon[30939]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:04:20.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:19 smithi064 ceph-mon[35179]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:04:20.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:19 smithi022 ceph-mon[35107]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:04:22.011 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:21 smithi022 ceph-mon[35107]: pgmap v345: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-19T09:04:22.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:21 smithi001 ceph-mon[30939]: pgmap v345: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-19T09:04:22.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:21 smithi064 ceph-mon[35179]: pgmap v345: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-19T09:04:24.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:23 smithi001 ceph-mon[30939]: pgmap v346: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:04:24.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:23 smithi064 ceph-mon[35179]: pgmap v346: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:04:24.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:23 smithi022 ceph-mon[35107]: pgmap v346: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:04:26.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:25 smithi001 ceph-mon[30939]: pgmap v347: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:26.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:25 smithi064 ceph-mon[35179]: pgmap v347: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:26.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:25 smithi022 ceph-mon[35107]: pgmap v347: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:26.391 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:04:26.666 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 -- 172.21.15.1:0/2231066672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc1036e0 msgr2=0x7fb4bc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/2231066672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc1036e0 0x7fb4bc107b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009930 tx=0x7fb4ac02a420 comp rx=0 tx=0).stop 2024-09-19T09:04:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 -- 172.21.15.1:0/2231066672 shutdown_connections 2024-09-19T09:04:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/2231066672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4bc1082a0 0x7fb4bc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/2231066672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc1036e0 0x7fb4bc107b90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/2231066672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4bc102d30 0x7fb4bc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 -- 172.21.15.1:0/2231066672 >> 172.21.15.1:0/2231066672 conn(0x7fb4bc0fc7d0 msgr2=0x7fb4bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 -- 172.21.15.1:0/2231066672 shutdown_connections 2024-09-19T09:04:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.144+0000 7fb4c44d9640 1 -- 172.21.15.1:0/2231066672 wait complete. 2024-09-19T09:04:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.145+0000 7fb4c44d9640 1 Processor -- start 2024-09-19T09:04:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.145+0000 7fb4c44d9640 1 -- start start 2024-09-19T09:04:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c44d9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc102d30 0x7fb4bc198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c44d9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4bc1036e0 0x7fb4bc198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c44d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4bc1082a0 0x7fb4bc19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c44d9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc112180 con 0x7fb4bc102d30 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c44d9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc112000 con 0x7fb4bc1082a0 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c44d9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc112300 con 0x7fb4bc1036e0 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc102d30 0x7fb4bc198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc102d30 0x7fb4bc198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32948/0 (socket says 172.21.15.1:32948) 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 -- 172.21.15.1:0/4250100564 learned_addr learned my addr 172.21.15.1:0/4250100564 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4bc1082a0 0x7fb4bc19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4bc1036e0 0x7fb4bc198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 -- 172.21.15.1:0/4250100564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4bc1036e0 msgr2=0x7fb4bc198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4bc1036e0 0x7fb4bc198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 -- 172.21.15.1:0/4250100564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4bc1082a0 msgr2=0x7fb4bc19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4bc1082a0 0x7fb4bc19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 -- 172.21.15.1:0/4250100564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc19d5d0 con 0x7fb4bc102d30 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4bc1036e0 0x7fb4bc198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.146+0000 7fb4c2275640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc102d30 0x7fb4bc198620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800c920 tx=0x7fb4b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.147+0000 7fb4b37fe640 1 -- 172.21.15.1:0/4250100564 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8007c70 con 0x7fb4bc102d30 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.147+0000 7fb4b37fe640 1 -- 172.21.15.1:0/4250100564 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4b8007e10 con 0x7fb4bc102d30 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.147+0000 7fb4c44d9640 1 -- 172.21.15.1:0/4250100564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4bc19d8c0 con 0x7fb4bc102d30 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.147+0000 7fb4b37fe640 1 -- 172.21.15.1:0/4250100564 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8018940 con 0x7fb4bc102d30 2024-09-19T09:04:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.147+0000 7fb4c44d9640 1 -- 172.21.15.1:0/4250100564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4bc1008c0 con 0x7fb4bc102d30 2024-09-19T09:04:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.149+0000 7fb4b37fe640 1 -- 172.21.15.1:0/4250100564 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fb4b8018b20 con 0x7fb4bc102d30 2024-09-19T09:04:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.149+0000 7fb4c68b2740 1 Processor -- start 2024-09-19T09:04:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c68b2740 1 -- start start 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429da4a0 0x555d429da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429dadc0 0x555d429e5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429e5680 0x555d429e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555d429402e0 con 0x555d429dadc0 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555d428e7ce0 con 0x555d429e5680 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555d4293c2a0 con 0x555d429da4a0 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c2275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429dadc0 0x555d429e5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c2275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429dadc0 0x555d429e5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32954/0 (socket says 172.21.15.1:32954) 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c2275640 1 -- 172.21.15.1:0/2416290383 learned_addr learned my addr 172.21.15.1:0/2416290383 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429da4a0 0x555d429da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.150+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429e5680 0x555d429e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4c2275640 1 -- 172.21.15.1:0/2416290383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429da4a0 msgr2=0x555d429da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4c2275640 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429da4a0 0x555d429da880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4c2275640 1 -- 172.21.15.1:0/2416290383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429e5680 msgr2=0x555d429e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4b37fe640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb4a80a32d0 0x7fb4a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4c2275640 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429e5680 0x555d429e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4c2275640 1 -- 172.21.15.1:0/2416290383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d428cc440 con 0x555d429dadc0 2024-09-19T09:04:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429e5680 0x555d429e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb4a80a32d0 0x7fb4a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4c2275640 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429dadc0 0x555d429e5140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80cd510 tx=0x7fb4b8098440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71947f7c522b4c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4b37fe640 1 -- 172.21.15.1:0/4250100564 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb4b80cfc40 con 0x7fb4bc102d30 2024-09-19T09:04:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4b0ff9640 1 -- 172.21.15.1:0/2416290383 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b809beb0 con 0x555d429dadc0 2024-09-19T09:04:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4b0ff9640 1 -- 172.21.15.1:0/2416290383 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4b80d3e40 con 0x555d429dadc0 2024-09-19T09:04:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.151+0000 7fb4b0ff9640 1 -- 172.21.15.1:0/2416290383 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b809ba40 con 0x555d429dadc0 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 -- 172.21.15.1:0/2416290383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429dadc0 msgr2=0x555d429e5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429dadc0 0x555d429e5140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80cd510 tx=0x7fb4b8098440 comp rx=0 tx=0).stop 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb4a80a32d0 0x7fb4a80a5790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4005fd0 tx=0x7fb4b4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 -- 172.21.15.1:0/2416290383 shutdown_connections 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429e5680 0x555d429e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429dadc0 0x555d429e5140 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/2416290383 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429da4a0 0x555d429da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 -- 172.21.15.1:0/2416290383 >> 172.21.15.1:0/2416290383 conn(0x555d429d6a30 msgr2=0x555d429d6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 -- 172.21.15.1:0/2416290383 shutdown_connections 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.152+0000 7fb4c68b2740 1 -- 172.21.15.1:0/2416290383 wait complete. 2024-09-19T09:04:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 1 -- start start 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 1 Processor -- start 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 0x555d429e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429e5680 0x555d429e27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555d429e8250 con 0x555d429e5680 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555d428fb050 con 0x555d429da4a0 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555d429e83d0 con 0x555d429dadc0 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c68b2740 10 client.0 _ll_register_callbacks cb 0x555d4293b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c2a76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429e5680 0x555d429e27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c2a76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429e5680 0x555d429e27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32968/0 (socket says 172.21.15.1:32968) 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c2a76640 1 -- 172.21.15.1:0/1782074939 learned_addr learned my addr 172.21.15.1:0/1782074939 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.153+0000 7fb4c2275640 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 0x555d429e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c2a76640 1 -- 172.21.15.1:0/1782074939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 msgr2=0x555d429e2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c2a76640 1 -- 172.21.15.1:0/1782074939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 msgr2=0x555d429e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 0x555d429e4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c2a76640 1 -- 172.21.15.1:0/1782074939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d426b13c0 con 0x555d429e5680 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429e5680 0x555d429e27b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40099c0 tx=0x7fb4b4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491e633caf91f696 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/1782074939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4004b20 con 0x555d429e5680 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/1782074939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb4b4004cc0 con 0x555d429e5680 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c68b2740 1 -- 172.21.15.1:0/1782074939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d4294d850 con 0x555d429e5680 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/1782074939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4b400f7d0 con 0x555d429e5680 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c68b2740 10 client.15399 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.154+0000 7fb4c68b2740 1 -- 172.21.15.1:0/1782074939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d429f3c60 con 0x555d429e5680 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/1782074939 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x555d4294d850 con 0x555d429e5680 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/1782074939 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb4b4026070 con 0x555d429e5680 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4c68b2740 10 client.15399 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4c68b2740 10 client.15399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4c68b2740 20 client.15399 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555d429f5070 0x555d429f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4c68b2740 4 client.15399 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4c68b2740 1 -- 172.21.15.1:0/1782074939 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d42947d60 con 0x555d429f5070 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.155+0000 7fb4c2275640 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555d429f5070 0x555d429f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.156+0000 7fb4a5ffb640 10 client.15399 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.156+0000 7fb4c2275640 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555d429f5070 0x555d429f74f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed87f92ebdd498b9 server_cookie=76a40948bc2ccc0b in_seq=0 out_seq=0 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.156+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/1782074939 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d42947d60 con 0x555d429f5070 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.156+0000 7fb4a5ffb640 10 client.15399 handle_command_reply: tid=0 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 client.15399 shutdown 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 -- 172.21.15.1:0/1782074939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429e5680 msgr2=0x555d429e27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429e5680 0x555d429e27b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40099c0 tx=0x7fb4b4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 -- 172.21.15.1:0/1782074939 shutdown_connections 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555d429f5070 0x555d429f74f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429e5680 0x555d429e27b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4a5ffb640 0 client.15399 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/1782074939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 0x555d429e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 -- 172.21.15.1:0/1782074939 >> 172.21.15.1:0/1782074939 conn(0x555d429d6a30 msgr2=0x555d429dc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 -- 172.21.15.1:0/1782074939 shutdown_connections 2024-09-19T09:04:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 1 -- 172.21.15.1:0/1782074939 wait complete. 2024-09-19T09:04:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.157+0000 7fb4c68b2740 20 client.15399 trim_cache size 0 max 16384 2024-09-19T09:04:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c68b2740 1 Processor -- start 2024-09-19T09:04:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c68b2740 1 -- start start 2024-09-19T09:04:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429d6a30 0x555d429f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429da4a0 0x555d429e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429dc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc1addc0 con 0x555d429da4a0 2024-09-19T09:04:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc1ab690 con 0x555d429d6a30 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc1a94e0 con 0x555d429dadc0 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c1a74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429da4a0 0x555d429e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c1a74640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429da4a0 0x555d429e2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32970/0 (socket says 172.21.15.1:32970) 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c1a74640 1 -- 172.21.15.1:0/4037945020 learned_addr learned my addr 172.21.15.1:0/4037945020 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c2275640 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429d6a30 0x555d429f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429dc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c1a74640 1 -- 172.21.15.1:0/4037945020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 msgr2=0x555d429dc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429dc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c1a74640 1 -- 172.21.15.1:0/4037945020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429d6a30 msgr2=0x555d429f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429d6a30 0x555d429f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c1a74640 1 -- 172.21.15.1:0/4037945020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d429f7b70 con 0x555d429da4a0 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.175+0000 7fb4c2275640 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429d6a30 0x555d429f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.176+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429da4a0 0x555d429e2230 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac006010 tx=0x7fb4ac032d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbb699a7f37fce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.176+0000 7fb4a7fff640 1 -- 172.21.15.1:0/4037945020 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac035040 con 0x555d429da4a0 2024-09-19T09:04:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.176+0000 7fb4a7fff640 1 -- 172.21.15.1:0/4037945020 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4ac031900 con 0x555d429da4a0 2024-09-19T09:04:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.176+0000 7fb4a7fff640 1 -- 172.21.15.1:0/4037945020 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac004920 con 0x555d429da4a0 2024-09-19T09:04:27.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 -- 172.21.15.1:0/4037945020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429da4a0 msgr2=0x555d429e2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429da4a0 0x555d429e2230 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac006010 tx=0x7fb4ac032d90 comp rx=0 tx=0).stop 2024-09-19T09:04:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 -- 172.21.15.1:0/4037945020 shutdown_connections 2024-09-19T09:04:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429dc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429da4a0 0x555d429e2230 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/4037945020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429d6a30 0x555d429f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 -- 172.21.15.1:0/4037945020 >> 172.21.15.1:0/4037945020 conn(0x555d429e2910 msgr2=0x555d429dbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 -- 172.21.15.1:0/4037945020 shutdown_connections 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 -- 172.21.15.1:0/4037945020 wait complete. 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 -- start start 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.177+0000 7fb4c68b2740 1 Processor -- start 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429d6a30 0x555d429edeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 0x555d429e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c68b2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc1a9b50 con 0x555d429d6a30 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc1aafc0 con 0x555d429da4a0 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c68b2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb4bc1aa220 con 0x555d429dadc0 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c68b2740 10 client.0 _ll_register_callbacks cb 0x7fb4b4009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429d6a30 0x555d429edeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429d6a30 0x555d429edeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32974/0 (socket says 172.21.15.1:32974) 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 -- 172.21.15.1:0/3336529526 learned_addr learned my addr 172.21.15.1:0/3336529526 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 0x555d429e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 -- 172.21.15.1:0/3336529526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 msgr2=0x555d429e97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 -- 172.21.15.1:0/3336529526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 msgr2=0x555d429e91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 0x555d429e91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 -- 172.21.15.1:0/3336529526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d429ea020 con 0x555d429d6a30 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2a76640 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4c2275640 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429d6a30 0x555d429edeb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80cd510 tx=0x7fb4b8018400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e42d2cf3131e1a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.178+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/3336529526 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b809bc20 con 0x555d429d6a30 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/3336529526 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb4b800fbe0 con 0x555d429d6a30 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 1 -- 172.21.15.1:0/3336529526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4ac031900 con 0x555d429d6a30 2024-09-19T09:04:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/3336529526 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4b809ba40 con 0x555d429d6a30 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 10 client.15405 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 1 -- 172.21.15.1:0/3336529526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d42a5ff20 con 0x555d429d6a30 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/3336529526 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4ac031900 con 0x555d429d6a30 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/3336529526 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb4b80cd820 con 0x555d429d6a30 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 10 client.15405 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 20 client.15405 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555d429e5680 0x555d42a621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 4 client.15405 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.179+0000 7fb4c68b2740 1 -- 172.21.15.1:0/3336529526 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555d428c4210 con 0x555d429e5680 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.180+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555d429e5680 0x555d42a621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.180+0000 7fb4c1a74640 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555d429e5680 0x555d42a621c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e8acb5b1a2f5e67 server_cookie=d5e860acbea7e4ea in_seq=0 out_seq=0 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.180+0000 7fb4a5ffb640 10 client.15405 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.180+0000 7fb4a5ffb640 1 -- 172.21.15.1:0/3336529526 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555d428c4210 con 0x555d429e5680 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.180+0000 7fb4a5ffb640 10 client.15405 handle_command_reply: tid=0 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.180+0000 7fb4c68b2740 1 client.15405 shutdown 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.180+0000 7fb4c68b2740 1 -- 172.21.15.1:0/3336529526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429d6a30 msgr2=0x555d429edeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.180+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429d6a30 0x555d429edeb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80cd510 tx=0x7fb4b8018400 comp rx=0 tx=0).stop 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 1 -- 172.21.15.1:0/3336529526 shutdown_connections 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555d429e5680 0x555d42a621c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555d429dadc0 0x555d429e97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d429da4a0 0x555d429e91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 1 --2- 172.21.15.1:0/3336529526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555d429d6a30 0x555d429edeb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 1 -- 172.21.15.1:0/3336529526 >> 172.21.15.1:0/3336529526 conn(0x555d429e2910 msgr2=0x555d429e42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4a5ffb640 0 client.15405 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 1 -- 172.21.15.1:0/3336529526 shutdown_connections 2024-09-19T09:04:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 1 -- 172.21.15.1:0/3336529526 wait complete. 2024-09-19T09:04:27.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c68b2740 20 client.15405 trim_cache size 0 max 16384 2024-09-19T09:04:27.189 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:04:27.189 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:04:27.189 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:04:27.189 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:04:27.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c44d9640 1 -- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb4a80a32d0 msgr2=0x7fb4a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb4a80a32d0 0x7fb4a80a5790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4005fd0 tx=0x7fb4b4009500 comp rx=0 tx=0).stop 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c44d9640 1 -- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc102d30 msgr2=0x7fb4bc198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.181+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc102d30 0x7fb4bc198620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800c920 tx=0x7fb4b800cde0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.182+0000 7fb4c44d9640 1 -- 172.21.15.1:0/4250100564 shutdown_connections 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.182+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4bc1082a0 0x7fb4bc19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.182+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb4a80a32d0 0x7fb4a80a5790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.182+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4bc1036e0 0x7fb4bc198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.182+0000 7fb4c44d9640 1 --2- 172.21.15.1:0/4250100564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4bc102d30 0x7fb4bc198620 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.182+0000 7fb4c44d9640 1 -- 172.21.15.1:0/4250100564 >> 172.21.15.1:0/4250100564 conn(0x7fb4bc0fc7d0 msgr2=0x7fb4bc105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.182+0000 7fb4c44d9640 1 -- 172.21.15.1:0/4250100564 shutdown_connections 2024-09-19T09:04:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:27.182+0000 7fb4c44d9640 1 -- 172.21.15.1:0/4250100564 wait complete. 2024-09-19T09:04:27.530 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T09:04:27.530 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:27.809 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:27 smithi001 ceph-mon[30939]: pgmap v348: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:04:28.050 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:04:28.050 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:28.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:27 smithi064 ceph-mon[35179]: pgmap v348: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:04:28.147 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:28.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:27 smithi022 ceph-mon[35107]: pgmap v348: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:04:28.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 -- 172.21.15.1:0/2064343416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8103780 msgr2=0x7fd5c8107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/2064343416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8103780 0x7fd5c8107bc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009930 tx=0x7fd5b402a420 comp rx=0 tx=0).stop 2024-09-19T09:04:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 -- 172.21.15.1:0/2064343416 shutdown_connections 2024-09-19T09:04:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/2064343416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5c8108300 0x7fd5c810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/2064343416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8103780 0x7fd5c8107bc0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/2064343416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c8102dd0 0x7fd5c81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 -- 172.21.15.1:0/2064343416 >> 172.21.15.1:0/2064343416 conn(0x7fd5c80fc7d0 msgr2=0x7fd5c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 -- 172.21.15.1:0/2064343416 shutdown_connections 2024-09-19T09:04:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.660+0000 7fd5ced7b640 1 -- 172.21.15.1:0/2064343416 wait complete. 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ced7b640 1 Processor -- start 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ced7b640 1 -- start start 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ced7b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8102dd0 0x7fd5c81a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ced7b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c8103780 0x7fd5c81a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ced7b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5c8108300 0x7fd5c819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ced7b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c81121b0 con 0x7fd5c8102dd0 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ced7b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c8112030 con 0x7fd5c8103780 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ced7b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c8112330 con 0x7fd5c8108300 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ccb17640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8102dd0 0x7fd5c81a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ccb17640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8102dd0 0x7fd5c81a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32988/0 (socket says 172.21.15.1:32988) 2024-09-19T09:04:28.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ccb17640 1 -- 172.21.15.1:0/1457364569 learned_addr learned my addr 172.21.15.1:0/1457364569 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5c7fff640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c8103780 0x7fd5c81a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5cd318640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5c8108300 0x7fd5c819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ccb17640 1 -- 172.21.15.1:0/1457364569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5c8108300 msgr2=0x7fd5c819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ccb17640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5c8108300 0x7fd5c819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ccb17640 1 -- 172.21.15.1:0/1457364569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c8103780 msgr2=0x7fd5c81a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ccb17640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c8103780 0x7fd5c81a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.661+0000 7fd5ccb17640 1 -- 172.21.15.1:0/1457364569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c819af60 con 0x7fd5c8102dd0 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.662+0000 7fd5cd318640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5c8108300 0x7fd5c819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.662+0000 7fd5ccb17640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8102dd0 0x7fd5c81a0620 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00d950 tx=0x7fd5bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.662+0000 7fd5c5ffb640 1 -- 172.21.15.1:0/1457364569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc017030 con 0x7fd5c8102dd0 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.662+0000 7fd5c5ffb640 1 -- 172.21.15.1:0/1457364569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd5bc004020 con 0x7fd5c8102dd0 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.662+0000 7fd5c5ffb640 1 -- 172.21.15.1:0/1457364569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc004a00 con 0x7fd5c8102dd0 2024-09-19T09:04:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.662+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c819b250 con 0x7fd5c8102dd0 2024-09-19T09:04:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.662+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c81a73d0 con 0x7fd5c8102dd0 2024-09-19T09:04:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.663+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c806a7b0 con 0x7fd5c8102dd0 2024-09-19T09:04:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.665+0000 7fd5c5ffb640 1 -- 172.21.15.1:0/1457364569 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fd5bc0041d0 con 0x7fd5c8102dd0 2024-09-19T09:04:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.665+0000 7fd5c5ffb640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd5b80a32d0 0x7fd5b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.665+0000 7fd5c7fff640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd5b80a32d0 0x7fd5b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.666+0000 7fd5c5ffb640 1 -- 172.21.15.1:0/1457364569 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd5bc0cf540 con 0x7fd5c8102dd0 2024-09-19T09:04:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.666+0000 7fd5c7fff640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd5b80a32d0 0x7fd5b80a5790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009900 tx=0x7fd5b40314c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:28.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.670+0000 7fd5c5ffb640 1 -- 172.21.15.1:0/1457364569 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5bc09c0e0 con 0x7fd5c8102dd0 2024-09-19T09:04:28.767 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.915+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5c81031b0 con 0x7fd5c8102dd0 2024-09-19T09:04:28.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.915+0000 7fd5c5ffb640 1 -- 172.21.15.1:0/1457364569 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7fd5bc09b9e0 con 0x7fd5c8102dd0 2024-09-19T09:04:28.916 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:04:28.916 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:04:28.916 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.917+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd5b80a32d0 msgr2=0x7fd5b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd5b80a32d0 0x7fd5b80a5790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009900 tx=0x7fd5b40314c0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8102dd0 msgr2=0x7fd5c81a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8102dd0 0x7fd5c81a0620 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00d950 tx=0x7fd5bc00de10 comp rx=0 tx=0).stop 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 shutdown_connections 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd5b80a32d0 0x7fd5b80a5790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5c8108300 0x7fd5c819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c8103780 0x7fd5c81a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 --2- 172.21.15.1:0/1457364569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c8102dd0 0x7fd5c81a0620 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 >> 172.21.15.1:0/1457364569 conn(0x7fd5c80fc7d0 msgr2=0x7fd5c8100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:28.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 shutdown_connections 2024-09-19T09:04:28.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:28.918+0000 7fd5ced7b640 1 -- 172.21.15.1:0/1457364569 wait complete. 2024-09-19T09:04:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.414+0000 7ff99bb3b640 1 -- 172.21.15.1:0/2195126041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9941027a0 msgr2=0x7ff9941067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.414+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/2195126041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9941027a0 0x7ff9941067f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff984009900 tx=0x7ff98402a410 comp rx=0 tx=0).stop 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.414+0000 7ff99bb3b640 1 -- 172.21.15.1:0/2195126041 shutdown_connections 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.414+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/2195126041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff994106f20 0x7ff99410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.414+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/2195126041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9941027a0 0x7ff9941067f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.414+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/2195126041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff994101df0 0x7ff9941021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.414+0000 7ff99bb3b640 1 -- 172.21.15.1:0/2195126041 >> 172.21.15.1:0/2195126041 conn(0x7ff9940fd8f0 msgr2=0x7ff9940ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 -- 172.21.15.1:0/2195126041 shutdown_connections 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 -- 172.21.15.1:0/2195126041 wait complete. 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 Processor -- start 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 -- start start 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff994101df0 0x7ff9940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff994106f20 0x7ff994074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff9941120a0 con 0x7ff994106f20 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff994111f20 con 0x7ff9941027a0 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.415+0000 7ff99bb3b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff994112220 con 0x7ff994101df0 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff994106f20 0x7ff994074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff994106f20 0x7ff994074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33010/0 (socket says 172.21.15.1:33010) 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 -- 172.21.15.1:0/336841788 learned_addr learned my addr 172.21.15.1:0/336841788 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff9990d6640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff9998d7640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff994101df0 0x7ff9940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 -- 172.21.15.1:0/336841788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff994101df0 msgr2=0x7ff9940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff994101df0 0x7ff9940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 -- 172.21.15.1:0/336841788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9941027a0 msgr2=0x7ff994074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 -- 172.21.15.1:0/336841788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9941a6a40 con 0x7ff994106f20 2024-09-19T09:04:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99a0d8640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff994106f20 0x7ff994074f70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00eb10 tx=0x7ff98c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff98affd640 1 -- 172.21.15.1:0/336841788 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c004b20 con 0x7ff994106f20 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9941a6d30 con 0x7ff994106f20 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff98affd640 1 -- 172.21.15.1:0/336841788 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff98c004cc0 con 0x7ff994106f20 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.416+0000 7ff98affd640 1 -- 172.21.15.1:0/336841788 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0107f0 con 0x7ff994106f20 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.417+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9941a7240 con 0x7ff994106f20 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.418+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9941021d0 con 0x7ff994106f20 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.419+0000 7ff98affd640 1 -- 172.21.15.1:0/336841788 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7ff98c005020 con 0x7ff994106f20 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.420+0000 7ff98affd640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9800a32d0 0x7ff9800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.420+0000 7ff9998d7640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9800a32d0 0x7ff9800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.420+0000 7ff98affd640 1 -- 172.21.15.1:0/336841788 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff98c0cff80 con 0x7ff994106f20 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.420+0000 7ff9998d7640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9800a32d0 0x7ff9800a5790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff990009bd0 tx=0x7ff990005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:29.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.425+0000 7ff98affd640 1 -- 172.21.15.1:0/336841788 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff98c09cb20 con 0x7ff994106f20 2024-09-19T09:04:29.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.676+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff99410a100 con 0x7ff994106f20 2024-09-19T09:04:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.677+0000 7ff98affd640 1 -- 172.21.15.1:0/336841788 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7ff98c09c420 con 0x7ff994106f20 2024-09-19T09:04:29.677 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:04:29.678 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:04:29.678 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:04:29.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9800a32d0 msgr2=0x7ff9800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:29.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9800a32d0 0x7ff9800a5790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff990009bd0 tx=0x7ff990005f90 comp rx=0 tx=0).stop 2024-09-19T09:04:29.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff994106f20 msgr2=0x7ff994074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:29.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff994106f20 0x7ff994074f70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00eb10 tx=0x7ff98c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 shutdown_connections 2024-09-19T09:04:29.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff994106f20 0x7ff994074f70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9941027a0 0x7ff994074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff9800a32d0 0x7ff9800a5790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 --2- 172.21.15.1:0/336841788 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff994101df0 0x7ff9940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.679+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 >> 172.21.15.1:0/336841788 conn(0x7ff9940fd8f0 msgr2=0x7ff9940fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.680+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 shutdown_connections 2024-09-19T09:04:29.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:29.680+0000 7ff99bb3b640 1 -- 172.21.15.1:0/336841788 wait complete. 2024-09-19T09:04:29.915 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T09:04:29.915 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T09:04:29.939 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:29 smithi001 ceph-mon[30939]: pgmap v349: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:29.939 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:29 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1457364569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:29.939 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:29 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/336841788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:29 smithi064 ceph-mon[35179]: pgmap v349: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:29 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1457364569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:29 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/336841788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:30.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:29 smithi022 ceph-mon[35107]: pgmap v349: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:04:30.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:29 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1457364569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:30.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:29 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/336841788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:30.593 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:04:30.679 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 -- 172.21.15.1:0/3920960868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0102d90 msgr2=0x7f57b0103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 --2- 172.21.15.1:0/3920960868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0102d90 0x7f57b0103170 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009930 tx=0x7f57ac02a420 comp rx=0 tx=0).stop 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 -- 172.21.15.1:0/3920960868 shutdown_connections 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 --2- 172.21.15.1:0/3920960868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57b0108290 0x7f57b010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 --2- 172.21.15.1:0/3920960868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57b0103740 0x7f57b0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 --2- 172.21.15.1:0/3920960868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0102d90 0x7f57b0103170 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 -- 172.21.15.1:0/3920960868 >> 172.21.15.1:0/3920960868 conn(0x7f57b00fc7d0 msgr2=0x7f57b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 -- 172.21.15.1:0/3920960868 shutdown_connections 2024-09-19T09:04:31.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.205+0000 7f57b7d17640 1 -- 172.21.15.1:0/3920960868 wait complete. 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b7d17640 1 Processor -- start 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b7d17640 1 -- start start 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b7d17640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57b0102d90 0x7f57b01009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b7d17640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57b0103740 0x7f57b0100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b7d17640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0108290 0x7f57b0101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b7d17640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01121b0 con 0x7f57b0108290 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b7d17640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0112030 con 0x7f57b0102d90 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b7d17640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0112330 con 0x7f57b0103740 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b62b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0108290 0x7f57b0101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b62b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0108290 0x7f57b0101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33030/0 (socket says 172.21.15.1:33030) 2024-09-19T09:04:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b5ab3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57b0102d90 0x7f57b01009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.206+0000 7f57b62b4640 1 -- 172.21.15.1:0/1385507747 learned_addr learned my addr 172.21.15.1:0/1385507747 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b52b2640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57b0103740 0x7f57b0100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b62b4640 1 -- 172.21.15.1:0/1385507747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57b0103740 msgr2=0x7f57b0100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b62b4640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57b0103740 0x7f57b0100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b62b4640 1 -- 172.21.15.1:0/1385507747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57b0102d90 msgr2=0x7f57b01009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b62b4640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57b0102d90 0x7f57b01009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b62b4640 1 -- 172.21.15.1:0/1385507747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b01a6af0 con 0x7f57b0108290 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b62b4640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0108290 0x7f57b0101470 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f57a800eb10 tx=0x7f57a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57a6ffd640 1 -- 172.21.15.1:0/1385507747 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8004b20 con 0x7f57b0108290 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b7d17640 1 -- 172.21.15.1:0/1385507747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b01a6de0 con 0x7f57b0108290 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57a6ffd640 1 -- 172.21.15.1:0/1385507747 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57a8004cc0 con 0x7f57b0108290 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57a6ffd640 1 -- 172.21.15.1:0/1385507747 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a80107f0 con 0x7f57b0108290 2024-09-19T09:04:31.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.207+0000 7f57b7d17640 1 -- 172.21.15.1:0/1385507747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b01a72a0 con 0x7f57b0108290 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57a6ffd640 1 -- 172.21.15.1:0/1385507747 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f57a8005020 con 0x7f57b0108290 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57ba0f0740 1 Processor -- start 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57ba0f0740 1 -- start start 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 0x559dfa34db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa358400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa35ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559dfa2b32a0 con 0x559dfa358940 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559dfa25ab10 con 0x559dfa34d760 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.210+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559dfa2af260 con 0x559dfa34e080 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57a6ffd640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f579c0a32d0 0x7f579c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa35ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa35ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33044/0 (socket says 172.21.15.1:33044) 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 -- 172.21.15.1:0/2784386917 learned_addr learned my addr 172.21.15.1:0/2784386917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/2784386917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa358400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b62b4640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f579c0a32d0 0x7f579c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57a6ffd640 1 -- 172.21.15.1:0/1385507747 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f57a80d0000 con 0x7f57b0108290 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 -- 172.21.15.1:0/2784386917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 msgr2=0x559dfa358400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 --2- 172.21.15.1:0/2784386917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa358400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 -- 172.21.15.1:0/2784386917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 msgr2=0x559dfa34db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 --2- 172.21.15.1:0/2784386917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 0x559dfa34db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 -- 172.21.15.1:0/2784386917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dfa024b90 con 0x559dfa358940 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b52b2640 1 --2- 172.21.15.1:0/2784386917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa35ad30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f57a000ccf0 tx=0x7f57a00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13908e8820b92108 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.211+0000 7f57b62b4640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f579c0a32d0 0x7f579c0a5790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f57a809c4d0 tx=0x7f57a8091a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f579bfff640 1 -- 172.21.15.1:0/2784386917 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0005020 con 0x559dfa358940 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f579bfff640 1 -- 172.21.15.1:0/2784386917 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57a00047a0 con 0x559dfa358940 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f579bfff640 1 -- 172.21.15.1:0/2784386917 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0012850 con 0x559dfa358940 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f57ba0f0740 1 -- 172.21.15.1:0/2784386917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 msgr2=0x559dfa35ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/2784386917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa35ad30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f57a000ccf0 tx=0x7f57a00117b0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f57ba0f0740 1 -- 172.21.15.1:0/2784386917 shutdown_connections 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/2784386917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa35ad30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/2784386917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa358400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/2784386917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 0x559dfa34db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.212+0000 7f57ba0f0740 1 -- 172.21.15.1:0/2784386917 >> 172.21.15.1:0/2784386917 conn(0x559dfa349cf0 msgr2=0x559dfa34a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.213+0000 7f57ba0f0740 1 -- 172.21.15.1:0/2784386917 shutdown_connections 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.213+0000 7f57ba0f0740 1 -- 172.21.15.1:0/2784386917 wait complete. 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.213+0000 7f57ba0f0740 1 -- start start 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.213+0000 7f57ba0f0740 1 Processor -- start 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa34d760 0x559dfa355890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa355dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa358940 0x559dfa356310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559dfa35b510 con 0x559dfa34d760 2024-09-19T09:04:31.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559dfa23b6e0 con 0x559dfa358940 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559dfa35b690 con 0x559dfa34e080 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57ba0f0740 10 client.0 _ll_register_callbacks cb 0x559dfa25fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa34d760 0x559dfa355890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa34d760 0x559dfa355890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33046/0 (socket says 172.21.15.1:33046) 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 -- 172.21.15.1:0/3249140510 learned_addr learned my addr 172.21.15.1:0/3249140510 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b5ab3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa355dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa358940 0x559dfa356310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 -- 172.21.15.1:0/3249140510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 msgr2=0x559dfa355dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa355dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 -- 172.21.15.1:0/3249140510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa358940 msgr2=0x559dfa356310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa358940 0x559dfa356310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 -- 172.21.15.1:0/3249140510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dfa364a80 con 0x559dfa34d760 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57b52b2640 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa34d760 0x559dfa355890 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f57a0001eb0 tx=0x7f57a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcb43042c0f2890 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.214+0000 7f57997fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57997fa640 1 -- 172.21.15.1:0/3249140510 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0005530 con 0x559dfa34d760 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57997fa640 1 -- 172.21.15.1:0/3249140510 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f57a0004030 con 0x559dfa34d760 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 1 -- 172.21.15.1:0/3249140510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a00047a0 con 0x559dfa34d760 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57997fa640 1 -- 172.21.15.1:0/3249140510 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f57a0004230 con 0x559dfa34d760 2024-09-19T09:04:31.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 10 client.15429 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 1 -- 172.21.15.1:0/3249140510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559dfa3673f0 con 0x559dfa34d760 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57997fa640 1 -- 172.21.15.1:0/3249140510 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57a00047a0 con 0x559dfa34d760 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57997fa640 1 -- 172.21.15.1:0/3249140510 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f57a0028070 con 0x559dfa34d760 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 10 client.15429 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 10 client.15429 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 20 client.15429 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559dfa3687f0 0x559dfa36abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 4 client.15429 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.215+0000 7f57ba0f0740 1 -- 172.21.15.1:0/3249140510 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dfa2c09d0 con 0x559dfa3687f0 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.216+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559dfa3687f0 0x559dfa36abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.216+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559dfa3687f0 0x559dfa36abe0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=262a04428853ed2b server_cookie=73d0ca7a51f8f5f4 in_seq=0 out_seq=0 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.216+0000 7f57997fa640 10 client.15429 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:31.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57997fa640 1 -- 172.21.15.1:0/3249140510 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559dfa2c09d0 con 0x559dfa3687f0 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57997fa640 10 client.15429 handle_command_reply: tid=0 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 client.15429 shutdown 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 -- 172.21.15.1:0/3249140510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa34d760 msgr2=0x559dfa355890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa34d760 0x559dfa355890 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f57a0001eb0 tx=0x7f57a00046c0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 -- 172.21.15.1:0/3249140510 shutdown_connections 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559dfa3687f0 0x559dfa36abe0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa358940 0x559dfa356310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57997fa640 0 client.15429 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa355dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/3249140510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa34d760 0x559dfa355890 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 -- 172.21.15.1:0/3249140510 >> 172.21.15.1:0/3249140510 conn(0x559dfa349cf0 msgr2=0x559dfa34f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 -- 172.21.15.1:0/3249140510 shutdown_connections 2024-09-19T09:04:31.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 1 -- 172.21.15.1:0/3249140510 wait complete. 2024-09-19T09:04:31.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.217+0000 7f57ba0f0740 20 client.15429 trim_cache size 0 max 16384 2024-09-19T09:04:31.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.235+0000 7f57ba0f0740 1 Processor -- start 2024-09-19T09:04:31.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.235+0000 7f57ba0f0740 1 -- start start 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.235+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 0x559dfa357760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.235+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa36dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.235+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa36e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.235+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01b2200 con 0x559dfa358940 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.235+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01afad0 con 0x559dfa34d760 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.235+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01ad920 con 0x559dfa34e080 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b52b2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 0x559dfa357760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa36dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa36dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:37474/0 (socket says 172.21.15.1:37474) 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 -- 172.21.15.1:0/1917838825 learned_addr learned my addr 172.21.15.1:0/1917838825 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b52b2640 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa36e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 -- 172.21.15.1:0/1917838825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 msgr2=0x559dfa357760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 0x559dfa357760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 -- 172.21.15.1:0/1917838825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 msgr2=0x559dfa36e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa36e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 -- 172.21.15.1:0/1917838825 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dfa34de70 con 0x559dfa34e080 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b52b2640 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa36e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.236+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa36dc00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0096c0 tx=0x7f57ac000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef209f75510affe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.237+0000 7f579b7fe640 1 -- 172.21.15.1:0/1917838825 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac035040 con 0x559dfa34e080 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.237+0000 7f579b7fe640 1 -- 172.21.15.1:0/1917838825 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57ac005520 con 0x559dfa34e080 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.237+0000 7f579b7fe640 1 -- 172.21.15.1:0/1917838825 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac004d00 con 0x559dfa34e080 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 -- 172.21.15.1:0/1917838825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 msgr2=0x559dfa36dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa36dc00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0096c0 tx=0x7f57ac000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 -- 172.21.15.1:0/1917838825 shutdown_connections 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa36e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34e080 0x559dfa36dc00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/1917838825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34d760 0x559dfa357760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 -- 172.21.15.1:0/1917838825 >> 172.21.15.1:0/1917838825 conn(0x559dfa349cf0 msgr2=0x559dfa34f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 -- 172.21.15.1:0/1917838825 shutdown_connections 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 -- 172.21.15.1:0/1917838825 wait complete. 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.238+0000 7f57ba0f0740 1 -- start start 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57ba0f0740 1 Processor -- start 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34d760 0x559dfa36bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34e080 0x559dfa36c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57ba0f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa3da940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01adf90 con 0x559dfa358940 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01af400 con 0x559dfa34e080 2024-09-19T09:04:31.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57ba0f0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01ae660 con 0x559dfa34d760 2024-09-19T09:04:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57ba0f0740 10 client.0 _ll_register_callbacks cb 0x7f57a0004de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57b52b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa3da940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57b52b2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa3da940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33074/0 (socket says 172.21.15.1:33074) 2024-09-19T09:04:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57b52b2640 1 -- 172.21.15.1:0/986553479 learned_addr learned my addr 172.21.15.1:0/986553479 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.239+0000 7f57b52b2640 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34d760 0x559dfa36bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57b52b2640 1 -- 172.21.15.1:0/986553479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34d760 msgr2=0x559dfa36bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57b52b2640 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34d760 0x559dfa36bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57b52b2640 1 -- 172.21.15.1:0/986553479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34e080 msgr2=0x559dfa36c310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:04:31.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34e080 0x559dfa36c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57b52b2640 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34e080 0x559dfa36c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57b52b2640 1 -- 172.21.15.1:0/986553479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dfa3dae80 con 0x559dfa358940 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57b52b2640 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa3da940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f57a0012bc0 tx=0x7f57a0004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5395780e25a53a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57997fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57997fa640 1 -- 172.21.15.1:0/986553479 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0030020 con 0x559dfa358940 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57997fa640 1 -- 172.21.15.1:0/986553479 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f57a0005530 con 0x559dfa358940 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.240+0000 7f57ba0f0740 1 -- 172.21.15.1:0/986553479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ac005520 con 0x559dfa358940 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57997fa640 1 -- 172.21.15.1:0/986553479 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f57a0005ae0 con 0x559dfa358940 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57ba0f0740 10 client.15435 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57ba0f0740 1 -- 172.21.15.1:0/986553479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559dfa3dc040 con 0x559dfa358940 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57997fa640 1 -- 172.21.15.1:0/986553479 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57ac005520 con 0x559dfa358940 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57997fa640 1 -- 172.21.15.1:0/986553479 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f57a0028070 con 0x559dfa358940 2024-09-19T09:04:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57ba0f0740 10 client.15435 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57ba0f0740 10 client.15435 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:04:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57ba0f0740 20 client.15435 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559dfa3687f0 0x559dfa3de7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57ba0f0740 4 client.15435 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T09:04:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.241+0000 7f57ba0f0740 1 -- 172.21.15.1:0/986553479 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x559dfa2bad20 con 0x559dfa3687f0 2024-09-19T09:04:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.242+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559dfa3687f0 0x559dfa3de7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.242+0000 7f57997fa640 10 client.15435 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.242+0000 7f57b5ab3640 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559dfa3687f0 0x559dfa3de7b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b36a6e68534628ef server_cookie=3060005b9befa1de in_seq=0 out_seq=0 2024-09-19T09:04:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57997fa640 1 -- 172.21.15.1:0/986553479 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559dfa2bad20 con 0x559dfa3687f0 2024-09-19T09:04:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57997fa640 10 client.15435 handle_command_reply: tid=0 2024-09-19T09:04:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 client.15435 shutdown 2024-09-19T09:04:31.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 -- 172.21.15.1:0/986553479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 msgr2=0x559dfa3da940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa3da940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f57a0012bc0 tx=0x7f57a0004c60 comp rx=0 tx=0).stop 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 -- 172.21.15.1:0/986553479 shutdown_connections 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559dfa3687f0 0x559dfa3de7b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559dfa358940 0x559dfa3da940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559dfa34e080 0x559dfa36c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 --2- 172.21.15.1:0/986553479 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559dfa34d760 0x559dfa36bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 -- 172.21.15.1:0/986553479 >> 172.21.15.1:0/986553479 conn(0x559dfa349cf0 msgr2=0x559dfa354030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57997fa640 0 client.15435 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 -- 172.21.15.1:0/986553479 shutdown_connections 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 1 -- 172.21.15.1:0/986553479 wait complete. 2024-09-19T09:04:31.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.253+0000 7f57ba0f0740 20 client.15435 trim_cache size 0 max 16384 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 24, 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 2, 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "d052e046": { 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 2, 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:04:31.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 131.2, 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:31.256 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:04:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 -- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f579c0a32d0 msgr2=0x7f579c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f579c0a32d0 0x7f579c0a5790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f57a809c4d0 tx=0x7f57a8091a20 comp rx=0 tx=0).stop 2024-09-19T09:04:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 -- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0108290 msgr2=0x7f57b0101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0108290 0x7f57b0101470 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f57a800eb10 tx=0x7f57a800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 -- 172.21.15.1:0/1385507747 shutdown_connections 2024-09-19T09:04:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b0108290 0x7f57b0101470 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f579c0a32d0 0x7f579c0a5790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57b0103740 0x7f57b0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 --2- 172.21.15.1:0/1385507747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57b0102d90 0x7f57b01009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.254+0000 7f57b7d17640 1 -- 172.21.15.1:0/1385507747 >> 172.21.15.1:0/1385507747 conn(0x7f57b00fc7d0 msgr2=0x7f57b0105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.255+0000 7f57b7d17640 1 -- 172.21.15.1:0/1385507747 shutdown_connections 2024-09-19T09:04:31.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:31.255+0000 7f57b7d17640 1 -- 172.21.15.1:0/1385507747 wait complete. 2024-09-19T09:04:31.456 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 -- 172.21.15.1:0/4159876858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c102dc0 msgr2=0x7ff94c103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 --2- 172.21.15.1:0/4159876858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c102dc0 0x7ff94c103240 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff938009900 tx=0x7ff93802a410 comp rx=0 tx=0).stop 2024-09-19T09:04:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 -- 172.21.15.1:0/4159876858 shutdown_connections 2024-09-19T09:04:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 --2- 172.21.15.1:0/4159876858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff94c103780 0x7ff94c10a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 --2- 172.21.15.1:0/4159876858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c102dc0 0x7ff94c103240 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 --2- 172.21.15.1:0/4159876858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94c0ffdf0 0x7ff94c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 -- 172.21.15.1:0/4159876858 >> 172.21.15.1:0/4159876858 conn(0x7ff94c0fb930 msgr2=0x7ff94c0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 -- 172.21.15.1:0/4159876858 shutdown_connections 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.690+0000 7ff95314b640 1 -- 172.21.15.1:0/4159876858 wait complete. 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff95314b640 1 Processor -- start 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff95314b640 1 -- start start 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff95314b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c0ffdf0 0x7ff94c102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff95314b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff94c102dc0 0x7ff94c100d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff95314b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94c103780 0x7ff94c1012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff95314b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c10d900 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff95314b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c10d780 con 0x7ff94c102dc0 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff95314b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c10da80 con 0x7ff94c103780 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff950ee7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c0ffdf0 0x7ff94c102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff950ee7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c0ffdf0 0x7ff94c102730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33082/0 (socket says 172.21.15.1:33082) 2024-09-19T09:04:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff950ee7640 1 -- 172.21.15.1:0/2821657188 learned_addr learned my addr 172.21.15.1:0/2821657188 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff9516e8640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94c103780 0x7ff94c1012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.691+0000 7ff94bfff640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff94c102dc0 0x7ff94c100d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff950ee7640 1 -- 172.21.15.1:0/2821657188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94c103780 msgr2=0x7ff94c1012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff950ee7640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94c103780 0x7ff94c1012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff950ee7640 1 -- 172.21.15.1:0/2821657188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff94c102dc0 msgr2=0x7ff94c100d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff950ee7640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff94c102dc0 0x7ff94c100d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff950ee7640 1 -- 172.21.15.1:0/2821657188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c101b40 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff9516e8640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94c103780 0x7ff94c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff950ee7640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c0ffdf0 0x7ff94c102730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9c0 tx=0x7ff94000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff949ffb640 1 -- 172.21.15.1:0/2821657188 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94000cd80 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff95314b640 1 -- 172.21.15.1:0/2821657188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94c1a2070 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff949ffb640 1 -- 172.21.15.1:0/2821657188 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9400035f0 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff949ffb640 1 -- 172.21.15.1:0/2821657188 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940010670 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.692+0000 7ff95314b640 1 -- 172.21.15.1:0/2821657188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94c1a2590 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff955fc5740 1 Processor -- start 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff955fc5740 1 -- start start 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 0x560a134d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134d5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff955fc5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a134312f0 con 0x560a134d3370 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff955fc5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560a133d9270 con 0x560a134ce2e0 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff955fc5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560a1342d2b0 con 0x560a134cd9a0 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff94bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff94bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134d5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33094/0 (socket says 172.21.15.1:33094) 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff94bfff640 1 -- 172.21.15.1:0/813868770 learned_addr learned my addr 172.21.15.1:0/813868770 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff9516e8640 1 --2- 172.21.15.1:0/813868770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff949ffb640 1 -- 172.21.15.1:0/2821657188 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7ff9400037a0 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff94bfff640 1 -- 172.21.15.1:0/813868770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 msgr2=0x560a134cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff94bfff640 1 --2- 172.21.15.1:0/813868770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff94bfff640 1 -- 172.21.15.1:0/813868770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 msgr2=0x560a134d2da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:04:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.695+0000 7ff94bfff640 1 --2- 172.21.15.1:0/813868770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 0x560a134d2da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.696+0000 7ff94bfff640 1 -- 172.21.15.1:0/813868770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a133d8340 con 0x560a134d3370 2024-09-19T09:04:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.696+0000 7ff94bfff640 1 --2- 172.21.15.1:0/813868770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134d5830 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff93802a930 tx=0x7ff938005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1e1303386dc110 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.696+0000 7ff936ffd640 1 -- 172.21.15.1:0/813868770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93803f070 con 0x560a134d3370 2024-09-19T09:04:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.696+0000 7ff936ffd640 1 -- 172.21.15.1:0/813868770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff938031740 con 0x560a134d3370 2024-09-19T09:04:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.696+0000 7ff936ffd640 1 -- 172.21.15.1:0/813868770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938035070 con 0x560a134d3370 2024-09-19T09:04:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.696+0000 7ff949ffb640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff93c0a32d0 0x7ff93c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.696+0000 7ff9516e8640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff93c0a32d0 0x7ff93c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff949ffb640 1 -- 172.21.15.1:0/2821657188 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff9400cffd0 con 0x7ff94c0ffdf0 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 -- 172.21.15.1:0/813868770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 msgr2=0x560a134d5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 --2- 172.21.15.1:0/813868770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134d5830 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff93802a930 tx=0x7ff938005de0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff9516e8640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff93c0a32d0 0x7ff93c0a5790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff944005fd0 tx=0x7ff944009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 -- 172.21.15.1:0/813868770 shutdown_connections 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 --2- 172.21.15.1:0/813868770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134d5830 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 --2- 172.21.15.1:0/813868770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 0x560a134d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 --2- 172.21.15.1:0/813868770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 -- 172.21.15.1:0/813868770 >> 172.21.15.1:0/813868770 conn(0x560a134c9010 msgr2=0x560a134c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 -- 172.21.15.1:0/813868770 shutdown_connections 2024-09-19T09:04:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 -- 172.21.15.1:0/813868770 wait complete. 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 -- start start 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.697+0000 7ff955fc5740 1 Processor -- start 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134cd9a0 0x560a134d7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134ce2e0 0x560a134d8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134df140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff955fc5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560a134d62e0 con 0x560a134d3370 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff955fc5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560a133ba290 con 0x560a134cd9a0 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff955fc5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560a134d6460 con 0x560a134ce2e0 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff955fc5740 10 client.0 _ll_register_callbacks cb 0x560a133eb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff9516e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134df140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff9516e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134df140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33096/0 (socket says 172.21.15.1:33096) 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff9516e8640 1 -- 172.21.15.1:0/2173976558 learned_addr learned my addr 172.21.15.1:0/2173976558 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff950ee7640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134cd9a0 0x560a134d7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff94bfff640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134ce2e0 0x560a134d8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff9516e8640 1 -- 172.21.15.1:0/2173976558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134ce2e0 msgr2=0x560a134d8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff9516e8640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134ce2e0 0x560a134d8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff9516e8640 1 -- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134cd9a0 msgr2=0x560a134d7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff9516e8640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134cd9a0 0x560a134d7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff9516e8640 1 -- 172.21.15.1:0/2173976558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a13144210 con 0x560a134d3370 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff950ee7640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134cd9a0 0x560a134d7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.698+0000 7ff94bfff640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134ce2e0 0x560a134d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff9516e8640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134df140 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff94401d8d0 tx=0x7ff944004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e6a1e1c7837f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff92bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff92bfff640 1 -- 172.21.15.1:0/2173976558 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff944027630 con 0x560a134d3370 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff92bfff640 1 -- 172.21.15.1:0/2173976558 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff94401e410 con 0x560a134d3370 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff955fc5740 1 -- 172.21.15.1:0/2173976558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff938031740 con 0x560a134d3370 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff92bfff640 1 -- 172.21.15.1:0/2173976558 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9440277d0 con 0x560a134d3370 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff955fc5740 10 client.15447 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff955fc5740 1 -- 172.21.15.1:0/2173976558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560a13210620 con 0x560a134d3370 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff92bfff640 1 -- 172.21.15.1:0/2173976558 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff938031740 con 0x560a134d3370 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.699+0000 7ff92bfff640 1 -- 172.21.15.1:0/2173976558 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff94400f040 con 0x560a134d3370 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff955fc5740 10 client.15447 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff955fc5740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff955fc5740 20 client.15447 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560a134e3890 0x560a134e5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff955fc5740 4 client.15447 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff955fc5740 1 -- 172.21.15.1:0/2173976558 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a1343ea20 con 0x560a134e3890 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff950ee7640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560a134e3890 0x560a134e5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff950ee7640 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560a134e3890 0x560a134e5c80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce003bb8aaa410a0 server_cookie=984b5f3d17882664 in_seq=0 out_seq=0 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.700+0000 7ff92bfff640 10 client.15447 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff92bfff640 1 -- 172.21.15.1:0/2173976558 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a1343ea20 con 0x560a134e3890 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff92bfff640 10 client.15447 handle_command_reply: tid=0 2024-09-19T09:04:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 client.15447 shutdown 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 -- 172.21.15.1:0/2173976558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 msgr2=0x560a134df140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134df140 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff94401d8d0 tx=0x7ff944004a40 comp rx=0 tx=0).stop 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 -- 172.21.15.1:0/2173976558 shutdown_connections 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560a134e3890 0x560a134e5c80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134df140 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134ce2e0 0x560a134d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff92bfff640 0 client.15447 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2173976558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134cd9a0 0x560a134d7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 -- 172.21.15.1:0/2173976558 >> 172.21.15.1:0/2173976558 conn(0x560a134c9010 msgr2=0x560a134ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 -- 172.21.15.1:0/2173976558 shutdown_connections 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.701+0000 7ff955fc5740 1 -- 172.21.15.1:0/2173976558 wait complete. 2024-09-19T09:04:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.702+0000 7ff955fc5740 20 client.15447 trim_cache size 0 max 16384 2024-09-19T09:04:31.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.721+0000 7ff955fc5740 1 Processor -- start 2024-09-19T09:04:31.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.721+0000 7ff955fc5740 1 -- start start 2024-09-19T09:04:31.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.721+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.721+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134ce2e0 0x560a134df100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.721+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134d3370 0x560a134c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.721+0000 7ff955fc5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c1adc00 con 0x560a134ce2e0 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.721+0000 7ff955fc5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c1ab4d0 con 0x560a134d3370 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.721+0000 7ff955fc5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c1a9320 con 0x560a134cd9a0 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134ce2e0 0x560a134df100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134ce2e0 0x560a134df100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33106/0 (socket says 172.21.15.1:33106) 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 -- 172.21.15.1:0/2235162606 learned_addr learned my addr 172.21.15.1:0/2235162606 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff950ee7640 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff9516e8640 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134d3370 0x560a134c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 -- 172.21.15.1:0/2235162606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 msgr2=0x560a134cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 -- 172.21.15.1:0/2235162606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134d3370 msgr2=0x560a134c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134d3370 0x560a134c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 -- 172.21.15.1:0/2235162606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a134c8e30 con 0x560a134ce2e0 2024-09-19T09:04:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff94bfff640 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134ce2e0 0x560a134df100 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x560a134c9e90 tx=0x7ff938032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82ed01e320a8e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff9367fc640 1 -- 172.21.15.1:0/2235162606 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93803f070 con 0x560a134ce2e0 2024-09-19T09:04:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff9367fc640 1 -- 172.21.15.1:0/2235162606 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff93804b070 con 0x560a134ce2e0 2024-09-19T09:04:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.722+0000 7ff9367fc640 1 -- 172.21.15.1:0/2235162606 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938035040 con 0x560a134ce2e0 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 -- 172.21.15.1:0/2235162606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134ce2e0 msgr2=0x560a134df100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134ce2e0 0x560a134df100 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x560a134c9e90 tx=0x7ff938032f30 comp rx=0 tx=0).stop 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 -- 172.21.15.1:0/2235162606 shutdown_connections 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134d3370 0x560a134c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134ce2e0 0x560a134df100 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 --2- 172.21.15.1:0/2235162606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 -- 172.21.15.1:0/2235162606 >> 172.21.15.1:0/2235162606 conn(0x560a134c9010 msgr2=0x560a134d7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 -- 172.21.15.1:0/2235162606 shutdown_connections 2024-09-19T09:04:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.723+0000 7ff955fc5740 1 -- 172.21.15.1:0/2235162606 wait complete. 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 1 -- start start 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 1 Processor -- start 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134dc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 0x560a134dc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134dd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c1a9990 con 0x560a134d3370 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c1aae00 con 0x560a134ce2e0 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c1aa060 con 0x560a134cd9a0 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff955fc5740 10 client.0 _ll_register_callbacks cb 0x7ff944009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff950ee7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134dc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff9516e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134dd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff950ee7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134dc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:37534/0 (socket says 172.21.15.1:37534) 2024-09-19T09:04:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff94bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 0x560a134dc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.724+0000 7ff950ee7640 1 -- 172.21.15.1:0/3861399248 learned_addr learned my addr 172.21.15.1:0/3861399248 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff9516e8640 1 -- 172.21.15.1:0/3861399248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 msgr2=0x560a134dc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff9516e8640 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134dc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff9516e8640 1 -- 172.21.15.1:0/3861399248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 msgr2=0x560a134dc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff9516e8640 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 0x560a134dc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff9516e8640 1 -- 172.21.15.1:0/3861399248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a134ddf60 con 0x560a134d3370 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff950ee7640 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134dc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff94bfff640 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 0x560a134dc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff9516e8640 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134dd950 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff9440315a0 tx=0x7ff944031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460444226c1aa7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff92bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff92bfff640 1 -- 172.21.15.1:0/3861399248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94403e060 con 0x560a134d3370 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff92bfff640 1 -- 172.21.15.1:0/3861399248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff944031d40 con 0x560a134d3370 2024-09-19T09:04:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff955fc5740 1 -- 172.21.15.1:0/3861399248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff93804b070 con 0x560a134d3370 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff92bfff640 1 -- 172.21.15.1:0/3861399248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff944004ab0 con 0x560a134d3370 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff955fc5740 10 client.15453 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.725+0000 7ff955fc5740 1 -- 172.21.15.1:0/3861399248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560a134df270 con 0x560a134d3370 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff92bfff640 1 -- 172.21.15.1:0/3861399248 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff93804b070 con 0x560a134d3370 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff92bfff640 1 -- 172.21.15.1:0/3861399248 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff9440052d0 con 0x560a134d3370 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff955fc5740 10 client.15453 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff955fc5740 10 client.15453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff955fc5740 20 client.15453 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff955fc5740 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560a1354ea60 0x560a13550e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff955fc5740 4 client.15453 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff955fc5740 1 -- 172.21.15.1:0/3861399248 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a13438d70 con 0x560a1354ea60 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.726+0000 7ff950ee7640 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560a1354ea60 0x560a13550e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.727+0000 7ff92bfff640 10 client.15453 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.727+0000 7ff950ee7640 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560a1354ea60 0x560a13550e80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a6570ff2a26dc17 server_cookie=f611a47fa84adb8b in_seq=0 out_seq=0 2024-09-19T09:04:31.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff92bfff640 1 -- 172.21.15.1:0/3861399248 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a13438d70 con 0x560a1354ea60 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff92bfff640 10 client.15453 handle_command_reply: tid=0 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 client.15453 shutdown 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 -- 172.21.15.1:0/3861399248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 msgr2=0x560a134dd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134dd950 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff9440315a0 tx=0x7ff944031a20 comp rx=0 tx=0).stop 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 -- 172.21.15.1:0/3861399248 shutdown_connections 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560a1354ea60 0x560a13550e80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560a134d3370 0x560a134dd950 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560a134ce2e0 0x560a134dc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff92bfff640 0 client.15453 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 --2- 172.21.15.1:0/3861399248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560a134cd9a0 0x560a134dc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 -- 172.21.15.1:0/3861399248 >> 172.21.15.1:0/3861399248 conn(0x560a134c9010 msgr2=0x560a134c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 -- 172.21.15.1:0/3861399248 shutdown_connections 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 1 -- 172.21.15.1:0/3861399248 wait complete. 2024-09-19T09:04:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.734+0000 7ff955fc5740 20 client.15453 trim_cache size 0 max 16384 2024-09-19T09:04:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:04:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:04:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:04:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 -- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff93c0a32d0 msgr2=0x7ff93c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff93c0a32d0 0x7ff93c0a5790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff944005fd0 tx=0x7ff944009580 comp rx=0 tx=0).stop 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 -- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c0ffdf0 msgr2=0x7ff94c102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c0ffdf0 0x7ff94c102730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9c0 tx=0x7ff94000ee80 comp rx=0 tx=0).stop 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 -- 172.21.15.1:0/2821657188 shutdown_connections 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff93c0a32d0 0x7ff93c0a5790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff94c103780 0x7ff94c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff94c102dc0 0x7ff94c100d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 --2- 172.21.15.1:0/2821657188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff94c0ffdf0 0x7ff94c102730 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 -- 172.21.15.1:0/2821657188 >> 172.21.15.1:0/2821657188 conn(0x7ff94c0fb930 msgr2=0x7ff94c106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 -- 172.21.15.1:0/2821657188 shutdown_connections 2024-09-19T09:04:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:31.735+0000 7ff95314b640 1 -- 172.21.15.1:0/2821657188 wait complete. 2024-09-19T09:04:32.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:31 smithi001 ceph-mon[30939]: pgmap v350: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:04:32.002 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd052e046', quiesce took 4.5 seconds. Will release after: 6.699999999999999 2024-09-19T09:04:32.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:31 smithi064 ceph-mon[35179]: pgmap v350: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:04:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:31 smithi022 ceph-mon[35107]: pgmap v350: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:04:32.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 -- 172.21.15.1:0/4207741666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 msgr2=0x7fb738110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/4207741666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 0x7fb738110ca0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb730009ca0 tx=0x7fb73002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 -- 172.21.15.1:0/4207741666 shutdown_connections 2024-09-19T09:04:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/4207741666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 0x7fb738110ca0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/4207741666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7381049a0 0x7fb7381089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/4207741666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb738103ff0 0x7fb7381043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 -- 172.21.15.1:0/4207741666 >> 172.21.15.1:0/4207741666 conn(0x7fb7380ffab0 msgr2=0x7fb738101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 -- 172.21.15.1:0/4207741666 shutdown_connections 2024-09-19T09:04:32.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.545+0000 7fb73dd0d640 1 -- 172.21.15.1:0/4207741666 wait complete. 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb73dd0d640 1 Processor -- start 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb73dd0d640 1 -- start start 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb73dd0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb738103ff0 0x7fb73819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb73dd0d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7381049a0 0x7fb73819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb73dd0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 0x7fb73819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb73dd0d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381142a0 con 0x7fb738109120 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb73dd0d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb738114120 con 0x7fb738103ff0 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb73dd0d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb738114420 con 0x7fb7381049a0 2024-09-19T09:04:32.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb737fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 0x7fb73819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb737fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 0x7fb73819efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43852/0 (socket says 172.21.15.1:43852) 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb737fff640 1 -- 172.21.15.1:0/2164297375 learned_addr learned my addr 172.21.15.1:0/2164297375 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb7377fe640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb738103ff0 0x7fb73819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.546+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7381049a0 0x7fb73819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb737fff640 1 -- 172.21.15.1:0/2164297375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7381049a0 msgr2=0x7fb73819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb737fff640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7381049a0 0x7fb73819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb737fff640 1 -- 172.21.15.1:0/2164297375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb738103ff0 msgr2=0x7fb73819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb737fff640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb738103ff0 0x7fb73819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb737fff640 1 -- 172.21.15.1:0/2164297375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73819f6b0 con 0x7fb738109120 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7381049a0 0x7fb73819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:32.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb737fff640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 0x7fb73819efd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb730006010 tx=0x7fb7300319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb734ff9640 1 -- 172.21.15.1:0/2164297375 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73002fa20 con 0x7fb738109120 2024-09-19T09:04:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb734ff9640 1 -- 172.21.15.1:0/2164297375 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb73002fbc0 con 0x7fb738109120 2024-09-19T09:04:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb73dd0d640 1 -- 172.21.15.1:0/2164297375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73819f940 con 0x7fb738109120 2024-09-19T09:04:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb73dd0d640 1 -- 172.21.15.1:0/2164297375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7381a7280 con 0x7fb738109120 2024-09-19T09:04:32.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.547+0000 7fb734ff9640 1 -- 172.21.15.1:0/2164297375 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7300467f0 con 0x7fb738109120 2024-09-19T09:04:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb734ff9640 1 -- 172.21.15.1:0/2164297375 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fb730046990 con 0x7fb738109120 2024-09-19T09:04:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb7400e6740 1 Processor -- start 2024-09-19T09:04:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb7400e6740 1 -- start start 2024-09-19T09:04:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 0x55b90c98d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c98da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 0x55b90c99a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb7400e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b90c8f32f0 con 0x55b90c98d5d0 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb7400e6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b90c89acf0 con 0x55b90c998370 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.550+0000 7fb7400e6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b90c8ef2b0 con 0x55b90c98eb40 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb7377fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c98da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb7377fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c98da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43858/0 (socket says 172.21.15.1:43858) 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb7377fe640 1 -- 172.21.15.1:0/1672950046 learned_addr learned my addr 172.21.15.1:0/1672950046 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb734ff9640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb7200a3350 0x7fb7200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb736ffd640 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 0x55b90c99a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb736ffd640 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 0x55b90c98d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb736ffd640 1 -- 172.21.15.1:0/1672950046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 msgr2=0x55b90c98d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb737fff640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb7200a3350 0x7fb7200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb736ffd640 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 0x55b90c98d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb736ffd640 1 -- 172.21.15.1:0/1672950046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 msgr2=0x55b90c98da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb736ffd640 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c98da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb734ff9640 1 -- 172.21.15.1:0/2164297375 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb7300f0dd0 con 0x7fb738109120 2024-09-19T09:04:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb736ffd640 1 -- 172.21.15.1:0/1672950046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b90c87f3a0 con 0x55b90c998370 2024-09-19T09:04:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb7377fe640 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c98da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.551+0000 7fb736ffd640 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 0x55b90c99a760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009710 tx=0x7fb72c0096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=746cb14946259b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.552+0000 7fb71dffb640 1 -- 172.21.15.1:0/1672950046 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c004050 con 0x55b90c998370 2024-09-19T09:04:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.552+0000 7fb71dffb640 1 -- 172.21.15.1:0/1672950046 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb72c00fe10 con 0x55b90c998370 2024-09-19T09:04:32.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.552+0000 7fb71dffb640 1 -- 172.21.15.1:0/1672950046 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0055d0 con 0x55b90c998370 2024-09-19T09:04:32.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.552+0000 7fb7400e6740 1 -- 172.21.15.1:0/1672950046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 msgr2=0x55b90c99a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.552+0000 7fb737fff640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb7200a3350 0x7fb7200a5810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb730009dc0 tx=0x7fb73008f0f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.552+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 0x55b90c99a760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009710 tx=0x7fb72c0096a0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 -- 172.21.15.1:0/1672950046 shutdown_connections 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 0x55b90c99a760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c98da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1672950046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 0x55b90c98d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 -- 172.21.15.1:0/1672950046 >> 172.21.15.1:0/1672950046 conn(0x55b90c956310 msgr2=0x55b90c989c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 -- 172.21.15.1:0/1672950046 shutdown_connections 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 -- 172.21.15.1:0/1672950046 wait complete. 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 -- start start 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.553+0000 7fb7400e6740 1 Processor -- start 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98d5d0 0x55b90c997dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98eb40 0x55b90c995070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c998370 0x55b90c995800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7400e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b90c99b070 con 0x55b90c98eb40 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7400e6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b90c8ae060 con 0x55b90c98d5d0 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7400e6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b90c99b1f0 con 0x55b90c998370 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98eb40 0x55b90c995070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98eb40 0x55b90c995070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43860/0 (socket says 172.21.15.1:43860) 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7400e6740 10 client.0 _ll_register_callbacks cb 0x55b90c6018c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 -- 172.21.15.1:0/2699837264 learned_addr learned my addr 172.21.15.1:0/2699837264 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98d5d0 0x55b90c997dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c998370 0x55b90c995800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 -- 172.21.15.1:0/2699837264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c998370 msgr2=0x55b90c995800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c998370 0x55b90c995800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 -- 172.21.15.1:0/2699837264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98d5d0 msgr2=0x55b90c997dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98d5d0 0x55b90c997dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 -- 172.21.15.1:0/2699837264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b90c6643c0 con 0x55b90c98eb40 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c998370 0x55b90c995800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.554+0000 7fb7377fe640 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98eb40 0x55b90c995070 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb72800bac0 tx=0x7fb728004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261525e2548043b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb716ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb716ffd640 1 -- 172.21.15.1:0/2699837264 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728011440 con 0x55b90c98eb40 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 1 -- 172.21.15.1:0/2699837264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb72c00fe10 con 0x55b90c98eb40 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb716ffd640 1 -- 172.21.15.1:0/2699837264 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb7280115e0 con 0x55b90c98eb40 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb716ffd640 1 -- 172.21.15.1:0/2699837264 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb7280117e0 con 0x55b90c98eb40 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 10 client.15465 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 1 -- 172.21.15.1:0/2699837264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b90c9a6bf0 con 0x55b90c98eb40 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb716ffd640 1 -- 172.21.15.1:0/2699837264 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb72c00fe10 con 0x55b90c98eb40 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb716ffd640 1 -- 172.21.15.1:0/2699837264 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb728025b50 con 0x55b90c98eb40 2024-09-19T09:04:32.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 10 client.15465 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 10 client.15465 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:04:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 20 client.15465 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55b90c9a8000 0x55b90c9aa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 4 client.15465 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.555+0000 7fb7400e6740 1 -- 172.21.15.1:0/2699837264 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b90c900860 con 0x55b90c9a8000 2024-09-19T09:04:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.556+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55b90c9a8000 0x55b90c9aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.556+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55b90c9a8000 0x55b90c9aa450 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4cf8bfdb8a161d80 server_cookie=eb05f3a3fb691c9e in_seq=0 out_seq=0 2024-09-19T09:04:32.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.556+0000 7fb716ffd640 10 client.15465 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:04:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb716ffd640 1 -- 172.21.15.1:0/2699837264 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b90c900860 con 0x55b90c9a8000 2024-09-19T09:04:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb716ffd640 10 client.15465 handle_command_reply: tid=0 2024-09-19T09:04:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 client.15465 shutdown 2024-09-19T09:04:32.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 -- 172.21.15.1:0/2699837264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98eb40 msgr2=0x55b90c995070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98eb40 0x55b90c995070 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb72800bac0 tx=0x7fb728004600 comp rx=0 tx=0).stop 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 -- 172.21.15.1:0/2699837264 shutdown_connections 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55b90c9a8000 0x55b90c9aa450 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c998370 0x55b90c995800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98eb40 0x55b90c995070 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2699837264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98d5d0 0x55b90c997dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 -- 172.21.15.1:0/2699837264 >> 172.21.15.1:0/2699837264 conn(0x55b90c956310 msgr2=0x55b90c98f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb716ffd640 0 client.15465 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 -- 172.21.15.1:0/2699837264 shutdown_connections 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.557+0000 7fb7400e6740 1 -- 172.21.15.1:0/2699837264 wait complete. 2024-09-19T09:04:32.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.558+0000 7fb7400e6740 20 client.15465 trim_cache size 0 max 16384 2024-09-19T09:04:32.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7400e6740 1 Processor -- start 2024-09-19T09:04:32.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7400e6740 1 -- start start 2024-09-19T09:04:32.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98d5d0 0x55b90c989e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98eb40 0x55b90c994930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c998370 0x55b90c9afd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7400e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381b2110 con 0x55b90c998370 2024-09-19T09:04:32.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7400e6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381af9e0 con 0x55b90c98eb40 2024-09-19T09:04:32.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7400e6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381ad830 con 0x55b90c98d5d0 2024-09-19T09:04:32.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c998370 0x55b90c9afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7377fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98eb40 0x55b90c994930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c998370 0x55b90c9afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43872/0 (socket says 172.21.15.1:43872) 2024-09-19T09:04:32.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 -- 172.21.15.1:0/2740268636 learned_addr learned my addr 172.21.15.1:0/2740268636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:32.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98d5d0 0x55b90c989e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 -- 172.21.15.1:0/2740268636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98d5d0 msgr2=0x55b90c989e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98d5d0 0x55b90c989e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 -- 172.21.15.1:0/2740268636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98eb40 msgr2=0x55b90c994930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98eb40 0x55b90c994930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb736ffd640 1 -- 172.21.15.1:0/2740268636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b90c994020 con 0x55b90c998370 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.571+0000 7fb7377fe640 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98eb40 0x55b90c994930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.572+0000 7fb736ffd640 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c998370 0x55b90c9afd20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0096e0 tx=0x7fb72c024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cddbf0530db227b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.572+0000 7fb71d7fa640 1 -- 172.21.15.1:0/2740268636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c011030 con 0x55b90c998370 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.572+0000 7fb71d7fa640 1 -- 172.21.15.1:0/2740268636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb72c00fe10 con 0x55b90c998370 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.572+0000 7fb71d7fa640 1 -- 172.21.15.1:0/2740268636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c004cf0 con 0x55b90c998370 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 -- 172.21.15.1:0/2740268636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c998370 msgr2=0x55b90c9afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c998370 0x55b90c9afd20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0096e0 tx=0x7fb72c024040 comp rx=0 tx=0).stop 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 -- 172.21.15.1:0/2740268636 shutdown_connections 2024-09-19T09:04:32.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c998370 0x55b90c9afd20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c98eb40 0x55b90c994930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 --2- 172.21.15.1:0/2740268636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98d5d0 0x55b90c989e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 -- 172.21.15.1:0/2740268636 >> 172.21.15.1:0/2740268636 conn(0x55b90c956310 msgr2=0x55b90c989700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 -- 172.21.15.1:0/2740268636 shutdown_connections 2024-09-19T09:04:32.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 -- 172.21.15.1:0/2740268636 wait complete. 2024-09-19T09:04:32.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 -- start start 2024-09-19T09:04:32.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.573+0000 7fb7400e6740 1 Processor -- start 2024-09-19T09:04:32.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c9a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 0x55b90c991e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb7400e6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 0x55b90c992340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb7400e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381adea0 con 0x55b90c98d5d0 2024-09-19T09:04:32.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb7400e6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381af310 con 0x55b90c998370 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb7400e6740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381ae570 con 0x55b90c98eb40 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb7400e6740 10 client.0 _ll_register_callbacks cb 0x7fb7280040c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb736ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c9a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb736ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c9a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43876/0 (socket says 172.21.15.1:43876) 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb736ffd640 1 -- 172.21.15.1:0/1095628553 learned_addr learned my addr 172.21.15.1:0/1095628553 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb7377fe640 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 0x55b90c991e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb736ffd640 1 -- 172.21.15.1:0/1095628553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 msgr2=0x55b90c991e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb736ffd640 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 0x55b90c991e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb736ffd640 1 -- 172.21.15.1:0/1095628553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 msgr2=0x55b90c992340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb736ffd640 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 0x55b90c992340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.574+0000 7fb736ffd640 1 -- 172.21.15.1:0/1095628553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b90c992b70 con 0x55b90c98d5d0 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb736ffd640 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c9a0bc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009b50 tx=0x7fb72c005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f588917bdfafa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb716ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:32.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb716ffd640 1 -- 172.21.15.1:0/1095628553 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c011230 con 0x55b90c98d5d0 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb716ffd640 1 -- 172.21.15.1:0/1095628553 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb72c00f910 con 0x55b90c98d5d0 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb7400e6740 1 -- 172.21.15.1:0/1095628553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb72c00fe10 con 0x55b90c98d5d0 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb716ffd640 1 -- 172.21.15.1:0/1095628553 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb72c03f070 con 0x55b90c98d5d0 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb7400e6740 10 client.15471 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb7400e6740 1 -- 172.21.15.1:0/1095628553 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b90ca12ce0 con 0x55b90c98d5d0 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb716ffd640 1 -- 172.21.15.1:0/1095628553 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb72c00fe10 con 0x55b90c98d5d0 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb716ffd640 1 -- 172.21.15.1:0/1095628553 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb72c038030 con 0x55b90c98d5d0 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.575+0000 7fb7400e6740 10 client.15471 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb7400e6740 10 client.15471 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb7400e6740 20 client.15471 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55b90ca13150 0x55b90ca15540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb7400e6740 4 client.15471 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb7400e6740 1 -- 172.21.15.1:0/1095628553 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b90c8fad70 con 0x55b90ca13150 2024-09-19T09:04:32.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb7377fe640 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55b90ca13150 0x55b90ca15540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb716ffd640 10 client.15471 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb7377fe640 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55b90ca13150 0x55b90ca15540 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=427191b4d264c66d server_cookie=2781a34dc20a88b9 in_seq=0 out_seq=0 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb716ffd640 1 -- 172.21.15.1:0/1095628553 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b90c8fad70 con 0x55b90ca13150 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb716ffd640 10 client.15471 handle_command_reply: tid=0 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.576+0000 7fb7400e6740 1 client.15471 shutdown 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 -- 172.21.15.1:0/1095628553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 msgr2=0x55b90c9a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c9a0bc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009b50 tx=0x7fb72c005f10 comp rx=0 tx=0).stop 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 -- 172.21.15.1:0/1095628553 shutdown_connections 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55b90ca13150 0x55b90ca15540 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b90c998370 0x55b90c992340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b90c98eb40 0x55b90c991e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 --2- 172.21.15.1:0/1095628553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b90c98d5d0 0x55b90c9a0bc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 -- 172.21.15.1:0/1095628553 >> 172.21.15.1:0/1095628553 conn(0x55b90c956310 msgr2=0x55b90c9884e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb716ffd640 0 client.15471 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:04:32.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 -- 172.21.15.1:0/1095628553 shutdown_connections 2024-09-19T09:04:32.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 1 -- 172.21.15.1:0/1095628553 wait complete. 2024-09-19T09:04:32.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.577+0000 7fb7400e6740 20 client.15471 trim_cache size 0 max 16384 2024-09-19T09:04:32.581 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 -- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb7200a3350 msgr2=0x7fb7200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb7200a3350 0x7fb7200a5810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb730009dc0 tx=0x7fb73008f0f0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 -- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 msgr2=0x7fb73819efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 0x7fb73819efd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb730006010 tx=0x7fb7300319f0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 -- 172.21.15.1:0/2164297375 shutdown_connections 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb738109120 0x7fb73819efd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb7200a3350 0x7fb7200a5810 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7381049a0 0x7fb73819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 --2- 172.21.15.1:0/2164297375 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb738103ff0 0x7fb73819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 -- 172.21.15.1:0/2164297375 >> 172.21.15.1:0/2164297375 conn(0x7fb7380ffab0 msgr2=0x7fb738100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 -- 172.21.15.1:0/2164297375 shutdown_connections 2024-09-19T09:04:32.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:32.578+0000 7fb73dd0d640 1 -- 172.21.15.1:0/2164297375 wait complete. 2024-09-19T09:04:33.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:33 smithi001 ceph-mon[30939]: pgmap v351: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:04:34.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:33 smithi064 ceph-mon[35179]: pgmap v351: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:04:34.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:33 smithi022 ceph-mon[35107]: pgmap v351: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:04:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:35 smithi001 ceph-mon[30939]: pgmap v352: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T09:04:36.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:35 smithi064 ceph-mon[35179]: pgmap v352: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T09:04:36.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:35 smithi022 ceph-mon[35107]: pgmap v352: 97 pgs: 97 active+clean; 658 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T09:04:36.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:04:36.800 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:37.956 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:37 smithi001 ceph-mon[30939]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:04:38.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 -- 172.21.15.1:0/3591645049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7081009b0 msgr2=0x7fd708100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 --2- 172.21.15.1:0/3591645049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7081009b0 0x7fd708100d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009900 tx=0x7fd6f802a410 comp rx=0 tx=0).stop 2024-09-19T09:04:38.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 -- 172.21.15.1:0/3591645049 shutdown_connections 2024-09-19T09:04:38.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 --2- 172.21.15.1:0/3591645049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd70810e4d0 0x7fd7081108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 --2- 172.21.15.1:0/3591645049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd708101360 0x7fd70810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 --2- 172.21.15.1:0/3591645049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7081009b0 0x7fd708100d90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 -- 172.21.15.1:0/3591645049 >> 172.21.15.1:0/3591645049 conn(0x7fd7080fc7d0 msgr2=0x7fd7080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:38.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 -- 172.21.15.1:0/3591645049 shutdown_connections 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.049+0000 7fd70ddae640 1 -- 172.21.15.1:0/3591645049 wait complete. 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.050+0000 7fd70ddae640 1 Processor -- start 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd70ddae640 1 -- start start 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd70ddae640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7081009b0 0x7fd7081a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd70ddae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd708101360 0x7fd7081a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd70ddae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd70810e4d0 0x7fd70819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd70ddae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd708114360 con 0x7fd70810e4d0 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd70ddae640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081141e0 con 0x7fd708101360 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd70ddae640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081144e0 con 0x7fd7081009b0 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd707fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd70810e4d0 0x7fd70819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd707fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd70810e4d0 0x7fd70819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43902/0 (socket says 172.21.15.1:43902) 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd707fff640 1 -- 172.21.15.1:0/1547660880 learned_addr learned my addr 172.21.15.1:0/1547660880 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:38.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd7077fe640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7081009b0 0x7fd7081a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd706ffd640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd708101360 0x7fd7081a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd707fff640 1 -- 172.21.15.1:0/1547660880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7081009b0 msgr2=0x7fd7081a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd707fff640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7081009b0 0x7fd7081a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd707fff640 1 -- 172.21.15.1:0/1547660880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd708101360 msgr2=0x7fd7081a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.051+0000 7fd707fff640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd708101360 0x7fd7081a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.052+0000 7fd707fff640 1 -- 172.21.15.1:0/1547660880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70819ad20 con 0x7fd70810e4d0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.052+0000 7fd706ffd640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd708101360 0x7fd7081a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.052+0000 7fd707fff640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd70810e4d0 0x7fd70819a5f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd70000eaa0 tx=0x7fd70000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.052+0000 7fd704ff9640 1 -- 172.21.15.1:0/1547660880 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70000cdb0 con 0x7fd70810e4d0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.052+0000 7fd70ddae640 1 -- 172.21.15.1:0/1547660880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70819b010 con 0x7fd70810e4d0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.052+0000 7fd704ff9640 1 -- 172.21.15.1:0/1547660880 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd700004b20 con 0x7fd70810e4d0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.052+0000 7fd70ddae640 1 -- 172.21.15.1:0/1547660880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7081a7300 con 0x7fd70810e4d0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.052+0000 7fd704ff9640 1 -- 172.21.15.1:0/1547660880 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700011760 con 0x7fd70810e4d0 2024-09-19T09:04:38.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.055+0000 7fd710187740 1 Processor -- start 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.055+0000 7fd704ff9640 1 -- 172.21.15.1:0/1547660880 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fd7000119a0 con 0x7fd70810e4d0 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd710187740 1 -- start start 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd710187740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd710187740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd710187740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd710187740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd1093f2f0 con 0x55dd109dab40 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd710187740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dd108e6cf0 con 0x55dd109d95d0 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd710187740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dd1093b2b0 con 0x55dd109e4370 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd706ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd706ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43912/0 (socket says 172.21.15.1:43912) 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd706ffd640 1 -- 172.21.15.1:0/2144371290 learned_addr learned my addr 172.21.15.1:0/2144371290 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd7077fe640 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.056+0000 7fd706ffd640 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd7077fe640 1 -- 172.21.15.1:0/2144371290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 msgr2=0x55dd109e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd7077fe640 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd7077fe640 1 -- 172.21.15.1:0/2144371290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 msgr2=0x55dd109d9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd7077fe640 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109d9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd7077fe640 1 -- 172.21.15.1:0/2144371290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd108cb3a0 con 0x55dd109d95d0 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd706ffd640 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109d9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd704ff9640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd6f00a32d0 0x7fd6f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd7077fe640 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109d9a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009230 tx=0x7fd6f8031480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dade3f0dfe85d50a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd706ffd640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd6f00a32d0 0x7fd6f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd704ff9640 1 -- 172.21.15.1:0/1547660880 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd7000cfc40 con 0x7fd70810e4d0 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd6edffb640 1 -- 172.21.15.1:0/2144371290 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f803f070 con 0x55dd109d95d0 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd6edffb640 1 -- 172.21.15.1:0/2144371290 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6f8004030 con 0x55dd109d95d0 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.057+0000 7fd6edffb640 1 -- 172.21.15.1:0/2144371290 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8035070 con 0x55dd109d95d0 2024-09-19T09:04:38.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 -- 172.21.15.1:0/2144371290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 msgr2=0x55dd109d9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd706ffd640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd6f00a32d0 0x7fd6f00a5790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55dd109da070 tx=0x7fd6fc016040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109d9a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009230 tx=0x7fd6f8031480 comp rx=0 tx=0).stop 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 -- 172.21.15.1:0/2144371290 shutdown_connections 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109d9a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 --2- 172.21.15.1:0/2144371290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109d9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 -- 172.21.15.1:0/2144371290 >> 172.21.15.1:0/2144371290 conn(0x55dd109a2310 msgr2=0x55dd109d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 -- 172.21.15.1:0/2144371290 shutdown_connections 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.058+0000 7fd710187740 1 -- 172.21.15.1:0/2144371290 wait complete. 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.059+0000 7fd710187740 1 -- start start 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.059+0000 7fd710187740 1 Processor -- start 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.059+0000 7fd710187740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.059+0000 7fd710187740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109e0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.059+0000 7fd710187740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.059+0000 7fd710187740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd109e7010 con 0x55dd109dab40 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.059+0000 7fd710187740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dd108fa060 con 0x55dd109d95d0 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.059+0000 7fd710187740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55dd109e7190 con 0x55dd109e4370 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd710187740 10 client.0 _ll_register_callbacks cb 0x55dd1064d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd706ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109e0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd706ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109e0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43918/0 (socket says 172.21.15.1:43918) 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd706ffd640 1 -- 172.21.15.1:0/1997537350 learned_addr learned my addr 172.21.15.1:0/1997537350 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd7077fe640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd707fff640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd707fff640 1 -- 172.21.15.1:0/1997537350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 msgr2=0x55dd109e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd707fff640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109e3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd707fff640 1 -- 172.21.15.1:0/1997537350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 msgr2=0x55dd109e0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd707fff640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109e0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd707fff640 1 -- 172.21.15.1:0/1997537350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd106b03c0 con 0x55dd109e4370 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd706ffd640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109e0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.060+0000 7fd7077fe640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd707fff640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e1570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7000cd5d0 tx=0x7fd70009c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60bc7a8fe9348773 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd6e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/1997537350 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70001f030 con 0x55dd109e4370 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/1997537350 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd7000bc070 con 0x55dd109e4370 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd710187740 1 -- 172.21.15.1:0/1997537350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f8004030 con 0x55dd109e4370 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/1997537350 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd7000a4d50 con 0x55dd109e4370 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd710187740 10 client.25120 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:38.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd710187740 1 -- 172.21.15.1:0/1997537350 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dd109f2b20 con 0x55dd109e4370 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/1997537350 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6f8004030 con 0x55dd109e4370 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/1997537350 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd70000f040 con 0x55dd109e4370 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd710187740 10 client.25120 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd710187740 10 client.25120 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd710187740 20 client.25120 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.061+0000 7fd710187740 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55dd109f4000 0x55dd109f6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.062+0000 7fd710187740 4 client.25120 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.062+0000 7fd710187740 1 -- 172.21.15.1:0/1997537350 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd1094c860 con 0x55dd109f4000 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.062+0000 7fd7077fe640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55dd109f4000 0x55dd109f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.062+0000 7fd6e6ffd640 10 client.25120 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.063+0000 7fd7077fe640 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55dd109f4000 0x55dd109f6460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7db5cb245d822f3e server_cookie=4812cf9c75ae6944 in_seq=0 out_seq=0 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.063+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/1997537350 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd1094c860 con 0x55dd109f4000 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.063+0000 7fd6e6ffd640 10 client.25120 handle_command_reply: tid=0 2024-09-19T09:04:38.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.063+0000 7fd710187740 1 client.25120 shutdown 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 -- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 msgr2=0x55dd109e1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e1570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7000cd5d0 tx=0x7fd70009c860 comp rx=0 tx=0).stop 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 -- 172.21.15.1:0/1997537350 shutdown_connections 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55dd109f4000 0x55dd109f6460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109e1570 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109dab40 0x55dd109e0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 --2- 172.21.15.1:0/1997537350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109d95d0 0x55dd109e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 -- 172.21.15.1:0/1997537350 >> 172.21.15.1:0/1997537350 conn(0x55dd109a2310 msgr2=0x55dd109db930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd6e6ffd640 0 client.25120 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 -- 172.21.15.1:0/1997537350 shutdown_connections 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 1 -- 172.21.15.1:0/1997537350 wait complete. 2024-09-19T09:04:38.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.064+0000 7fd710187740 20 client.25120 trim_cache size 0 max 16384 2024-09-19T09:04:38.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.089+0000 7fd710187740 1 Processor -- start 2024-09-19T09:04:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.089+0000 7fd710187740 1 -- start start 2024-09-19T09:04:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd710187740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109d95d0 0x55dd109f0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd710187740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109dab40 0x55dd109d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd710187740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd710187740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4010cd0 con 0x55dd109d95d0 2024-09-19T09:04:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd710187740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400e5a0 con 0x55dd109dab40 2024-09-19T09:04:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd710187740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400c3f0 con 0x55dd109e4370 2024-09-19T09:04:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109d95d0 0x55dd109f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109d95d0 0x55dd109f0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43924/0 (socket says 172.21.15.1:43924) 2024-09-19T09:04:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd7077fe640 1 -- 172.21.15.1:0/1404724031 learned_addr learned my addr 172.21.15.1:0/1404724031 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:38.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd706ffd640 1 --2- 172.21.15.1:0/1404724031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109dab40 0x55dd109d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd7077fe640 1 -- 172.21.15.1:0/1404724031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 msgr2=0x55dd109d5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd7077fe640 1 --2- 172.21.15.1:0/1404724031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd7077fe640 1 -- 172.21.15.1:0/1404724031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109dab40 msgr2=0x55dd109d5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd7077fe640 1 --2- 172.21.15.1:0/1404724031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109dab40 0x55dd109d5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.090+0000 7fd7077fe640 1 -- 172.21.15.1:0/1404724031 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd109d92d0 con 0x55dd109d95d0 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.091+0000 7fd7077fe640 1 --2- 172.21.15.1:0/1404724031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109d95d0 0x55dd109f0310 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009900 tx=0x7fd6f802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27766c4b01a65a75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.091+0000 7fd6ed7fa640 1 -- 172.21.15.1:0/1404724031 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8035040 con 0x55dd109d95d0 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.091+0000 7fd6ed7fa640 1 -- 172.21.15.1:0/1404724031 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6f8031840 con 0x55dd109d95d0 2024-09-19T09:04:38.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.091+0000 7fd6ed7fa640 1 -- 172.21.15.1:0/1404724031 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f803f040 con 0x55dd109d95d0 2024-09-19T09:04:38.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 -- 172.21.15.1:0/1404724031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109d95d0 msgr2=0x55dd109f0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 --2- 172.21.15.1:0/1404724031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109d95d0 0x55dd109f0310 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009900 tx=0x7fd6f802a410 comp rx=0 tx=0).stop 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 -- 172.21.15.1:0/1404724031 shutdown_connections 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 --2- 172.21.15.1:0/1404724031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109e4370 0x55dd109d5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 --2- 172.21.15.1:0/1404724031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109dab40 0x55dd109d5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 --2- 172.21.15.1:0/1404724031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109d95d0 0x55dd109f0310 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 -- 172.21.15.1:0/1404724031 >> 172.21.15.1:0/1404724031 conn(0x55dd109a2310 msgr2=0x55dd109e0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 -- 172.21.15.1:0/1404724031 shutdown_connections 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 -- 172.21.15.1:0/1404724031 wait complete. 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.092+0000 7fd710187740 1 -- start start 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd710187740 1 Processor -- start 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd710187740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109dab40 0x55dd109e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd710187740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109e4370 0x55dd109e85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd710187740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109e8b30 0x55dd10a66550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd710187740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400ca60 con 0x55dd109e8b30 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd710187740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400ded0 con 0x55dd109e4370 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd710187740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400d130 con 0x55dd109dab40 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd710187740 10 client.0 _ll_register_callbacks cb 0x7fd700009230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd707fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109e8b30 0x55dd10a66550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109dab40 0x55dd109e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109dab40 0x55dd109e80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:56128/0 (socket says 172.21.15.1:56128) 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd707fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109e8b30 0x55dd10a66550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43934/0 (socket says 172.21.15.1:43934) 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.093+0000 7fd7077fe640 1 -- 172.21.15.1:0/2755770258 learned_addr learned my addr 172.21.15.1:0/2755770258 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd706ffd640 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109e4370 0x55dd109e85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd7077fe640 1 -- 172.21.15.1:0/2755770258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109e4370 msgr2=0x55dd109e85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd7077fe640 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109e4370 0x55dd109e85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd7077fe640 1 -- 172.21.15.1:0/2755770258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109e8b30 msgr2=0x55dd10a66550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:38.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd7077fe640 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109e8b30 0x55dd10a66550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd7077fe640 1 -- 172.21.15.1:0/2755770258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd109e71e0 con 0x55dd109dab40 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd707fff640 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109e8b30 0x55dd10a66550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd7077fe640 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109dab40 0x55dd109e80b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8006010 tx=0x7fd6f8004510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf29580a8a043785 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd6e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/2755770258 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f805d060 con 0x55dd109dab40 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/2755770258 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd6f804f3a0 con 0x55dd109dab40 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd710187740 1 -- 172.21.15.1:0/2755770258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f8031840 con 0x55dd109dab40 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.094+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/2755770258 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd6f803f070 con 0x55dd109dab40 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.095+0000 7fd710187740 10 client.25123 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.095+0000 7fd710187740 1 -- 172.21.15.1:0/2755770258 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dd10a679a0 con 0x55dd109dab40 2024-09-19T09:04:38.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.095+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/2755770258 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd6f8031840 con 0x55dd109dab40 2024-09-19T09:04:38.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.095+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/2755770258 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd6f803baf0 con 0x55dd109dab40 2024-09-19T09:04:38.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.095+0000 7fd710187740 10 client.25123 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.095+0000 7fd710187740 10 client.25123 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.095+0000 7fd710187740 20 client.25123 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.095+0000 7fd710187740 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55dd10a67bd0 0x55dd10a69fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.096+0000 7fd710187740 4 client.25123 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.096+0000 7fd710187740 1 -- 172.21.15.1:0/2755770258 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dd10946d70 con 0x55dd10a67bd0 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.096+0000 7fd706ffd640 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55dd10a67bd0 0x55dd10a69fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.096+0000 7fd6e6ffd640 10 client.25123 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.096+0000 7fd706ffd640 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55dd10a67bd0 0x55dd10a69fc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e3d6a79333d06555 server_cookie=8c3383456312ddf2 in_seq=0 out_seq=0 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.096+0000 7fd6e6ffd640 1 -- 172.21.15.1:0/2755770258 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dd10946d70 con 0x55dd10a67bd0 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.096+0000 7fd6e6ffd640 10 client.25123 handle_command_reply: tid=0 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.096+0000 7fd710187740 1 client.25123 shutdown 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 -- 172.21.15.1:0/2755770258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109dab40 msgr2=0x55dd109e80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109dab40 0x55dd109e80b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8006010 tx=0x7fd6f8004510 comp rx=0 tx=0).stop 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 -- 172.21.15.1:0/2755770258 shutdown_connections 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55dd10a67bd0 0x55dd10a69fc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd6e6ffd640 0 client.25123 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd109e8b30 0x55dd10a66550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd109e4370 0x55dd109e85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 --2- 172.21.15.1:0/2755770258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55dd109dab40 0x55dd109e80b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 -- 172.21.15.1:0/2755770258 >> 172.21.15.1:0/2755770258 conn(0x55dd109a2310 msgr2=0x55dd109d5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 -- 172.21.15.1:0/2755770258 shutdown_connections 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 1 -- 172.21.15.1:0/2755770258 wait complete. 2024-09-19T09:04:38.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.097+0000 7fd710187740 20 client.25123 trim_cache size 0 max 16384 2024-09-19T09:04:38.102 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 -- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd6f00a32d0 msgr2=0x7fd6f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd6f00a32d0 0x7fd6f00a5790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55dd109da070 tx=0x7fd6fc016040 comp rx=0 tx=0).stop 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 -- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd70810e4d0 msgr2=0x7fd70819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd70810e4d0 0x7fd70819a5f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd70000eaa0 tx=0x7fd70000ef60 comp rx=0 tx=0).stop 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 -- 172.21.15.1:0/1547660880 shutdown_connections 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd70810e4d0 0x7fd70819a5f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd708101360 0x7fd7081a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fd6f00a32d0 0x7fd6f00a5790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 --2- 172.21.15.1:0/1547660880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7081009b0 0x7fd7081a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.098+0000 7fd70ddae640 1 -- 172.21.15.1:0/1547660880 >> 172.21.15.1:0/1547660880 conn(0x7fd7080fc7d0 msgr2=0x7fd7080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:38.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.099+0000 7fd70ddae640 1 -- 172.21.15.1:0/1547660880 shutdown_connections 2024-09-19T09:04:38.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:38.099+0000 7fd70ddae640 1 -- 172.21.15.1:0/1547660880 wait complete. 2024-09-19T09:04:38.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:37 smithi064 ceph-mon[35179]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:04:38.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:37 smithi022 ceph-mon[35107]: pgmap v353: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:04:38.702 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:38.771 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:04:39.065 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:39.107 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:39.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 -- 172.21.15.1:0/3168601274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1036e0 msgr2=0x7f292c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 --2- 172.21.15.1:0/3168601274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1036e0 0x7f292c107b90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2920009900 tx=0x7f292002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 -- 172.21.15.1:0/3168601274 shutdown_connections 2024-09-19T09:04:39.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 --2- 172.21.15.1:0/3168601274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f292c1082a0 0x7f292c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 --2- 172.21.15.1:0/3168601274 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1036e0 0x7f292c107b90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 --2- 172.21.15.1:0/3168601274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f292c102d30 0x7f292c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 -- 172.21.15.1:0/3168601274 >> 172.21.15.1:0/3168601274 conn(0x7f292c0fc7d0 msgr2=0x7f292c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 -- 172.21.15.1:0/3168601274 shutdown_connections 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.869+0000 7f2931b0a640 1 -- 172.21.15.1:0/3168601274 wait complete. 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.870+0000 7f2931b0a640 1 Processor -- start 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.870+0000 7f2931b0a640 1 -- start start 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.870+0000 7f2931b0a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f292c102d30 0x7f292c1a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.870+0000 7f2931b0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f292c1036e0 0x7f292c1a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.870+0000 7f2931b0a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1082a0 0x7f292c10ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.870+0000 7f2931b0a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1121c0 con 0x7f292c1036e0 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f2931b0a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f292c112040 con 0x7f292c102d30 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f292c1036e0 0x7f292c1a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f2931b0a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f292c112340 con 0x7f292c1082a0 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f292c1036e0 0x7f292c1a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43976/0 (socket says 172.21.15.1:43976) 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292affd640 1 -- 172.21.15.1:0/79783566 learned_addr learned my addr 172.21.15.1:0/79783566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292bfff640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1082a0 0x7f292c10ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292bfff640 1 -- 172.21.15.1:0/79783566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f292c102d30 msgr2=0x7f292c1a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292bfff640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f292c102d30 0x7f292c1a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292bfff640 1 -- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f292c1036e0 msgr2=0x7f292c1a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292bfff640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f292c1036e0 0x7f292c1a4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292bfff640 1 -- 172.21.15.1:0/79783566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c10e500 con 0x7f292c1082a0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f292bfff640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1082a0 0x7f292c10ddd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f292400ec50 tx=0x7f292400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.871+0000 7f2928ff9640 1 -- 172.21.15.1:0/79783566 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924003b70 con 0x7f292c1082a0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.872+0000 7f2928ff9640 1 -- 172.21.15.1:0/79783566 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2924003d10 con 0x7f292c1082a0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.872+0000 7f2928ff9640 1 -- 172.21.15.1:0/79783566 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924010990 con 0x7f292c1082a0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.872+0000 7f2931b0a640 1 -- 172.21.15.1:0/79783566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c10e7f0 con 0x7f292c1082a0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.872+0000 7f2931b0a640 1 -- 172.21.15.1:0/79783566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1ab7c0 con 0x7f292c1082a0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.874+0000 7f2928ff9640 1 -- 172.21.15.1:0/79783566 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f2924003fc0 con 0x7f292c1082a0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.875+0000 7f2928ff9640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29140a3350 0x7f29140a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.875+0000 7f2928ff9640 1 -- 172.21.15.1:0/79783566 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f29240cffb0 con 0x7f292c1082a0 2024-09-19T09:04:39.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.875+0000 7f2933ee3740 1 Processor -- start 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.875+0000 7f292b7fe640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29140a3350 0x7f29140a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.875+0000 7f2933ee3740 1 -- start start 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.875+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 0x55fbaf20f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.875+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf20f5d0 0x55fbaf20fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf21a370 0x55fbaf21c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f2933ee3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fbaf1752f0 con 0x55fbaf20f5d0 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f2933ee3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fbaf11ccf0 con 0x55fbaf21a370 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f2933ee3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fbaf1712b0 con 0x55fbaf210b40 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf21a370 0x55fbaf21c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf21a370 0x55fbaf21c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:57200/0 (socket says 172.21.15.1:57200) 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 -- 172.21.15.1:0/4007980523 learned_addr learned my addr 172.21.15.1:0/4007980523 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf20f5d0 0x55fbaf20fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 -- 172.21.15.1:0/4007980523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 msgr2=0x55fbaf20f090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 --2- 172.21.15.1:0/4007980523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 0x55fbaf20f090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 -- 172.21.15.1:0/4007980523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf20f5d0 msgr2=0x55fbaf20fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 --2- 172.21.15.1:0/4007980523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf20f5d0 0x55fbaf20fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 -- 172.21.15.1:0/4007980523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbaf1013a0 con 0x55fbaf21a370 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.876+0000 7f292bfff640 1 --2- 172.21.15.1:0/4007980523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf21a370 0x55fbaf21c760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2924005fd0 tx=0x7f292409c220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4761393ae264ca39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.877+0000 7f2911ffb640 1 -- 172.21.15.1:0/4007980523 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29240b4020 con 0x55fbaf21a370 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.877+0000 7f2911ffb640 1 -- 172.21.15.1:0/4007980523 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2924009820 con 0x55fbaf21a370 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.877+0000 7f292b7fe640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29140a3350 0x7f29140a5810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f291c0058c0 tx=0x7f291c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.877+0000 7f2911ffb640 1 -- 172.21.15.1:0/4007980523 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29240cdb90 con 0x55fbaf21a370 2024-09-19T09:04:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 -- 172.21.15.1:0/4007980523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf21a370 msgr2=0x55fbaf21c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 --2- 172.21.15.1:0/4007980523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf21a370 0x55fbaf21c760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2924005fd0 tx=0x7f292409c220 comp rx=0 tx=0).stop 2024-09-19T09:04:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 -- 172.21.15.1:0/4007980523 shutdown_connections 2024-09-19T09:04:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 --2- 172.21.15.1:0/4007980523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf21a370 0x55fbaf21c760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 --2- 172.21.15.1:0/4007980523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf20f5d0 0x55fbaf20fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 --2- 172.21.15.1:0/4007980523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 0x55fbaf20f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 -- 172.21.15.1:0/4007980523 >> 172.21.15.1:0/4007980523 conn(0x55fbaf1d8310 msgr2=0x55fbaf20bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 -- 172.21.15.1:0/4007980523 shutdown_connections 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 -- 172.21.15.1:0/4007980523 wait complete. 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.878+0000 7f2933ee3740 1 -- start start 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f2933ee3740 1 Processor -- start 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf219dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf210b40 0x55fbaf217070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf21a370 0x55fbaf217800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f2933ee3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fbaf21d070 con 0x55fbaf210b40 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f2933ee3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fbaf130060 con 0x55fbaf20f5d0 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f2933ee3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fbaf21d1f0 con 0x55fbaf21a370 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f2933ee3740 10 client.0 _ll_register_callbacks cb 0x55fbaee838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f292affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf210b40 0x55fbaf217070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f292bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf21a370 0x55fbaf217800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f292bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf21a370 0x55fbaf217800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:56170/0 (socket says 172.21.15.1:56170) 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.879+0000 7f292bfff640 1 -- 172.21.15.1:0/2407703347 learned_addr learned my addr 172.21.15.1:0/2407703347 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f292b7fe640 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf219dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f292bfff640 1 -- 172.21.15.1:0/2407703347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 msgr2=0x55fbaf219dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f292bfff640 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf219dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f292bfff640 1 -- 172.21.15.1:0/2407703347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf210b40 msgr2=0x55fbaf217070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f292bfff640 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf210b40 0x55fbaf217070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f292bfff640 1 -- 172.21.15.1:0/2407703347 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbaeee63c0 con 0x55fbaf21a370 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f292affd640 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf210b40 0x55fbaf217070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f292bfff640 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf21a370 0x55fbaf217800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2924098e20 tx=0x7f29240047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3be535299aab708 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f290affd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f290affd640 1 -- 172.21.15.1:0/2407703347 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292407e060 con 0x55fbaf21a370 2024-09-19T09:04:39.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f290affd640 1 -- 172.21.15.1:0/2407703347 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f29240042b0 con 0x55fbaf21a370 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.880+0000 7f2933ee3740 1 -- 172.21.15.1:0/2407703347 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2924009820 con 0x55fbaf21a370 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f290affd640 1 -- 172.21.15.1:0/2407703347 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f29240b9020 con 0x55fbaf21a370 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f2933ee3740 10 client.25135 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f2933ee3740 1 -- 172.21.15.1:0/2407703347 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fbaf21d070 con 0x55fbaf21a370 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f290affd640 1 -- 172.21.15.1:0/2407703347 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2924009820 con 0x55fbaf21a370 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f290affd640 1 -- 172.21.15.1:0/2407703347 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2924004bd0 con 0x55fbaf21a370 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f2933ee3740 10 client.25135 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f2933ee3740 10 client.25135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f2933ee3740 20 client.25135 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f2933ee3740 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fbaf229d00 0x55fbaf22c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f2933ee3740 4 client.25135 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.881+0000 7f2933ee3740 1 -- 172.21.15.1:0/2407703347 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbaf182860 con 0x55fbaf229d00 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.882+0000 7f292b7fe640 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fbaf229d00 0x55fbaf22c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.882+0000 7f292b7fe640 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fbaf229d00 0x55fbaf22c0f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=983d5e3068f27339 server_cookie=94dafc0c9649a558 in_seq=0 out_seq=0 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.882+0000 7f290affd640 10 client.25135 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f290affd640 1 -- 172.21.15.1:0/2407703347 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbaf182860 con 0x55fbaf229d00 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f290affd640 10 client.25135 handle_command_reply: tid=0 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 client.25135 shutdown 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 -- 172.21.15.1:0/2407703347 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf21a370 msgr2=0x55fbaf217800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf21a370 0x55fbaf217800 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2924098e20 tx=0x7f29240047e0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 -- 172.21.15.1:0/2407703347 shutdown_connections 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fbaf229d00 0x55fbaf22c0f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf21a370 0x55fbaf217800 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf210b40 0x55fbaf217070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 --2- 172.21.15.1:0/2407703347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf219dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f2933ee3740 1 -- 172.21.15.1:0/2407703347 >> 172.21.15.1:0/2407703347 conn(0x55fbaf1d8310 msgr2=0x55fbaf2119c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.883+0000 7f290affd640 0 client.25135 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:39.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.884+0000 7f2933ee3740 1 -- 172.21.15.1:0/2407703347 shutdown_connections 2024-09-19T09:04:39.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.884+0000 7f2933ee3740 1 -- 172.21.15.1:0/2407703347 wait complete. 2024-09-19T09:04:39.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.884+0000 7f2933ee3740 20 client.25135 trim_cache size 0 max 16384 2024-09-19T09:04:39.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.909+0000 7f2933ee3740 1 Processor -- start 2024-09-19T09:04:39.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.910+0000 7f2933ee3740 1 -- start start 2024-09-19T09:04:39.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.910+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf20f5d0 0x55fbaf215f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.910+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf210b40 0x55fbaf2317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.910+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf231cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f292b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf20f5d0 0x55fbaf215f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f292b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf20f5d0 0x55fbaf215f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:56176/0 (socket says 172.21.15.1:56176) 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f292affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf210b40 0x55fbaf2317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f292affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf210b40 0x55fbaf2317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:57222/0 (socket says 172.21.15.1:57222) 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f292bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf231cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f292bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf231cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44004/0 (socket says 172.21.15.1:44004) 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f292b7fe640 1 -- 172.21.15.1:0/3707336221 learned_addr learned my addr 172.21.15.1:0/3707336221 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f2933ee3740 1 -- 172.21.15.1:0/3707336221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1b66b0 con 0x55fbaf21a370 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f2933ee3740 1 -- 172.21.15.1:0/3707336221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1b3f80 con 0x55fbaf210b40 2024-09-19T09:04:39.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.911+0000 7f2933ee3740 1 -- 172.21.15.1:0/3707336221 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1b1dd0 con 0x55fbaf20f5d0 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.912+0000 7f292affd640 1 -- 172.21.15.1:0/3707336221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf20f5d0 msgr2=0x55fbaf215f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.912+0000 7f292affd640 1 --2- 172.21.15.1:0/3707336221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf20f5d0 0x55fbaf215f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.912+0000 7f292affd640 1 -- 172.21.15.1:0/3707336221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 msgr2=0x55fbaf231cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.912+0000 7f292affd640 1 --2- 172.21.15.1:0/3707336221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf231cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.912+0000 7f292affd640 1 -- 172.21.15.1:0/3707336221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbaf20c960 con 0x55fbaf210b40 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.912+0000 7f292affd640 1 --2- 172.21.15.1:0/3707336221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf210b40 0x55fbaf2317b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2920009230 tx=0x7f2920031690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59158aa7c632826 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.913+0000 7f29117fa640 1 -- 172.21.15.1:0/3707336221 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920035040 con 0x55fbaf210b40 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.913+0000 7f29117fa640 1 -- 172.21.15.1:0/3707336221 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2920031840 con 0x55fbaf210b40 2024-09-19T09:04:39.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.913+0000 7f29117fa640 1 -- 172.21.15.1:0/3707336221 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920004a00 con 0x55fbaf210b40 2024-09-19T09:04:39.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.914+0000 7f2933ee3740 1 -- 172.21.15.1:0/3707336221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf210b40 msgr2=0x55fbaf2317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.914+0000 7f2933ee3740 1 --2- 172.21.15.1:0/3707336221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf210b40 0x55fbaf2317b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2920009230 tx=0x7f2920031690 comp rx=0 tx=0).stop 2024-09-19T09:04:39.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.914+0000 7f2933ee3740 1 -- 172.21.15.1:0/3707336221 shutdown_connections 2024-09-19T09:04:39.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.914+0000 7f2933ee3740 1 --2- 172.21.15.1:0/3707336221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf231cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.914+0000 7f2933ee3740 1 --2- 172.21.15.1:0/3707336221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf210b40 0x55fbaf2317b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.914+0000 7f2933ee3740 1 --2- 172.21.15.1:0/3707336221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf20f5d0 0x55fbaf215f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.914+0000 7f2933ee3740 1 -- 172.21.15.1:0/3707336221 >> 172.21.15.1:0/3707336221 conn(0x55fbaf1d8310 msgr2=0x55fbaf215810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.914+0000 7f2933ee3740 1 -- 172.21.15.1:0/3707336221 shutdown_connections 2024-09-19T09:04:39.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.915+0000 7f2933ee3740 1 -- 172.21.15.1:0/3707336221 wait complete. 2024-09-19T09:04:39.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.915+0000 7f2933ee3740 1 -- start start 2024-09-19T09:04:39.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.915+0000 7f2933ee3740 1 Processor -- start 2024-09-19T09:04:39.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.916+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf214000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.916+0000 7f2933ee3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 0x55fbaf214540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.916+0000 7f292b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf214000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.916+0000 7f292b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf214000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:57226/0 (socket says 172.21.15.1:57226) 2024-09-19T09:04:39.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.916+0000 7f292b7fe640 1 -- 172.21.15.1:0/998117454 learned_addr learned my addr 172.21.15.1:0/998117454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:39.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f2933ee3740 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf214a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f292affd640 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 0x55fbaf214540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1b2440 con 0x55fbaf21a370 2024-09-19T09:04:39.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f292bfff640 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf214a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1b38b0 con 0x55fbaf20f5d0 2024-09-19T09:04:39.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1b2b10 con 0x55fbaf210b40 2024-09-19T09:04:39.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f2933ee3740 10 client.0 _ll_register_callbacks cb 0x7f29240cdf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:39.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f292bfff640 1 -- 172.21.15.1:0/998117454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 msgr2=0x55fbaf214540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f292bfff640 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 0x55fbaf214540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f292bfff640 1 -- 172.21.15.1:0/998117454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 msgr2=0x55fbaf214000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:39.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.917+0000 7f292bfff640 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf214000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.918+0000 7f292bfff640 1 -- 172.21.15.1:0/998117454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbaf293780 con 0x55fbaf21a370 2024-09-19T09:04:39.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.918+0000 7f292b7fe640 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf214000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:39.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.918+0000 7f292bfff640 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf214a80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2924098130 tx=0x7f292400cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b6acfe3754f670 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:39.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.918+0000 7f290affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:39.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.918+0000 7f290affd640 1 -- 172.21.15.1:0/998117454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292407e040 con 0x55fbaf21a370 2024-09-19T09:04:39.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.918+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2920031840 con 0x55fbaf21a370 2024-09-19T09:04:39.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.918+0000 7f290affd640 1 -- 172.21.15.1:0/998117454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2924004b40 con 0x55fbaf21a370 2024-09-19T09:04:39.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.918+0000 7f290affd640 1 -- 172.21.15.1:0/998117454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f29240b4040 con 0x55fbaf21a370 2024-09-19T09:04:39.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.919+0000 7f2933ee3740 10 client.15513 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:39.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.919+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fbaf2949c0 con 0x55fbaf21a370 2024-09-19T09:04:39.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.919+0000 7f290affd640 1 -- 172.21.15.1:0/998117454 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2920031840 con 0x55fbaf21a370 2024-09-19T09:04:39.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.919+0000 7f290affd640 1 -- 172.21.15.1:0/998117454 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f29240b0370 con 0x55fbaf21a370 2024-09-19T09:04:39.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.919+0000 7f2933ee3740 10 client.15513 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:39.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.919+0000 7f2933ee3740 10 client.15513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:39.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.920+0000 7f2933ee3740 20 client.15513 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.920+0000 7f2933ee3740 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fbaf294f40 0x55fbaf297330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.920+0000 7f2933ee3740 4 client.15513 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.920+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbaf17cd70 con 0x55fbaf294f40 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.920+0000 7f292b7fe640 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fbaf294f40 0x55fbaf297330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.920+0000 7f290affd640 10 client.15513 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.920+0000 7f292b7fe640 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fbaf294f40 0x55fbaf297330 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6721ab9b8a8ddf7b server_cookie=2ee440b25b16be7f in_seq=0 out_seq=0 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f290affd640 1 -- 172.21.15.1:0/998117454 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbaf17cd70 con 0x55fbaf294f40 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f290affd640 10 client.15513 handle_command_reply: tid=0 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 client.15513 shutdown 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 msgr2=0x55fbaf214a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf214a80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2924098130 tx=0x7f292400cd40 comp rx=0 tx=0).stop 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 shutdown_connections 2024-09-19T09:04:39.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fbaf294f40 0x55fbaf297330 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fbaf21a370 0x55fbaf214a80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f290affd640 0 client.15513 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:39.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fbaf210b40 0x55fbaf214540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 --2- 172.21.15.1:0/998117454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fbaf20f5d0 0x55fbaf214000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.921+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 >> 172.21.15.1:0/998117454 conn(0x55fbaf1d8310 msgr2=0x55fbaf215810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.922+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 shutdown_connections 2024-09-19T09:04:39.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.922+0000 7f2933ee3740 1 -- 172.21.15.1:0/998117454 wait complete. 2024-09-19T09:04:39.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.922+0000 7f2933ee3740 20 client.15513 trim_cache size 0 max 16384 2024-09-19T09:04:39.924 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:04:39.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 -- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29140a3350 msgr2=0x7f29140a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29140a3350 0x7f29140a5810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f291c0058c0 tx=0x7f291c005850 comp rx=0 tx=0).stop 2024-09-19T09:04:39.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 -- 172.21.15.1:0/79783566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1082a0 msgr2=0x7f292c10ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:39.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1082a0 0x7f292c10ddd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f292400ec50 tx=0x7f292400c6a0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 -- 172.21.15.1:0/79783566 shutdown_connections 2024-09-19T09:04:39.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f29140a3350 0x7f29140a5810 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f292c1082a0 0x7f292c10ddd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f292c1036e0 0x7f292c1a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 --2- 172.21.15.1:0/79783566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f292c102d30 0x7f292c1a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:39.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 -- 172.21.15.1:0/79783566 >> 172.21.15.1:0/79783566 conn(0x7f292c0fc7d0 msgr2=0x7f292c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:39.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 -- 172.21.15.1:0/79783566 shutdown_connections 2024-09-19T09:04:39.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.923+0000 7f2931b0a640 1 -- 172.21.15.1:0/79783566 wait complete. 2024-09-19T09:04:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 -- 172.21.15.1:0/340555245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f01036e0 msgr2=0x7f57f010bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 --2- 172.21.15.1:0/340555245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f01036e0 0x7f57f010bbd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009900 tx=0x7f57e402a480 comp rx=0 tx=0).stop 2024-09-19T09:04:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 -- 172.21.15.1:0/340555245 shutdown_connections 2024-09-19T09:04:40.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 --2- 172.21.15.1:0/340555245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f010c1a0 0x7f57f010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 --2- 172.21.15.1:0/340555245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f01036e0 0x7f57f010bbd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 --2- 172.21.15.1:0/340555245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f0102dc0 0x7f57f01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 -- 172.21.15.1:0/340555245 >> 172.21.15.1:0/340555245 conn(0x7f57f00fc7a0 msgr2=0x7f57f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 -- 172.21.15.1:0/340555245 shutdown_connections 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.788+0000 7f57f5498640 1 -- 172.21.15.1:0/340555245 wait complete. 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.789+0000 7f57f5498640 1 Processor -- start 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.789+0000 7f57f5498640 1 -- start start 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57f5498640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f0102dc0 0x7f57f0198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57f5498640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f010c1a0 0x7f57f0198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57ee7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f010c1a0 0x7f57f0198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57f5498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f019d000 0x7f57f019d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57f5498640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01120e0 con 0x7f57f010c1a0 2024-09-19T09:04:40.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57f5498640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0111f60 con 0x7f57f019d000 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57ee7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f010c1a0 0x7f57f0198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43948/0 (socket says 172.21.15.1:43948) 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57f5498640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0112260 con 0x7f57f0102dc0 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.790+0000 7f57ee7fc640 1 -- 172.21.15.1:0/2292181652 learned_addr learned my addr 172.21.15.1:0/2292181652 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57ef7fe640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f019d000 0x7f57f019d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57eeffd640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f0102dc0 0x7f57f0198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57ee7fc640 1 -- 172.21.15.1:0/2292181652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f0102dc0 msgr2=0x7f57f0198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57ee7fc640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f0102dc0 0x7f57f0198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57ee7fc640 1 -- 172.21.15.1:0/2292181652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f019d000 msgr2=0x7f57f019d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57ee7fc640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f019d000 0x7f57f019d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57ee7fc640 1 -- 172.21.15.1:0/2292181652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f019dac0 con 0x7f57f010c1a0 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57eeffd640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f0102dc0 0x7f57f0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.791+0000 7f57ef7fe640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f019d000 0x7f57f019d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:40.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.792+0000 7f57ee7fc640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f010c1a0 0x7f57f0198c70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f57e4004770 tx=0x7f57e4032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.792+0000 7f57d7fff640 1 -- 172.21.15.1:0/2292181652 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e403f030 con 0x7f57f010c1a0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.792+0000 7f57d7fff640 1 -- 172.21.15.1:0/2292181652 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57e4003d00 con 0x7f57f010c1a0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.792+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f019dd50 con 0x7f57f010c1a0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.792+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f01a54d0 con 0x7f57f010c1a0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.793+0000 7f57d7fff640 1 -- 172.21.15.1:0/2292181652 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4035070 con 0x7f57f010c1a0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.795+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f01031a0 con 0x7f57f010c1a0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.796+0000 7f57d7fff640 1 -- 172.21.15.1:0/2292181652 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f57e4042030 con 0x7f57f010c1a0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.797+0000 7f57d7fff640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57d80a33d0 0x7f57d80a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.797+0000 7f57d7fff640 1 -- 172.21.15.1:0/2292181652 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f57e40efea0 con 0x7f57f010c1a0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.798+0000 7f57eeffd640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57d80a33d0 0x7f57d80a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.798+0000 7f57eeffd640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57d80a33d0 0x7f57d80a5890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009b40 tx=0x7f57e0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:40.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:39.803+0000 7f57d7fff640 1 -- 172.21.15.1:0/2292181652 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57e40bc9e0 con 0x7f57f010c1a0 2024-09-19T09:04:40.015 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:39 smithi001 ceph-mon[30939]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T09:04:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:39 smithi064 ceph-mon[35179]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T09:04:40.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.160+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57f01071e0 con 0x7f57f010c1a0 2024-09-19T09:04:40.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.161+0000 7f57d7fff640 1 -- 172.21.15.1:0/2292181652 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f57e40bc2e0 con 0x7f57f010c1a0 2024-09-19T09:04:40.162 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:04:40.162 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:04:40.162 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.164+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57d80a33d0 msgr2=0x7f57d80a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.164+0000 7f57f5498640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57d80a33d0 0x7f57d80a5890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009b40 tx=0x7f57e0005e50 comp rx=0 tx=0).stop 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.164+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f010c1a0 msgr2=0x7f57f0198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.164+0000 7f57f5498640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f010c1a0 0x7f57f0198c70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f57e4004770 tx=0x7f57e4032c70 comp rx=0 tx=0).stop 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.165+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 shutdown_connections 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.165+0000 7f57f5498640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f019d000 0x7f57f019d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.165+0000 7f57f5498640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f010c1a0 0x7f57f0198c70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.165+0000 7f57f5498640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f57d80a33d0 0x7f57d80a5890 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.165+0000 7f57f5498640 1 --2- 172.21.15.1:0/2292181652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57f0102dc0 0x7f57f0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.165+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 >> 172.21.15.1:0/2292181652 conn(0x7f57f00fc7a0 msgr2=0x7f57f00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.165+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 shutdown_connections 2024-09-19T09:04:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:40.165+0000 7f57f5498640 1 -- 172.21.15.1:0/2292181652 wait complete. 2024-09-19T09:04:40.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:39 smithi022 ceph-mon[35107]: pgmap v354: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T09:04:40.895 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db --set-id d052e046 --release --await' 2024-09-19T09:04:40.895 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db --set-id d052e046 --release --await 2024-09-19T09:04:41.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:40 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2292181652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:41.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:40 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2292181652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:41.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:40 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2292181652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:41.445 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:41.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.955+0000 7fdef959e640 1 -- 172.21.15.1:0/1517898236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef4101270 msgr2=0x7fdef410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:41.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.955+0000 7fdef959e640 1 --2- 172.21.15.1:0/1517898236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef4101270 0x7fdef410d7a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009cd0 tx=0x7fdeec02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.956+0000 7fdef959e640 1 -- 172.21.15.1:0/1517898236 shutdown_connections 2024-09-19T09:04:41.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.956+0000 7fdef959e640 1 --2- 172.21.15.1:0/1517898236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef4101270 0x7fdef410d7a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.956+0000 7fdef959e640 1 --2- 172.21.15.1:0/1517898236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef41008d0 0x7fdef4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.956+0000 7fdef959e640 1 --2- 172.21.15.1:0/1517898236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef41068d0 0x7fdef4106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.956+0000 7fdef959e640 1 -- 172.21.15.1:0/1517898236 >> 172.21.15.1:0/1517898236 conn(0x7fdef40fc610 msgr2=0x7fdef40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.956+0000 7fdef959e640 1 -- 172.21.15.1:0/1517898236 shutdown_connections 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.956+0000 7fdef959e640 1 -- 172.21.15.1:0/1517898236 wait complete. 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.957+0000 7fdef959e640 1 Processor -- start 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.957+0000 7fdef959e640 1 -- start start 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.957+0000 7fdef959e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef41008d0 0x7fdef410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef959e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef4101270 0x7fdef4109580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef959e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef41068d0 0x7fdef4109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef959e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4110df0 con 0x7fdef41068d0 2024-09-19T09:04:41.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef959e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4110c70 con 0x7fdef41008d0 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef959e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4110f70 con 0x7fdef4101270 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef41008d0 0x7fdef410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef41008d0 0x7fdef410d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:57248/0 (socket says 172.21.15.1:57248) 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef3fff640 1 -- 172.21.15.1:0/249106746 learned_addr learned my addr 172.21.15.1:0/249106746 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef41068d0 0x7fdef4109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef37fe640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef4101270 0x7fdef4109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef3fff640 1 -- 172.21.15.1:0/249106746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef4101270 msgr2=0x7fdef4109580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.958+0000 7fdef3fff640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef4101270 0x7fdef4109580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef3fff640 1 -- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef41068d0 msgr2=0x7fdef4109ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef3fff640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef41068d0 0x7fdef4109ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef3fff640 1 -- 172.21.15.1:0/249106746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef410a2f0 con 0x7fdef41008d0 2024-09-19T09:04:41.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef41068d0 0x7fdef4109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:41.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef3fff640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef41008d0 0x7fdef410d4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdee400e9f0 tx=0x7fdee400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:41.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef17fa640 1 -- 172.21.15.1:0/249106746 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee400cd80 con 0x7fdef41008d0 2024-09-19T09:04:41.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef17fa640 1 -- 172.21.15.1:0/249106746 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdee4005520 con 0x7fdef41008d0 2024-09-19T09:04:41.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef959e640 1 -- 172.21.15.1:0/249106746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef41aaf10 con 0x7fdef41008d0 2024-09-19T09:04:41.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef959e640 1 -- 172.21.15.1:0/249106746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef41ab360 con 0x7fdef41008d0 2024-09-19T09:04:41.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.959+0000 7fdef17fa640 1 -- 172.21.15.1:0/249106746 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4010690 con 0x7fdef41008d0 2024-09-19T09:04:41.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdef17fa640 1 -- 172.21.15.1:0/249106746 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fdee40046c0 con 0x7fdef41008d0 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdefcbd9740 1 Processor -- start 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdefcbd9740 1 -- start start 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c4651d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651db30 0x558c46527eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdefcbd9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558c46482620 con 0x558c4651d210 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdefcbd9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c46429e50 con 0x558c465283f0 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdefcbd9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558c4647e5e0 con 0x558c4651db30 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.963+0000 7fdef8d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c4651d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef8d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c4651d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44042/0 (socket says 172.21.15.1:44042) 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef8d9d640 1 -- 172.21.15.1:0/3861256173 learned_addr learned my addr 172.21.15.1:0/3861256173 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef3fff640 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651db30 0x558c46527eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef37fe640 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef8d9d640 1 -- 172.21.15.1:0/3861256173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651db30 msgr2=0x558c46527eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651db30 0x558c46527eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef8d9d640 1 -- 172.21.15.1:0/3861256173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 msgr2=0x558c4652a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef8d9d640 1 -- 172.21.15.1:0/3861256173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4641ad40 con 0x558c4651d210 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef37fe640 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.964+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c4651d5f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009cd0 tx=0x7fdeec009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305c4b56353b7dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.965+0000 7fdeda7fc640 1 -- 172.21.15.1:0/3861256173 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec048070 con 0x558c4651d210 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.965+0000 7fdef17fa640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdedc0a3350 0x7fdedc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.965+0000 7fdeda7fc640 1 -- 172.21.15.1:0/3861256173 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdeec036070 con 0x558c4651d210 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.965+0000 7fdeda7fc640 1 -- 172.21.15.1:0/3861256173 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec004600 con 0x558c4651d210 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.965+0000 7fdef3fff640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdedc0a3350 0x7fdedc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdef17fa640 1 -- 172.21.15.1:0/249106746 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdee40cfda0 con 0x7fdef41008d0 2024-09-19T09:04:41.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3861256173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 msgr2=0x558c4651d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c4651d5f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009cd0 tx=0x7fdeec009800 comp rx=0 tx=0).stop 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3861256173 shutdown_connections 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651db30 0x558c46527eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3861256173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c4651d5f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3861256173 >> 172.21.15.1:0/3861256173 conn(0x558c465197a0 msgr2=0x558c46519b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3861256173 shutdown_connections 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdef3fff640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdedc0a3350 0x7fdedc0a5810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x558c4651a600 tx=0x7fdee40bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.966+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3861256173 wait complete. 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdefcbd9740 1 -- start start 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdefcbd9740 1 Processor -- start 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4651d210 0x558c46525290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651db30 0x558c465257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651db30 0x558c465257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c465283f0 0x558c46525d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdefcbd9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558c4652afc0 con 0x558c4651db30 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651db30 0x558c465257d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44048/0 (socket says 172.21.15.1:44048) 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c4640af10 con 0x558c4651d210 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558c4652b140 con 0x558c465283f0 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.967+0000 7fdef37fe640 1 -- 172.21.15.1:0/3505516624 learned_addr learned my addr 172.21.15.1:0/3505516624 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdefcbd9740 10 client.0 _ll_register_callbacks cb 0x558c4642edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4651d210 0x558c46525290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c465283f0 0x558c46525d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef37fe640 1 -- 172.21.15.1:0/3505516624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c465283f0 msgr2=0x558c46525d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef37fe640 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c465283f0 0x558c46525d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef37fe640 1 -- 172.21.15.1:0/3505516624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4651d210 msgr2=0x558c46525290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef37fe640 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4651d210 0x558c46525290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef37fe640 1 -- 172.21.15.1:0/3505516624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c46191580 con 0x558c4651db30 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c465283f0 0x558c46525d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdef37fe640 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651db30 0x558c465257d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdee8012730 tx=0x7fdee8012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275bbdcf52a6769 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec036070 con 0x558c4651db30 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.968+0000 7fded37fe640 10 client.15525 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fded37fe640 1 -- 172.21.15.1:0/3505516624 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee800f920 con 0x558c4651db30 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fded37fe640 1 -- 172.21.15.1:0/3505516624 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdee800fac0 con 0x558c4651db30 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fded37fe640 1 -- 172.21.15.1:0/3505516624 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdee800fd00 con 0x558c4651db30 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fdefcbd9740 10 client.15525 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=24}) -- 0x558c4625b960 con 0x558c4651db30 2024-09-19T09:04:41.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fded37fe640 1 -- 172.21.15.1:0/3505516624 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdee8026470 con 0x558c4651db30 2024-09-19T09:04:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fdefcbd9740 10 client.15525 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fdefcbd9740 10 client.15525 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:04:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fdefcbd9740 20 client.15525 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.969+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558c46537e60 0x558c4653a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.970+0000 7fdefcbd9740 4 client.15525 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:41.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.970+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c4648fb90 con 0x558c46537e60 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.970+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558c46537e60 0x558c4653a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.970+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558c46537e60 0x558c4653a250 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e3b967bdb79b58 server_cookie=ceb26c4e8d02deb3 in_seq=0 out_seq=0 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.970+0000 7fded37fe640 10 client.15525 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.971+0000 7fded37fe640 1 -- 172.21.15.1:0/3505516624 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c4648fb90 con 0x558c46537e60 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.971+0000 7fded37fe640 10 client.15525 handle_command_reply: tid=0 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.971+0000 7fdefcbd9740 1 client.15525 shutdown 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651db30 msgr2=0x558c465257d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651db30 0x558c465257d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdee8012730 tx=0x7fdee8012bf0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 shutdown_connections 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558c46537e60 0x558c4653a250 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c465283f0 0x558c46525d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651db30 0x558c465257d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fded37fe640 0 client.15525 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3505516624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c4651d210 0x558c46525290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 >> 172.21.15.1:0/3505516624 conn(0x558c465197a0 msgr2=0x558c46518900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 shutdown_connections 2024-09-19T09:04:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3505516624 wait complete. 2024-09-19T09:04:41.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.972+0000 7fdefcbd9740 20 client.15525 trim_cache size 0 max 16384 2024-09-19T09:04:41.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.994+0000 7fdefcbd9740 1 Processor -- start 2024-09-19T09:04:41.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.994+0000 7fdefcbd9740 1 -- start start 2024-09-19T09:04:41.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.994+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651d210 0x558c46527160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.994+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4653fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.994+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c46537e60 0x558c4653ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:41.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.994+0000 7fdefcbd9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41b63c0 con 0x558c46537e60 2024-09-19T09:04:41.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.994+0000 7fdefcbd9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41b3c90 con 0x558c465283f0 2024-09-19T09:04:41.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.994+0000 7fdefcbd9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41b1ae0 con 0x558c4651d210 2024-09-19T09:04:41.996 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:41 smithi001 ceph-mon[30939]: pgmap v355: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:04:41.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4653fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4653fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:57274/0 (socket says 172.21.15.1:57274) 2024-09-19T09:04:41.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 -- 172.21.15.1:0/3936818858 learned_addr learned my addr 172.21.15.1:0/3936818858 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:41.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c46537e60 0x558c4653ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 -- 172.21.15.1:0/3936818858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651d210 msgr2=0x558c46527160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651d210 0x558c46527160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 -- 172.21.15.1:0/3936818858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c46537e60 msgr2=0x558c4653ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c46537e60 0x558c4653ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 -- 172.21.15.1:0/3936818858 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4651a850 con 0x558c465283f0 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c46537e60 0x558c4653ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.995+0000 7fdef37fe640 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4653fa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdee8000c00 tx=0x7fdee8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41acd9776f400b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.996+0000 7fded9ffb640 1 -- 172.21.15.1:0/3936818858 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee800fea0 con 0x558c465283f0 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.996+0000 7fded9ffb640 1 -- 172.21.15.1:0/3936818858 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdeec036070 con 0x558c465283f0 2024-09-19T09:04:41.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.996+0000 7fded9ffb640 1 -- 172.21.15.1:0/3936818858 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8003850 con 0x558c465283f0 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.997+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3936818858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 msgr2=0x558c4653fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.997+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4653fa10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdee8000c00 tx=0x7fdee8014000 comp rx=0 tx=0).stop 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.997+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3936818858 shutdown_connections 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.997+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c46537e60 0x558c4653ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.997+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4653fa10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.997+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/3936818858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c4651d210 0x558c46527160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.997+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3936818858 >> 172.21.15.1:0/3936818858 conn(0x558c465197a0 msgr2=0x558c4651f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.998+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3936818858 shutdown_connections 2024-09-19T09:04:41.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.998+0000 7fdefcbd9740 1 -- 172.21.15.1:0/3936818858 wait complete. 2024-09-19T09:04:41.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.998+0000 7fdefcbd9740 1 -- start start 2024-09-19T09:04:41.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.999+0000 7fdefcbd9740 1 Processor -- start 2024-09-19T09:04:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:41.999+0000 7fdefcbd9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c46530a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdef8d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c46530a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdef8d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c46530a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44068/0 (socket says 172.21.15.1:44068) 2024-09-19T09:04:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdef8d9d640 1 -- 172.21.15.1:0/1240666135 learned_addr learned my addr 172.21.15.1:0/1240666135 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c46537e60 0x558c4652d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41b2150 con 0x558c4651d210 2024-09-19T09:04:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41b35c0 con 0x558c465283f0 2024-09-19T09:04:42.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41b2820 con 0x558c46537e60 2024-09-19T09:04:42.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.000+0000 7fdef37fe640 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdef37fe640 1 -- 172.21.15.1:0/1240666135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c46537e60 msgr2=0x558c4652d2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:04:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdef37fe640 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c46537e60 0x558c4652d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdef37fe640 1 -- 172.21.15.1:0/1240666135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 msgr2=0x558c46530a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdef37fe640 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c46530a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdef37fe640 1 -- 172.21.15.1:0/1240666135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c4652aea0 con 0x558c465283f0 2024-09-19T09:04:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdefcbd9740 10 client.0 _ll_register_callbacks cb 0x7fdee8009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec036070 con 0x558c465283f0 2024-09-19T09:04:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c46530a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fdef37fe640 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652cd90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x558c4652b290 tx=0x7fdee8005680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63724472b8100ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fded37fe640 10 client.25166 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fded37fe640 1 -- 172.21.15.1:0/1240666135 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee803a060 con 0x558c465283f0 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.001+0000 7fded37fe640 1 -- 172.21.15.1:0/1240666135 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdee8026970 con 0x558c465283f0 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fded37fe640 1 -- 172.21.15.1:0/1240666135 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdee800fea0 con 0x558c465283f0 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fdefcbd9740 10 client.25166 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=24}) -- 0x558c465a3590 con 0x558c465283f0 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fded37fe640 1 -- 172.21.15.1:0/1240666135 <== mon.2 v2:172.21.15.22:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdee80035f0 con 0x558c465283f0 2024-09-19T09:04:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fdefcbd9740 10 client.25166 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fdefcbd9740 10 client.25166 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:04:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fdefcbd9740 20 client.25166 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558c465a3bf0 0x558c465a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fdefcbd9740 4 client.25166 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d052e046", "release": true, "await": true}] 2024-09-19T09:04:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.002+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d052e046", "release": true, "await": true}) -- 0x558c4648a0a0 con 0x558c465a3bf0 2024-09-19T09:04:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.003+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558c465a3bf0 0x558c465a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.003+0000 7fdef8d9d640 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558c465a3bf0 0x558c465a5fe0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71116e409a769c5e server_cookie=b1e4d83706cd6890 in_seq=0 out_seq=0 2024-09-19T09:04:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.003+0000 7fded37fe640 10 client.25166 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:42.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.005+0000 7fded37fe640 1 -- 172.21.15.1:0/1240666135 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x558c4648a0a0 con 0x558c465a3bf0 2024-09-19T09:04:42.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.005+0000 7fded37fe640 10 client.25166 handle_command_reply: tid=0 2024-09-19T09:04:42.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.005+0000 7fdefcbd9740 1 client.25166 shutdown 2024-09-19T09:04:42.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 msgr2=0x558c4652cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:42.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652cd90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x558c4652b290 tx=0x7fdee8005680 comp rx=0 tx=0).stop 2024-09-19T09:04:42.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 shutdown_connections 2024-09-19T09:04:42.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558c465a3bf0 0x558c465a5fe0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558c46537e60 0x558c4652d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c465283f0 0x558c4652cd90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 --2- 172.21.15.1:0/1240666135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c4651d210 0x558c46530a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 >> 172.21.15.1:0/1240666135 conn(0x558c465197a0 msgr2=0x558c465180e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:42.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fded37fe640 0 client.25166 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:42.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 shutdown_connections 2024-09-19T09:04:42.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 1 -- 172.21.15.1:0/1240666135 wait complete. 2024-09-19T09:04:42.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.006+0000 7fdefcbd9740 20 client.25166 trim_cache size 0 max 16384 2024-09-19T09:04:42.010 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:04:42.010 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 24, 2024-09-19T09:04:42.010 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:04:42.010 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 4, 2024-09-19T09:04:42.010 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:04:42.010 INFO:teuthology.orchestra.run.smithi001.stdout: "d052e046": { 2024-09-19T09:04:42.011 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 4, 2024-09-19T09:04:42.011 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:04:42.011 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:04:42.011 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:04:42.011 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:04:42.011 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:04:42.012 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:04:42.012 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 131.2, 2024-09-19T09:04:42.012 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:04:42.012 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:04:42.012 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:04:42.013 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:04:42.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:04:42.013 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:04:42.013 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:42.013 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:42.014 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:42.014 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:42.014 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:42.014 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:04:42.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 -- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdedc0a3350 msgr2=0x7fdedc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:42.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdedc0a3350 0x7fdedc0a5810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x558c4651a600 tx=0x7fdee40bc040 comp rx=0 tx=0).stop 2024-09-19T09:04:42.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 -- 172.21.15.1:0/249106746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef41008d0 msgr2=0x7fdef410d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:42.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef41008d0 0x7fdef410d4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdee400e9f0 tx=0x7fdee400edf0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 -- 172.21.15.1:0/249106746 shutdown_connections 2024-09-19T09:04:42.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdef41068d0 0x7fdef4109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdedc0a3350 0x7fdedc0a5810 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdef4101270 0x7fdef4109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 --2- 172.21.15.1:0/249106746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef41008d0 0x7fdef410d4e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:42.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.007+0000 7fdef959e640 1 -- 172.21.15.1:0/249106746 >> 172.21.15.1:0/249106746 conn(0x7fdef40fc610 msgr2=0x7fdef41023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:42.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.008+0000 7fdef959e640 1 -- 172.21.15.1:0/249106746 shutdown_connections 2024-09-19T09:04:42.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:42.008+0000 7fdef959e640 1 -- 172.21.15.1:0/249106746 wait complete. 2024-09-19T09:04:42.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:41 smithi064 ceph-mon[35179]: pgmap v355: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:04:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:41 smithi022 ceph-mon[35107]: pgmap v355: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:04:42.415 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:04:42.415 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:04:42.763 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd052e046', total seconds elapsed: 15.2 2024-09-19T09:04:42.826 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:43.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.347+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3360826862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb381036e0 msgr2=0x7fdb38107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:43.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.347+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3360826862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb381036e0 0x7fdb38107b90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009930 tx=0x7fdb2c02a420 comp rx=0 tx=0).stop 2024-09-19T09:04:43.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.347+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3360826862 shutdown_connections 2024-09-19T09:04:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.347+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3360826862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb381082a0 0x7fdb3810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.347+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3360826862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb381036e0 0x7fdb38107b90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.347+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3360826862 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb38102d30 0x7fdb38103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.347+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3360826862 >> 172.21.15.1:0/3360826862 conn(0x7fdb380fc7d0 msgr2=0x7fdb380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.348+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3360826862 shutdown_connections 2024-09-19T09:04:43.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.348+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3360826862 wait complete. 2024-09-19T09:04:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.349+0000 7fdb3ca0c640 1 Processor -- start 2024-09-19T09:04:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.349+0000 7fdb3ca0c640 1 -- start start 2024-09-19T09:04:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb3ca0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb38102d30 0x7fdb3819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb3ca0c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb381082a0 0x7fdb3819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb3ca0c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb38198730 0x7fdb38198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb3ca0c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb381121c0 con 0x7fdb38102d30 2024-09-19T09:04:43.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb3ca0c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdb38112040 con 0x7fdb38198730 2024-09-19T09:04:43.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb3ca0c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb38112340 con 0x7fdb381082a0 2024-09-19T09:04:43.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb36d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb38198730 0x7fdb38198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb36d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb38198730 0x7fdb38198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:35960/0 (socket says 172.21.15.1:35960) 2024-09-19T09:04:43.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb36d9d640 1 -- 172.21.15.1:0/3643938566 learned_addr learned my addr 172.21.15.1:0/3643938566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:43.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.350+0000 7fdb36d9d640 1 -- 172.21.15.1:0/3643938566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb381082a0 msgr2=0x7fdb3819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:43.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.351+0000 7fdb36d9d640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb381082a0 0x7fdb3819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.351+0000 7fdb36d9d640 1 -- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb38102d30 msgr2=0x7fdb3819e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:04:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.351+0000 7fdb3659c640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb38102d30 0x7fdb3819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.351+0000 7fdb36d9d640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb38102d30 0x7fdb3819e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.351+0000 7fdb36d9d640 1 -- 172.21.15.1:0/3643938566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb381992e0 con 0x7fdb38198730 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.351+0000 7fdb36d9d640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb38198730 0x7fdb38198bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000eaa0 tx=0x7fdb3000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.351+0000 7fdb277fe640 1 -- 172.21.15.1:0/3643938566 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000cdb0 con 0x7fdb38198730 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.352+0000 7fdb277fe640 1 -- 172.21.15.1:0/3643938566 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb30004b20 con 0x7fdb38198730 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.352+0000 7fdb277fe640 1 -- 172.21.15.1:0/3643938566 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30011760 con 0x7fdb38198730 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.352+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3643938566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb381a5410 con 0x7fdb38198730 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.352+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3643938566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb381a57b0 con 0x7fdb38198730 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.355+0000 7fdb3ede5740 1 Processor -- start 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.356+0000 7fdb277fe640 1 -- 172.21.15.1:0/3643938566 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fdb30004cd0 con 0x7fdb38198730 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.356+0000 7fdb3ede5740 1 -- start start 2024-09-19T09:04:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.356+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbb7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.356+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb76c0 0x55db5cbb16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.356+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb1d60 0x55db5cbb21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.356+0000 7fdb3ede5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55db5cb0d280 con 0x55db5cbb6da0 2024-09-19T09:04:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.356+0000 7fdb3ede5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55db5cab4b10 con 0x55db5cbb1d60 2024-09-19T09:04:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.356+0000 7fdb3ede5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55db5cb09240 con 0x55db5cbb76c0 2024-09-19T09:04:43.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb35d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbb7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb35d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbb7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56102/0 (socket says 172.21.15.1:56102) 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb35d9b640 1 -- 172.21.15.1:0/2377087592 learned_addr learned my addr 172.21.15.1:0/2377087592 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb3659c640 1 --2- 172.21.15.1:0/2377087592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb76c0 0x55db5cbb16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb277fe640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb200a32d0 0x7fdb200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb35d9b640 1 -- 172.21.15.1:0/2377087592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb76c0 msgr2=0x55db5cbb16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/2377087592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb76c0 0x55db5cbb16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb35d9b640 1 -- 172.21.15.1:0/2377087592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb1d60 msgr2=0x55db5cbb21e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/2377087592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb1d60 0x55db5cbb21e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb35d9b640 1 -- 172.21.15.1:0/2377087592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db5cac11f0 con 0x55db5cbb6da0 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.357+0000 7fdb277fe640 1 -- 172.21.15.1:0/3643938566 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdb300cfd80 con 0x7fdb38198730 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.358+0000 7fdb36d9d640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb200a32d0 0x7fdb200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.358+0000 7fdb36d9d640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb200a32d0 0x7fdb200a5790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdb30098680 tx=0x7fdb30005820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.358+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/2377087592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbb7180 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdb380697d0 tx=0x7fdb2c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4dd51cce8d7bf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.359+0000 7fdb24ff9640 1 -- 172.21.15.1:0/2377087592 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c03e070 con 0x55db5cbb6da0 2024-09-19T09:04:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.359+0000 7fdb24ff9640 1 -- 172.21.15.1:0/2377087592 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb2c031840 con 0x55db5cbb6da0 2024-09-19T09:04:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.360+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2377087592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 msgr2=0x55db5cbb7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.360+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2377087592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbb7180 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdb380697d0 tx=0x7fdb2c005d50 comp rx=0 tx=0).stop 2024-09-19T09:04:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.360+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2377087592 shutdown_connections 2024-09-19T09:04:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.360+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2377087592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb1d60 0x55db5cbb21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.360+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2377087592 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb76c0 0x55db5cbb16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.360+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2377087592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbb7180 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.360+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2377087592 >> 172.21.15.1:0/2377087592 conn(0x55db5cba3ba0 msgr2=0x55db5cba3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.360+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2377087592 shutdown_connections 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.361+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2377087592 wait complete. 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.361+0000 7fdb3ede5740 1 -- start start 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.361+0000 7fdb3ede5740 1 Processor -- start 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbbd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbbaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb76c0 0x55db5cbbb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3ede5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55db5cbbe120 con 0x55db5cbb6da0 2024-09-19T09:04:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3ede5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55db5cac7f10 con 0x55db5cbb76c0 2024-09-19T09:04:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3ede5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55db5cbbe2a0 con 0x55db5cbb1d60 2024-09-19T09:04:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbbaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3ede5740 10 client.0 _ll_register_callbacks cb 0x55db5ca90a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbbaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56116/0 (socket says 172.21.15.1:56116) 2024-09-19T09:04:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb3659c640 1 -- 172.21.15.1:0/2851353725 learned_addr learned my addr 172.21.15.1:0/2851353725 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:43.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.362+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbbd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.363+0000 7fdb3659c640 1 -- 172.21.15.1:0/2851353725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 msgr2=0x55db5cbbd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.363+0000 7fdb3659c640 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbbd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.363+0000 7fdb3659c640 1 -- 172.21.15.1:0/2851353725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb76c0 msgr2=0x55db5cbbb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.363+0000 7fdb3659c640 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb76c0 0x55db5cbbb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.363+0000 7fdb3659c640 1 -- 172.21.15.1:0/2851353725 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db5c87e6a0 con 0x55db5cbb6da0 2024-09-19T09:04:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.363+0000 7fdb3659c640 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbbaa10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdb28013820 tx=0x7fdb28013ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78cdda58429d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.363+0000 7fdb1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:43.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.364+0000 7fdb1dffb640 1 -- 172.21.15.1:0/2851353725 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28004220 con 0x55db5cbb6da0 2024-09-19T09:04:43.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.364+0000 7fdb1dffb640 1 -- 172.21.15.1:0/2851353725 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdb280043c0 con 0x55db5cbb6da0 2024-09-19T09:04:43.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.364+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2851353725 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb2c031840 con 0x55db5cbb6da0 2024-09-19T09:04:43.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.364+0000 7fdb1dffb640 1 -- 172.21.15.1:0/2851353725 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdb280119c0 con 0x55db5cbb6da0 2024-09-19T09:04:43.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.364+0000 7fdb3ede5740 10 client.15537 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:43.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.364+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2851353725 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55db5cbc9d50 con 0x55db5cbb6da0 2024-09-19T09:04:43.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.364+0000 7fdb1dffb640 1 -- 172.21.15.1:0/2851353725 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb2c031840 con 0x55db5cbb6da0 2024-09-19T09:04:43.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.365+0000 7fdb1dffb640 1 -- 172.21.15.1:0/2851353725 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdb2801a070 con 0x55db5cbb6da0 2024-09-19T09:04:43.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.366+0000 7fdb3ede5740 10 client.15537 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:43.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.366+0000 7fdb3ede5740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:43.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.366+0000 7fdb3ede5740 20 client.15537 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:43.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.366+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55db5cbcb160 0x55db5cbcd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.366+0000 7fdb3ede5740 4 client.15537 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:43.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.366+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2851353725 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db5cb1a7f0 con 0x55db5cbcb160 2024-09-19T09:04:43.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.366+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55db5cbcb160 0x55db5cbcd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.367+0000 7fdb1dffb640 10 client.15537 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:43.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.367+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55db5cbcb160 0x55db5cbcd570 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46ad4a991b452a52 server_cookie=84dad592628dc605 in_seq=0 out_seq=0 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.367+0000 7fdb1dffb640 1 -- 172.21.15.1:0/2851353725 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db5cb1a7f0 con 0x55db5cbcb160 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.367+0000 7fdb1dffb640 10 client.15537 handle_command_reply: tid=0 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.367+0000 7fdb3ede5740 1 client.15537 shutdown 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.367+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2851353725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 msgr2=0x55db5cbbaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.367+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbbaa10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdb28013820 tx=0x7fdb28013ce0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2851353725 shutdown_connections 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55db5cbcb160 0x55db5cbcd570 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb76c0 0x55db5cbbb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb6da0 0x55db5cbbaa10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb1dffb640 0 client.15537 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:43.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/2851353725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbbd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2851353725 >> 172.21.15.1:0/2851353725 conn(0x55db5cba3ba0 msgr2=0x55db5cba3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:43.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2851353725 shutdown_connections 2024-09-19T09:04:43.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 1 -- 172.21.15.1:0/2851353725 wait complete. 2024-09-19T09:04:43.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.368+0000 7fdb3ede5740 20 client.15537 trim_cache size 0 max 16384 2024-09-19T09:04:43.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3ede5740 1 Processor -- start 2024-09-19T09:04:43.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3ede5740 1 -- start start 2024-09-19T09:04:43.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbb16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbd2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb35d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbb16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb35d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbb16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:59970/0 (socket says 172.21.15.1:59970) 2024-09-19T09:04:43.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:35980/0 (socket says 172.21.15.1:35980) 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb35d9b640 1 -- 172.21.15.1:0/1153201377 learned_addr learned my addr 172.21.15.1:0/1153201377 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3ede5740 1 -- 172.21.15.1:0/1153201377 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb381ae3d0 con 0x55db5cbb76c0 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3ede5740 1 -- 172.21.15.1:0/1153201377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdb381abca0 con 0x55db5cbb6da0 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb3ede5740 1 -- 172.21.15.1:0/1153201377 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb381a9af0 con 0x55db5cbb1d60 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.403+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/1153201377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbd2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb35d9b640 1 -- 172.21.15.1:0/1153201377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 msgr2=0x55db5cbc7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/1153201377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb35d9b640 1 -- 172.21.15.1:0/1153201377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 msgr2=0x55db5cbd2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/1153201377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbd2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb35d9b640 1 -- 172.21.15.1:0/1153201377 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db5cbba9b0 con 0x55db5cbb1d60 2024-09-19T09:04:43.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/1153201377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbb16f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c005390 tx=0x7fdb2c0053c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a9d249f7b2b87bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb1ffff640 1 -- 172.21.15.1:0/1153201377 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c03e040 con 0x55db5cbb1d60 2024-09-19T09:04:43.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb1ffff640 1 -- 172.21.15.1:0/1153201377 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb2c031840 con 0x55db5cbb1d60 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.404+0000 7fdb1ffff640 1 -- 172.21.15.1:0/1153201377 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c003e60 con 0x55db5cbb1d60 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.405+0000 7fdb3ede5740 1 -- 172.21.15.1:0/1153201377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 msgr2=0x55db5cbb16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.405+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/1153201377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbb16f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c005390 tx=0x7fdb2c0053c0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.405+0000 7fdb3ede5740 1 -- 172.21.15.1:0/1153201377 shutdown_connections 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.405+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/1153201377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbd2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.405+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/1153201377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.405+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/1153201377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbb16f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.405+0000 7fdb3ede5740 1 -- 172.21.15.1:0/1153201377 >> 172.21.15.1:0/1153201377 conn(0x55db5cba3ba0 msgr2=0x55db5cba3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.405+0000 7fdb3ede5740 1 -- 172.21.15.1:0/1153201377 shutdown_connections 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.406+0000 7fdb3ede5740 1 -- 172.21.15.1:0/1153201377 wait complete. 2024-09-19T09:04:43.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.406+0000 7fdb3ede5740 1 -- start start 2024-09-19T09:04:43.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.406+0000 7fdb3ede5740 1 Processor -- start 2024-09-19T09:04:43.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.406+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbc3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.406+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb3ede5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbbe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbbe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbbe540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56130/0 (socket says 172.21.15.1:56130) 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 -- 172.21.15.1:0/527882351 learned_addr learned my addr 172.21.15.1:0/527882351 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb3659c640 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb381aa160 con 0x55db5cbb76c0 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdb381ab5d0 con 0x55db5cbb6da0 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdb381aa830 con 0x55db5cbb1d60 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbc3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 -- 172.21.15.1:0/527882351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 msgr2=0x55db5cbc3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:43.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbc3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 -- 172.21.15.1:0/527882351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 msgr2=0x55db5cbc3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.407+0000 7fdb35d9b640 1 -- 172.21.15.1:0/527882351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db5cbbed40 con 0x55db5cbb76c0 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.408+0000 7fdb35d9b640 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbbe540 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009680 tx=0x7fdb2c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32158413fccf2074 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.408+0000 7fdb1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.408+0000 7fdb3ede5740 10 client.0 _ll_register_callbacks cb 0x7fdb28005870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.408+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb2c031840 con 0x55db5cbb76c0 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.408+0000 7fdb1dffb640 1 -- 172.21.15.1:0/527882351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c063070 con 0x55db5cbb76c0 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.408+0000 7fdb1dffb640 1 -- 172.21.15.1:0/527882351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdb2c0035f0 con 0x55db5cbb76c0 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.408+0000 7fdb1dffb640 1 -- 172.21.15.1:0/527882351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdb2c03e030 con 0x55db5cbb76c0 2024-09-19T09:04:43.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3ede5740 10 client.15543 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:43.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55db5cc36670 con 0x55db5cbb76c0 2024-09-19T09:04:43.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb1dffb640 1 -- 172.21.15.1:0/527882351 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdb2c066020 con 0x55db5cbb76c0 2024-09-19T09:04:43.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3ede5740 10 client.15543 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3ede5740 10 client.15543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3ede5740 20 client.15543 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55db5cc36840 0x55db5cc38c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3ede5740 4 client.15543 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fdb2c031840 con 0x55db5cc36840 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.409+0000 7fdb3659c640 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55db5cc36840 0x55db5cc38c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.410+0000 7fdb3659c640 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55db5cc36840 0x55db5cc38c30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=171a4daf235b5aef server_cookie=8740c22abc163610 in_seq=0 out_seq=0 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.410+0000 7fdb1dffb640 10 client.15543 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.411+0000 7fdb1dffb640 1 -- 172.21.15.1:0/527882351 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fdb2c031840 con 0x55db5cc36840 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.411+0000 7fdb1dffb640 10 client.15543 handle_command_reply: tid=0 2024-09-19T09:04:43.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.411+0000 7fdb3ede5740 1 client.15543 shutdown 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 msgr2=0x55db5cbbe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbbe540 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009680 tx=0x7fdb2c005d50 comp rx=0 tx=0).stop 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 shutdown_connections 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55db5cc36840 0x55db5cc38c30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb1dffb640 0 client.15543 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db5cbb76c0 0x55db5cbbe540 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db5cbb6da0 0x55db5cbc3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 --2- 172.21.15.1:0/527882351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55db5cbb1d60 0x55db5cbc3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 >> 172.21.15.1:0/527882351 conn(0x55db5cba3ba0 msgr2=0x55db5cbb91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:43.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 shutdown_connections 2024-09-19T09:04:43.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 1 -- 172.21.15.1:0/527882351 wait complete. 2024-09-19T09:04:43.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.412+0000 7fdb3ede5740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T09:04:43.414 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:04:43.414 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:04:43.414 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "7c12dd09-f409-4b40-930a-3788048c95e0", 2024-09-19T09:04:43.415 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:04:43.415 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:04:43.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.413+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb200a32d0 msgr2=0x7fdb200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:43.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.413+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb200a32d0 0x7fdb200a5790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdb30098680 tx=0x7fdb30005820 comp rx=0 tx=0).stop 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.413+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3643938566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb38198730 msgr2=0x7fdb38198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.413+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb38198730 0x7fdb38198bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000eaa0 tx=0x7fdb3000ef60 comp rx=0 tx=0).stop 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.413+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3643938566 shutdown_connections 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.413+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb38198730 0x7fdb38198bb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.414+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdb200a32d0 0x7fdb200a5790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.414+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb381082a0 0x7fdb3819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.414+0000 7fdb3ca0c640 1 --2- 172.21.15.1:0/3643938566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb38102d30 0x7fdb3819e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.414+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3643938566 >> 172.21.15.1:0/3643938566 conn(0x7fdb380fc7d0 msgr2=0x7fdb380fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.414+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3643938566 shutdown_connections 2024-09-19T09:04:43.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:43.414+0000 7fdb3ca0c640 1 -- 172.21.15.1:0/3643938566 wait complete. 2024-09-19T09:04:44.026 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:43 smithi001 ceph-mon[30939]: pgmap v356: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:04:44.027 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:43 smithi001 ceph-mon[30939]: scrub queued for path: / 2024-09-19T09:04:44.027 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:43 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:44.027 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:43 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:04:44.027 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:43 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:44.068 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:04:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:43 smithi064 ceph-mon[35179]: pgmap v356: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:04:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:43 smithi064 ceph-mon[35179]: scrub queued for path: / 2024-09-19T09:04:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:43 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:43 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:04:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:43 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:44.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:43 smithi022 ceph-mon[35107]: pgmap v356: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:04:44.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:43 smithi022 ceph-mon[35107]: scrub queued for path: / 2024-09-19T09:04:44.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:43 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:44.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:43 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:04:44.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:43 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 -- 172.21.15.1:0/3342047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0104ef0 msgr2=0x7f8cc01072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 --2- 172.21.15.1:0/3342047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0104ef0 0x7f8cc01072e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009900 tx=0x7f8cb002a410 comp rx=0 tx=0).stop 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 -- 172.21.15.1:0/3342047 shutdown_connections 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 --2- 172.21.15.1:0/3342047 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc0107820 0x7f8cc0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 --2- 172.21.15.1:0/3342047 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0104ef0 0x7f8cc01072e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 --2- 172.21.15.1:0/3342047 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cc01025c0 0x7f8cc01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 -- 172.21.15.1:0/3342047 >> 172.21.15.1:0/3342047 conn(0x7f8cc00fc1c0 msgr2=0x7f8cc00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 -- 172.21.15.1:0/3342047 shutdown_connections 2024-09-19T09:04:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.860+0000 7f8cc8731640 1 -- 172.21.15.1:0/3342047 wait complete. 2024-09-19T09:04:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.861+0000 7f8cc8731640 1 Processor -- start 2024-09-19T09:04:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.861+0000 7f8cc8731640 1 -- start start 2024-09-19T09:04:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.861+0000 7f8cc8731640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cc01025c0 0x7f8cc0101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.861+0000 7f8cc8731640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc0104ef0 0x7f8cc0100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.861+0000 7f8cc8731640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0107820 0x7f8cc0100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.861+0000 7f8cc8731640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc010d980 con 0x7f8cc0107820 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.861+0000 7f8cc8731640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc010d800 con 0x7f8cc0104ef0 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.861+0000 7f8cc8731640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc010db00 con 0x7f8cc01025c0 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc6cce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0107820 0x7f8cc0100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc6cce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0107820 0x7f8cc0100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56152/0 (socket says 172.21.15.1:56152) 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc0104ef0 0x7f8cc0100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc6cce640 1 -- 172.21.15.1:0/1550911259 learned_addr learned my addr 172.21.15.1:0/1550911259 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cc01025c0 0x7f8cc0101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/1550911259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cc01025c0 msgr2=0x7f8cc0101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cc01025c0 0x7f8cc0101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0107820 msgr2=0x7f8cc0100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0107820 0x7f8cc0100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/1550911259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc0101340 con 0x7f8cc0104ef0 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cc01025c0 0x7f8cc0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.862+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc0104ef0 0x7f8cc0100570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009230 tx=0x7f8cb0032d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.863+0000 7f8cb77fe640 1 -- 172.21.15.1:0/1550911259 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb003f070 con 0x7f8cc0104ef0 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.863+0000 7f8cc8731640 1 -- 172.21.15.1:0/1550911259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc01a20a0 con 0x7f8cc0104ef0 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.863+0000 7f8cb77fe640 1 -- 172.21.15.1:0/1550911259 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cb003b460 con 0x7f8cc0104ef0 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.863+0000 7f8cc8731640 1 -- 172.21.15.1:0/1550911259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc01a2610 con 0x7f8cc0104ef0 2024-09-19T09:04:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.863+0000 7f8cb77fe640 1 -- 172.21.15.1:0/1550911259 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0035070 con 0x7f8cc0104ef0 2024-09-19T09:04:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.865+0000 7f8cb77fe640 1 -- 172.21.15.1:0/1550911259 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f8cb0003a00 con 0x7f8cc0104ef0 2024-09-19T09:04:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.866+0000 7f8cb77fe640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8cac0a3350 0x7f8cac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.866+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8cac0a3350 0x7f8cac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.866+0000 7f8ccb4cc740 1 Processor -- start 2024-09-19T09:04:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.866+0000 7f8cb77fe640 1 -- 172.21.15.1:0/1550911259 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8cb00f0230 con 0x7f8cc0104ef0 2024-09-19T09:04:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.867+0000 7f8ccb4cc740 1 -- start start 2024-09-19T09:04:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.867+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8cac0a3350 0x7f8cac0a5810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009fc0 tx=0x7f8cbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.867+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8a9a0 0x5598f4e8ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.867+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8b2e0 0x5598f4e8fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.867+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 0x5598f4e92830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.867+0000 7f8cc5ccc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8b2e0 0x5598f4e8fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.867+0000 7f8cc5ccc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8b2e0 0x5598f4e8fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56168/0 (socket says 172.21.15.1:56168) 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3348453953 learned_addr learned my addr 172.21.15.1:0/3348453953 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3348453953 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598f4dee2f0 con 0x5598f4e8b2e0 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3348453953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5598f4d96270 con 0x5598f4e90370 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8a9a0 0x5598f4e8ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3348453953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5598f4dea2b0 con 0x5598f4e8a9a0 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc6cce640 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 0x5598f4e92830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc64cd640 1 -- 172.21.15.1:0/3348453953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 msgr2=0x5598f4e92830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 0x5598f4e92830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc64cd640 1 -- 172.21.15.1:0/3348453953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8b2e0 msgr2=0x5598f4e8fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8b2e0 0x5598f4e8fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc64cd640 1 -- 172.21.15.1:0/3348453953 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f4d95340 con 0x5598f4e8a9a0 2024-09-19T09:04:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8b2e0 0x5598f4e8fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.868+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8a9a0 0x5598f4e8ada0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc011ca0 tx=0x7f8cbc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2884a8d698bf3e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.869+0000 7f8cb4ff9640 1 -- 172.21.15.1:0/3348453953 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00f480 con 0x5598f4e8a9a0 2024-09-19T09:04:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.869+0000 7f8cb4ff9640 1 -- 172.21.15.1:0/3348453953 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cbc00fb20 con 0x5598f4e8a9a0 2024-09-19T09:04:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.869+0000 7f8cb4ff9640 1 -- 172.21.15.1:0/3348453953 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc01cb60 con 0x5598f4e8a9a0 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.869+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3348453953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8a9a0 msgr2=0x5598f4e8ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.869+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8a9a0 0x5598f4e8ada0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc011ca0 tx=0x7f8cbc014000 comp rx=0 tx=0).stop 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3348453953 shutdown_connections 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 0x5598f4e92830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8b2e0 0x5598f4e8fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3348453953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8a9a0 0x5598f4e8ada0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3348453953 >> 172.21.15.1:0/3348453953 conn(0x5598f4e86010 msgr2=0x5598f4e86410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3348453953 shutdown_connections 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3348453953 wait complete. 2024-09-19T09:04:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 -- start start 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.870+0000 7f8ccb4cc740 1 Processor -- start 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e94c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e95190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 0x5598f4e9c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598f4e93340 con 0x5598f4e8a9a0 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5598f4d77290 con 0x5598f4e90370 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5598f4e934c0 con 0x5598f4e8b2e0 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8ccb4cc740 10 client.0 _ll_register_callbacks cb 0x5598f4da8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e95190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e95190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:60020/0 (socket says 172.21.15.1:60020) 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3314352842 learned_addr learned my addr 172.21.15.1:0/3314352842 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e94c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc6cce640 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 0x5598f4e9c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3314352842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 msgr2=0x5598f4e9c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 0x5598f4e9c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3314352842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 msgr2=0x5598f4e94c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e94c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3314352842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f4b01210 con 0x5598f4e8b2e0 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e95190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009900 tx=0x7f8cb0005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ff9000ea90213c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.871+0000 7f8ca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3314352842 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00ef030 con 0x5598f4e8b2e0 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3314352842 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8cb00b8d90 con 0x5598f4e8b2e0 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3314352842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cbc00fb20 con 0x5598f4e8b2e0 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3314352842 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8cb0048040 con 0x5598f4e8b2e0 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ccb4cc740 10 client.25177 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3314352842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5598f4bcd620 con 0x5598f4e8b2e0 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3314352842 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cbc00fb20 con 0x5598f4e8b2e0 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3314352842 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8cb00c4e50 con 0x5598f4e8b2e0 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.872+0000 7f8ccb4cc740 10 client.25177 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.873+0000 7f8ccb4cc740 10 client.25177 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.873+0000 7f8ccb4cc740 20 client.25177 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.873+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5598f4ea0960 0x5598f4ea2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.873+0000 7f8ccb4cc740 4 client.25177 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.873+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3314352842 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598f4dfba20 con 0x5598f4ea0960 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.873+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5598f4ea0960 0x5598f4ea2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.874+0000 7f8ca9ffb640 10 client.25177 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.874+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5598f4ea0960 0x5598f4ea2da0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f579bc10408833e server_cookie=1d7027da66d0b482 in_seq=0 out_seq=0 2024-09-19T09:04:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.874+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3314352842 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598f4dfba20 con 0x5598f4ea0960 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.874+0000 7f8ca9ffb640 10 client.25177 handle_command_reply: tid=0 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.874+0000 7f8ccb4cc740 1 client.25177 shutdown 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3314352842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 msgr2=0x5598f4e95190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e95190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009900 tx=0x7f8cb0005d50 comp rx=0 tx=0).stop 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3314352842 shutdown_connections 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5598f4ea0960 0x5598f4ea2da0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e90370 0x5598f4e9c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e95190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3314352842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e94c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3314352842 >> 172.21.15.1:0/3314352842 conn(0x5598f4e86010 msgr2=0x5598f4e87820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ca9ffb640 0 client.25177 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3314352842 shutdown_connections 2024-09-19T09:04:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3314352842 wait complete. 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.875+0000 7f8ccb4cc740 20 client.25177 trim_cache size 0 max 16384 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8ccb4cc740 1 Processor -- start 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8ccb4cc740 1 -- start start 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e86010 0x5598f4e93fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8a9a0 0x5598f4e9c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e86ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca4010da0 con 0x5598f4e86010 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca400e670 con 0x5598f4e8a9a0 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca400c4c0 con 0x5598f4e8b2e0 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.904+0000 7f8cc64cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e86010 0x5598f4e93fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc64cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e86010 0x5598f4e93fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56190/0 (socket says 172.21.15.1:56190) 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc64cd640 1 -- 172.21.15.1:0/1531916540 learned_addr learned my addr 172.21.15.1:0/1531916540 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8a9a0 0x5598f4e9c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc6cce640 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e86ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc64cd640 1 -- 172.21.15.1:0/1531916540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 msgr2=0x5598f4e86ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e86ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc64cd640 1 -- 172.21.15.1:0/1531916540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8a9a0 msgr2=0x5598f4e9c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8a9a0 0x5598f4e9c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc64cd640 1 -- 172.21.15.1:0/1531916540 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f4e8a5e0 con 0x5598f4e86010 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8a9a0 0x5598f4e9c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e86010 0x5598f4e93fd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc011ca0 tx=0x7f8cbc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80c4c33fe8f6d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cabfff640 1 -- 172.21.15.1:0/1531916540 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc01c3f0 con 0x5598f4e86010 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cabfff640 1 -- 172.21.15.1:0/1531916540 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cbc01c590 con 0x5598f4e86010 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.905+0000 7f8cabfff640 1 -- 172.21.15.1:0/1531916540 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc004680 con 0x5598f4e86010 2024-09-19T09:04:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/1531916540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e86010 msgr2=0x5598f4e93fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e86010 0x5598f4e93fd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc011ca0 tx=0x7f8cbc009b30 comp rx=0 tx=0).stop 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/1531916540 shutdown_connections 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e8b2e0 0x5598f4e86ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8a9a0 0x5598f4e9c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/1531916540 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e86010 0x5598f4e93fd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/1531916540 >> 172.21.15.1:0/1531916540 conn(0x5598f4e8fec0 msgr2=0x5598f4e938c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/1531916540 shutdown_connections 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/1531916540 wait complete. 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 -- start start 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.906+0000 7f8ccb4cc740 1 Processor -- start 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e86010 0x5598f4e99690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e99bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8ccb4cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8b2e0 0x5598f4e9ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca400cb30 con 0x5598f4e8a9a0 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca400dfa0 con 0x5598f4e8b2e0 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8ccb4cc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca400d200 con 0x5598f4e86010 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8ccb4cc740 10 client.0 _ll_register_callbacks cb 0x7f8cb00edad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc5ccc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e99bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc5ccc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e99bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56206/0 (socket says 172.21.15.1:56206) 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3227812893 learned_addr learned my addr 172.21.15.1:0/3227812893 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e86010 0x5598f4e99690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc6cce640 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8b2e0 0x5598f4e9ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3227812893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e86010 msgr2=0x5598f4e99690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e86010 0x5598f4e99690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3227812893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8b2e0 msgr2=0x5598f4e9ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8b2e0 0x5598f4e9ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.907+0000 7f8cc5ccc640 1 -- 172.21.15.1:0/3227812893 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f4e812d0 con 0x5598f4e8a9a0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8cc5ccc640 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e99bd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00c4db0 tx=0x7f8cb00db1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf26d69f614b543 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3227812893 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb00ef040 con 0x5598f4e8a9a0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3227812893 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8cb00bbbc0 con 0x5598f4e8a9a0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3227812893 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cbc01c590 con 0x5598f4e8a9a0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3227812893 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8cb00bc720 con 0x5598f4e8a9a0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 10 client.15561 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3227812893 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5598f4e812d0 con 0x5598f4e8a9a0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3227812893 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cb00d5070 con 0x5598f4e8a9a0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3227812893 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8cb00bb5e0 con 0x5598f4e8a9a0 2024-09-19T09:04:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 10 client.15561 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 20 client.15561 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5598f4e90370 0x5598f4f0d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 4 client.15561 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.908+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3227812893 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8cbc01c590 con 0x5598f4e90370 2024-09-19T09:04:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.909+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5598f4e90370 0x5598f4f0d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.909+0000 7f8ca9ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.910+0000 7f8cc64cd640 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5598f4e90370 0x5598f4f0d6e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cbb8ebc2843d23e server_cookie=82a4489cd4a76449 in_seq=0 out_seq=0 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.913+0000 7f8ca9ffb640 1 -- 172.21.15.1:0/3227812893 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8cbc01c590 con 0x5598f4e90370 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.913+0000 7f8ca9ffb640 10 client.15561 handle_command_reply: tid=0 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 client.15561 shutdown 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3227812893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 msgr2=0x5598f4e99bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e99bd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00c4db0 tx=0x7f8cb00db1c0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3227812893 shutdown_connections 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5598f4e90370 0x5598f4f0d6e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598f4e8b2e0 0x5598f4e9ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598f4e8a9a0 0x5598f4e99bd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 --2- 172.21.15.1:0/3227812893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5598f4e86010 0x5598f4e99690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3227812893 >> 172.21.15.1:0/3227812893 conn(0x5598f4e8fec0 msgr2=0x5598f4e940e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ca9ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3227812893 shutdown_connections 2024-09-19T09:04:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 1 -- 172.21.15.1:0/3227812893 wait complete. 2024-09-19T09:04:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.914+0000 7f8ccb4cc740 20 client.15561 trim_cache size 0 max 16384 2024-09-19T09:04:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:04:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:04:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:04:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:04:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 -- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8cac0a3350 msgr2=0x7f8cac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8cac0a3350 0x7f8cac0a5810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009fc0 tx=0x7f8cbc005f90 comp rx=0 tx=0).stop 2024-09-19T09:04:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 -- 172.21.15.1:0/1550911259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc0104ef0 msgr2=0x7f8cc0100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc0104ef0 0x7f8cc0100570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009230 tx=0x7f8cb0032d70 comp rx=0 tx=0).stop 2024-09-19T09:04:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 -- 172.21.15.1:0/1550911259 shutdown_connections 2024-09-19T09:04:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cc0107820 0x7f8cc0100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc0104ef0 0x7f8cc0100570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8cac0a3350 0x7f8cac0a5810 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 --2- 172.21.15.1:0/1550911259 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8cc01025c0 0x7f8cc0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 -- 172.21.15.1:0/1550911259 >> 172.21.15.1:0/1550911259 conn(0x7f8cc00fc1c0 msgr2=0x7f8cc0102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.915+0000 7f8cc8731640 1 -- 172.21.15.1:0/1550911259 shutdown_connections 2024-09-19T09:04:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:44.916+0000 7f8cc8731640 1 -- 172.21.15.1:0/1550911259 wait complete. 2024-09-19T09:04:44.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.919+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/3092980408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7ac105a90 msgr2=0x7fa7ac105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.919+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/3092980408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7ac105a90 0x7fa7ac105e70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009930 tx=0x7fa79c02a420 comp rx=0 tx=0).stop 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.921+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/3092980408 shutdown_connections 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.921+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/3092980408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7ac101bc0 0x7fa7ac10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.921+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/3092980408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7ac101240 0x7fa7ac101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.921+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/3092980408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7ac105a90 0x7fa7ac105e70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.921+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/3092980408 >> 172.21.15.1:0/3092980408 conn(0x7fa7ac077210 msgr2=0x7fa7ac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.921+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/3092980408 shutdown_connections 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.921+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/3092980408 wait complete. 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.922+0000 7fa7b0ac8640 1 Processor -- start 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.922+0000 7fa7b0ac8640 1 -- start start 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.922+0000 7fa7b0ac8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7ac101240 0x7fa7ac1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.922+0000 7fa7b0ac8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7ac101bc0 0x7fa7ac1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.922+0000 7fa7b0ac8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7ac105a90 0x7fa7ac19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.922+0000 7fa7b0ac8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10ff60 con 0x7fa7ac101bc0 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.922+0000 7fa7b0ac8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10fde0 con 0x7fa7ac101240 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.922+0000 7fa7b0ac8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac1145f0 con 0x7fa7ac105a90 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7a9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7ac101bc0 0x7fa7ac1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7a9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7ac101bc0 0x7fa7ac1a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56220/0 (socket says 172.21.15.1:56220) 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7a9d9b640 1 -- 172.21.15.1:0/897877492 learned_addr learned my addr 172.21.15.1:0/897877492 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7ac101240 0x7fa7ac1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7ac105a90 0x7fa7ac19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7a9d9b640 1 -- 172.21.15.1:0/897877492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7ac105a90 msgr2=0x7fa7ac19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7a9d9b640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7ac105a90 0x7fa7ac19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7a9d9b640 1 -- 172.21.15.1:0/897877492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7ac101240 msgr2=0x7fa7ac1a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7a9d9b640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7ac101240 0x7fa7ac1a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.923+0000 7fa7a9d9b640 1 -- 172.21.15.1:0/897877492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac19af00 con 0x7fa7ac101bc0 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.924+0000 7fa7a9d9b640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7ac101bc0 0x7fa7ac1a0ab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000d950 tx=0x7fa7a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.924+0000 7fa79b7fe640 1 -- 172.21.15.1:0/897877492 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0017030 con 0x7fa7ac101bc0 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.924+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/897877492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac19b1f0 con 0x7fa7ac101bc0 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.924+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/897877492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac1a7560 con 0x7fa7ac101bc0 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.925+0000 7fa79b7fe640 1 -- 172.21.15.1:0/897877492 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa7a0004020 con 0x7fa7ac101bc0 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.925+0000 7fa79b7fe640 1 -- 172.21.15.1:0/897877492 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0005020 con 0x7fa7ac101bc0 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.927+0000 7fa79b7fe640 1 -- 172.21.15.1:0/897877492 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fa7a00051c0 con 0x7fa7ac101bc0 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.928+0000 7fa7b2ea1740 1 Processor -- start 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.928+0000 7fa7b2ea1740 1 -- start start 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c074a0 0x5569e6c07880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c12140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa79b7fe640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa7940a33d0 0x7fa7940a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c12680 0x5569e6c14a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5569e6b6d2e0 con 0x5569e6c07dc0 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5569e6b14ce0 con 0x5569e6c12680 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5569e6b692a0 con 0x5569e6c074a0 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c12140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c12140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56236/0 (socket says 172.21.15.1:56236) 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aa59c640 1 -- 172.21.15.1:0/134102353 learned_addr learned my addr 172.21.15.1:0/134102353 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa79b7fe640 1 -- 172.21.15.1:0/897877492 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa7a00cf3d0 con 0x7fa7ac101bc0 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c12680 0x5569e6c14a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7a9d9b640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa7940a33d0 0x7fa7940a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aa59c640 1 -- 172.21.15.1:0/134102353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c074a0 msgr2=0x5569e6c07880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c074a0 0x5569e6c07880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aa59c640 1 -- 172.21.15.1:0/134102353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c12680 msgr2=0x5569e6c14a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c12680 0x5569e6c14a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aa59c640 1 -- 172.21.15.1:0/134102353 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569e6af9440 con 0x5569e6c07dc0 2024-09-19T09:04:44.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.929+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c12680 0x5569e6c14a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:44.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.930+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c12140 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa79c02a940 tx=0x7fa79c031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f8fa323a029bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.930+0000 7fa798ff9640 1 -- 172.21.15.1:0/134102353 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c040070 con 0x5569e6c07dc0 2024-09-19T09:04:44.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.930+0000 7fa798ff9640 1 -- 172.21.15.1:0/134102353 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa79c005020 con 0x5569e6c07dc0 2024-09-19T09:04:44.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.930+0000 7fa798ff9640 1 -- 172.21.15.1:0/134102353 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c035040 con 0x5569e6c07dc0 2024-09-19T09:04:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/134102353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 msgr2=0x5569e6c12140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c12140 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa79c02a940 tx=0x7fa79c031640 comp rx=0 tx=0).stop 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7a9d9b640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa7940a33d0 0x7fa7940a5890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00974d0 tx=0x7fa7a0004f20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/134102353 shutdown_connections 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c12680 0x5569e6c14a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c12140 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/134102353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c074a0 0x5569e6c07880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/134102353 >> 172.21.15.1:0/134102353 conn(0x5569e6c03a30 msgr2=0x5569e6c03e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/134102353 shutdown_connections 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.931+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/134102353 wait complete. 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 1 -- start start 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 1 Processor -- start 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c11f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c0f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c12680 0x5569e6c0f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5569e6c15250 con 0x5569e6c07dc0 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5569e6b28050 con 0x5569e6c074a0 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5569e6c153d0 con 0x5569e6c12680 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7b2ea1740 10 client.0 _ll_register_callbacks cb 0x5569e6b68160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7aa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c0f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7aa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c0f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56250/0 (socket says 172.21.15.1:56250) 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.932+0000 7fa7aa59c640 1 -- 172.21.15.1:0/4169721968 learned_addr learned my addr 172.21.15.1:0/4169721968 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.933+0000 7fa7aa59c640 1 -- 172.21.15.1:0/4169721968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c12680 msgr2=0x5569e6c0f760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.933+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c12680 0x5569e6c0f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.933+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c12680 0x5569e6c0f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.933+0000 7fa7aa59c640 1 -- 172.21.15.1:0/4169721968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 msgr2=0x5569e6c11f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.933+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c11f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.933+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c11f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.933+0000 7fa7aa59c640 1 -- 172.21.15.1:0/4169721968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569e68de3c0 con 0x5569e6c07dc0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c0f220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa79c005c40 tx=0x7fa79c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7850996d85d125cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa791ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa791ffb640 1 -- 172.21.15.1:0/4169721968 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c04d060 con 0x5569e6c07dc0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/4169721968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa79c005020 con 0x5569e6c07dc0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa791ffb640 1 -- 172.21.15.1:0/4169721968 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa79c004030 con 0x5569e6c07dc0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa791ffb640 1 -- 172.21.15.1:0/4169721968 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa79c040070 con 0x5569e6c07dc0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa7b2ea1740 10 client.15573 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/4169721968 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5569e6c20bc0 con 0x5569e6c07dc0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.934+0000 7fa791ffb640 1 -- 172.21.15.1:0/4169721968 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa79c005020 con 0x5569e6c07dc0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.935+0000 7fa791ffb640 1 -- 172.21.15.1:0/4169721968 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa79c003b30 con 0x5569e6c07dc0 2024-09-19T09:04:44.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.935+0000 7fa7b2ea1740 10 client.15573 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.935+0000 7fa7b2ea1740 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.935+0000 7fa7b2ea1740 20 client.15573 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.935+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5569e6c21f10 0x5569e6c24300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.935+0000 7fa7b2ea1740 4 client.15573 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.935+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/4169721968 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569e6b7a850 con 0x5569e6c21f10 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.936+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5569e6c21f10 0x5569e6c24300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.936+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5569e6c21f10 0x5569e6c24300 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15f04c624e8cd421 server_cookie=c2b669cba0e0cdf in_seq=0 out_seq=0 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.936+0000 7fa791ffb640 10 client.15573 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa791ffb640 1 -- 172.21.15.1:0/4169721968 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569e6b7a850 con 0x5569e6c21f10 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa791ffb640 10 client.15573 handle_command_reply: tid=0 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 client.15573 shutdown 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/4169721968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 msgr2=0x5569e6c0f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c0f220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa79c005c40 tx=0x7fa79c02a420 comp rx=0 tx=0).stop 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/4169721968 shutdown_connections 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5569e6c21f10 0x5569e6c24300 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c12680 0x5569e6c0f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c07dc0 0x5569e6c0f220 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/4169721968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c11f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/4169721968 >> 172.21.15.1:0/4169721968 conn(0x5569e6c03a30 msgr2=0x5569e6c09710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa791ffb640 0 client.15573 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/4169721968 shutdown_connections 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.937+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/4169721968 wait complete. 2024-09-19T09:04:44.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.938+0000 7fa7b2ea1740 20 client.15573 trim_cache size 0 max 16384 2024-09-19T09:04:44.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.971+0000 7fa7b2ea1740 1 Processor -- start 2024-09-19T09:04:44.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.971+0000 7fa7b2ea1740 1 -- start start 2024-09-19T09:04:44.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.971+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c03a30 0x5569e6c11190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c074a0 0x5569e6c29ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 0x5569e6c2a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c010d70 con 0x5569e6c074a0 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c00e640 con 0x5569e6c03a30 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c00c490 con 0x5569e6c07dc0 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c074a0 0x5569e6c29ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aa59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c074a0 0x5569e6c29ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56264/0 (socket says 172.21.15.1:56264) 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aa59c640 1 -- 172.21.15.1:0/3924595222 learned_addr learned my addr 172.21.15.1:0/3924595222 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c03a30 0x5569e6c11190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aad9d640 1 -- 172.21.15.1:0/3924595222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 msgr2=0x5569e6c2a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 0x5569e6c2a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aad9d640 1 -- 172.21.15.1:0/3924595222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c074a0 msgr2=0x5569e6c29ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c074a0 0x5569e6c29ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aad9d640 1 -- 172.21.15.1:0/3924595222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569e6c07bf0 con 0x5569e6c03a30 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c074a0 0x5569e6c29ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:44.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.972+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c03a30 0x5569e6c11190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5569e6c24a00 tx=0x7fa7a4007520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e7b8cb9c8e46be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.973+0000 7fa793fff640 1 -- 172.21.15.1:0/3924595222 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4003970 con 0x5569e6c03a30 2024-09-19T09:04:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.973+0000 7fa793fff640 1 -- 172.21.15.1:0/3924595222 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa7a401f070 con 0x5569e6c03a30 2024-09-19T09:04:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.973+0000 7fa793fff640 1 -- 172.21.15.1:0/3924595222 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a400f990 con 0x5569e6c03a30 2024-09-19T09:04:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/3924595222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c03a30 msgr2=0x5569e6c11190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c03a30 0x5569e6c11190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5569e6c24a00 tx=0x7fa7a4007520 comp rx=0 tx=0).stop 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/3924595222 shutdown_connections 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 0x5569e6c2a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c074a0 0x5569e6c29ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/3924595222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c03a30 0x5569e6c11190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/3924595222 >> 172.21.15.1:0/3924595222 conn(0x5569e6c0f8c0 msgr2=0x5569e6c10a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/3924595222 shutdown_connections 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/3924595222 wait complete. 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 -- start start 2024-09-19T09:04:44.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.974+0000 7fa7b2ea1740 1 Processor -- start 2024-09-19T09:04:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c03a30 0x5569e6c1aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c17e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7b2ea1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 0x5569e6c18370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c00cb00 con 0x5569e6c03a30 2024-09-19T09:04:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c00df70 con 0x5569e6c074a0 2024-09-19T09:04:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7b2ea1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c00d1d0 con 0x5569e6c07dc0 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7b2ea1740 10 client.0 _ll_register_callbacks cb 0x7fa79c031490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c03a30 0x5569e6c1aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c03a30 0x5569e6c1aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56268/0 (socket says 172.21.15.1:56268) 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aad9d640 1 -- 172.21.15.1:0/1440459070 learned_addr learned my addr 172.21.15.1:0/1440459070 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c17e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 0x5569e6c18370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aa59c640 1 -- 172.21.15.1:0/1440459070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 msgr2=0x5569e6c18370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 0x5569e6c18370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aa59c640 1 -- 172.21.15.1:0/1440459070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c03a30 msgr2=0x5569e6c1aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c03a30 0x5569e6c1aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.975+0000 7fa7aa59c640 1 -- 172.21.15.1:0/1440459070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569e6c188b0 con 0x5569e6c074a0 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.976+0000 7fa7aa59c640 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c17e30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa79c03c490 tx=0x7fa79c0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e04e74d0fc782dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.976+0000 7fa791ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:04:44.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.976+0000 7fa791ffb640 1 -- 172.21.15.1:0/1440459070 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c04d040 con 0x5569e6c074a0 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.976+0000 7fa791ffb640 1 -- 172.21.15.1:0/1440459070 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa79c03cbb0 con 0x5569e6c074a0 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.976+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/1440459070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7a401f070 con 0x5569e6c074a0 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.976+0000 7fa791ffb640 1 -- 172.21.15.1:0/1440459070 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa79c035040 con 0x5569e6c074a0 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.976+0000 7fa7b2ea1740 10 client.25205 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.976+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/1440459070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5569e6c8c7d0 con 0x5569e6c074a0 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa791ffb640 1 -- 172.21.15.1:0/1440459070 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa7a401f070 con 0x5569e6c074a0 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa791ffb640 1 -- 172.21.15.1:0/1440459070 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa79c004bb0 con 0x5569e6c074a0 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa7b2ea1740 10 client.25205 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa7b2ea1740 10 client.25205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa7b2ea1740 20 client.25205 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5569e6c12680 0x5569e6c8ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa7b2ea1740 4 client.25205 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/1440459070 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5569e6b74d60 con 0x5569e6c12680 2024-09-19T09:04:44.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.977+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5569e6c12680 0x5569e6c8ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7aad9d640 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5569e6c12680 0x5569e6c8ef90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55f468c1ea42ecd8 server_cookie=bd287a80e4663b82 in_seq=0 out_seq=0 2024-09-19T09:04:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa791ffb640 10 client.25205 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa791ffb640 1 -- 172.21.15.1:0/1440459070 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5569e6b74d60 con 0x5569e6c12680 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa791ffb640 10 client.25205 handle_command_reply: tid=0 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 client.25205 shutdown 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 msgr2=0x5569e6c17e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c17e30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa79c03c490 tx=0x7fa79c0047e0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/1440459070 shutdown_connections 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5569e6c12680 0x5569e6c8ef90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa791ffb640 0 client.25205 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5569e6c07dc0 0x5569e6c18370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5569e6c074a0 0x5569e6c17e30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 --2- 172.21.15.1:0/1440459070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5569e6c03a30 0x5569e6c1aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/1440459070 >> 172.21.15.1:0/1440459070 conn(0x5569e6c0f8c0 msgr2=0x5569e6c112a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/1440459070 shutdown_connections 2024-09-19T09:04:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 1 -- 172.21.15.1:0/1440459070 wait complete. 2024-09-19T09:04:44.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.978+0000 7fa7b2ea1740 20 client.25205 trim_cache size 0 max 16384 2024-09-19T09:04:44.982 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:04:44.982 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:04:44.982 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:04:44.982 INFO:teuthology.orchestra.run.smithi001.stdout: "7c12dd09-f409-4b40-930a-3788048c95e0": { 2024-09-19T09:04:44.982 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:04:44.982 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "7c12dd09-f409-4b40-930a-3788048c95e0", 2024-09-19T09:04:44.982 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:04:44.983 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:44.983 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:04:44.983 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.979+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa7940a33d0 msgr2=0x7fa7940a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.979+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa7940a33d0 0x7fa7940a5890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00974d0 tx=0x7fa7a0004f20 comp rx=0 tx=0).stop 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.979+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7ac101bc0 msgr2=0x7fa7ac1a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.979+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7ac101bc0 0x7fa7ac1a0ab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000d950 tx=0x7fa7a000de10 comp rx=0 tx=0).stop 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.979+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/897877492 shutdown_connections 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.979+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa7940a33d0 0x7fa7940a5890 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.979+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa7ac105a90 0x7fa7ac19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.980+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa7ac101bc0 0x7fa7ac1a0ab0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.980+0000 7fa7b0ac8640 1 --2- 172.21.15.1:0/897877492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7ac101240 0x7fa7ac1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.980+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/897877492 >> 172.21.15.1:0/897877492 conn(0x7fa7ac077210 msgr2=0x7fa7ac103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:44.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.980+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/897877492 shutdown_connections 2024-09-19T09:04:44.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:04:44.980+0000 7fa7b0ac8640 1 -- 172.21.15.1:0/897877492 wait complete. 2024-09-19T09:04:45.770 INFO:tasks.cephfs.filesystem:scrub status for tag:7c12dd09-f409-4b40-930a-3788048c95e0 - {'path': '/', 'tag': '7c12dd09-f409-4b40-930a-3788048c95e0', 'options': 'recursive,force'} 2024-09-19T09:04:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:45 smithi001 ceph-mon[30939]: pgmap v357: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:04:46.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:45 smithi064 ceph-mon[35179]: pgmap v357: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:04:46.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:45 smithi022 ceph-mon[35107]: pgmap v357: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:04:48.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:47 smithi001 ceph-mon[30939]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T09:04:48.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:47 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:04:48.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:47 smithi064 ceph-mon[35179]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T09:04:48.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:47 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:04:48.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:47 smithi022 ceph-mon[35107]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T09:04:48.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:47 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:04:50.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:49 smithi001 ceph-mon[30939]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:04:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:49 smithi064 ceph-mon[35179]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:04:50.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:49 smithi022 ceph-mon[35107]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:04:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:51 smithi001 ceph-mon[30939]: pgmap v360: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T09:04:52.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:51 smithi064 ceph-mon[35179]: pgmap v360: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T09:04:52.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:51 smithi022 ceph-mon[35107]: pgmap v360: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T09:04:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:53 smithi001 ceph-mon[30939]: pgmap v361: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:04:54.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:53 smithi064 ceph-mon[35179]: pgmap v361: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:04:54.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:53 smithi022 ceph-mon[35107]: pgmap v361: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:04:56.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:55 smithi001 ceph-mon[30939]: pgmap v362: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:04:56.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:55 smithi064 ceph-mon[35179]: pgmap v362: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:04:56.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:55 smithi022 ceph-mon[35107]: pgmap v362: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:04:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:57 smithi001 ceph-mon[30939]: pgmap v363: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T09:04:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 -- 172.21.15.1:0/2932393418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c1025e0 msgr2=0x7f0b6c108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/2932393418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c1025e0 0x7f0b6c108e70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009ca0 tx=0x7f0b6402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 -- 172.21.15.1:0/2932393418 shutdown_connections 2024-09-19T09:04:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/2932393418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c1025e0 0x7f0b6c108e70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/2932393418 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b6c101c20 0x7f0b6c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/2932393418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b6c100a30 0x7f0b6c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 -- 172.21.15.1:0/2932393418 >> 172.21.15.1:0/2932393418 conn(0x7f0b6c0fc190 msgr2=0x7f0b6c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 -- 172.21.15.1:0/2932393418 shutdown_connections 2024-09-19T09:04:58.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.052+0000 7f0b70b9f640 1 -- 172.21.15.1:0/2932393418 wait complete. 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b70b9f640 1 Processor -- start 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b70b9f640 1 -- start start 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b70b9f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c100a30 0x7f0b6c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b70b9f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b6c101c20 0x7f0b6c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b70b9f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b6c1025e0 0x7f0b6c1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b70b9f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c10d8d0 con 0x7f0b6c100a30 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b6a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c100a30 0x7f0b6c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b70b9f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c10d750 con 0x7f0b6c1025e0 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b70b9f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c10da50 con 0x7f0b6c101c20 2024-09-19T09:04:58.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b6a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c100a30 0x7f0b6c19a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36178/0 (socket says 172.21.15.1:36178) 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b6a59c640 1 -- 172.21.15.1:0/688911885 learned_addr learned my addr 172.21.15.1:0/688911885 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b6c101c20 0x7f0b6c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b6a59c640 1 -- 172.21.15.1:0/688911885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b6c101c20 msgr2=0x7f0b6c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.053+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b6c101c20 0x7f0b6c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b6a59c640 1 -- 172.21.15.1:0/688911885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b6c1025e0 msgr2=0x7f0b6c1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b6ad9d640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b6c1025e0 0x7f0b6c1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b6c1025e0 0x7f0b6c1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b6a59c640 1 -- 172.21.15.1:0/688911885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c1a1d30 con 0x7f0b6c100a30 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b6ad9d640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b6c1025e0 0x7f0b6c1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c100a30 0x7f0b6c19a110 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00e9c0 tx=0x7f0b5c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b5b7fe640 1 -- 172.21.15.1:0/688911885 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00cde0 con 0x7f0b6c100a30 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b5b7fe640 1 -- 172.21.15.1:0/688911885 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b5c010930 con 0x7f0b6c100a30 2024-09-19T09:04:58.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b70b9f640 1 -- 172.21.15.1:0/688911885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6c1a1fc0 con 0x7f0b6c100a30 2024-09-19T09:04:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b5b7fe640 1 -- 172.21.15.1:0/688911885 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c018ab0 con 0x7f0b6c100a30 2024-09-19T09:04:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.054+0000 7f0b70b9f640 1 -- 172.21.15.1:0/688911885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6c1a24d0 con 0x7f0b6c100a30 2024-09-19T09:04:58.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.057+0000 7f0b5b7fe640 1 -- 172.21.15.1:0/688911885 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f0b5c01f020 con 0x7f0b6c100a30 2024-09-19T09:04:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.058+0000 7f0b5b7fe640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b540a3350 0x7f0b540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.058+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b540a3350 0x7f0b540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b5b7fe640 1 -- 172.21.15.1:0/688911885 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0b5c0cfce0 con 0x7f0b6c100a30 2024-09-19T09:04:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b73a17740 1 Processor -- start 2024-09-19T09:04:58.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b540a3350 0x7f0b540a5810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c19b620 tx=0x7f0b6000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b73a17740 1 -- start start 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b5e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b61040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b73a17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5620b8ab42f0 con 0x5620b8b591b0 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b73a17740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620b8a5c270 con 0x5620b8b5eb80 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b73a17740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5620b8ab02b0 con 0x5620b8b59af0 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b6a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b6a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36194/0 (socket says 172.21.15.1:36194) 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.059+0000 7f0b6a59c640 1 -- 172.21.15.1:0/1988348643 learned_addr learned my addr 172.21.15.1:0/1988348643 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b5e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b6ad9d640 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b61040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b6a59c640 1 -- 172.21.15.1:0/1988348643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 msgr2=0x5620b8b5e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b5e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b6a59c640 1 -- 172.21.15.1:0/1988348643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 msgr2=0x5620b8b61040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b61040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b6a59c640 1 -- 172.21.15.1:0/1988348643 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620b8a5b340 con 0x5620b8b591b0 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b6ad9d640 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b61040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b595b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c6a0 tx=0x7f0b5c09bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72bbb385375d781 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b58ff9640 1 -- 172.21.15.1:0/1988348643 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0a0530 con 0x5620b8b591b0 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b58ff9640 1 -- 172.21.15.1:0/1988348643 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b5c0a4df0 con 0x5620b8b591b0 2024-09-19T09:04:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.060+0000 7f0b58ff9640 1 -- 172.21.15.1:0/1988348643 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c010d40 con 0x5620b8b591b0 2024-09-19T09:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 -- 172.21.15.1:0/1988348643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 msgr2=0x5620b8b595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b595b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c6a0 tx=0x7f0b5c09bae0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 -- 172.21.15.1:0/1988348643 shutdown_connections 2024-09-19T09:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b61040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b5e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 --2- 172.21.15.1:0/1988348643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b595b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 -- 172.21.15.1:0/1988348643 >> 172.21.15.1:0/1988348643 conn(0x5620b8b54820 msgr2=0x5620b8b54c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 -- 172.21.15.1:0/1988348643 shutdown_connections 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.061+0000 7f0b73a17740 1 -- 172.21.15.1:0/1988348643 wait complete. 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 1 -- start start 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 1 Processor -- start 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b6a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5620b8b61b50 con 0x5620b8b591b0 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620b8a3d290 con 0x5620b8b5eb80 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5620b8b61cd0 con 0x5620b8b59af0 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b73a17740 10 client.0 _ll_register_callbacks cb 0x5620b8a6e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b6a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b6a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36208/0 (socket says 172.21.15.1:36208) 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b6a59c640 1 -- 172.21.15.1:0/3895481319 learned_addr learned my addr 172.21.15.1:0/3895481319 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.062+0000 7f0b6ad9d640 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b6a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b6a59c640 1 -- 172.21.15.1:0/3895481319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 msgr2=0x5620b8b639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b6a59c640 1 -- 172.21.15.1:0/3895481319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 msgr2=0x5620b8b6a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b6a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b6a59c640 1 -- 172.21.15.1:0/3895481319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620b87c7210 con 0x5620b8b591b0 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b634a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c09bc50 tx=0x7f0b5c010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92fe1e60872c9a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b51ffb640 1 -- 172.21.15.1:0/3895481319 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c09a480 con 0x5620b8b591b0 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b51ffb640 1 -- 172.21.15.1:0/3895481319 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0b5c09c3e0 con 0x5620b8b591b0 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b73a17740 1 -- 172.21.15.1:0/3895481319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b5c0a4df0 con 0x5620b8b591b0 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b51ffb640 1 -- 172.21.15.1:0/3895481319 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b5c09c5e0 con 0x5620b8b591b0 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b73a17740 10 client.15591 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b73a17740 1 -- 172.21.15.1:0/3895481319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5620b8893620 con 0x5620b8b591b0 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.063+0000 7f0b51ffb640 1 -- 172.21.15.1:0/3895481319 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b5c0a4df0 con 0x5620b8b591b0 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b51ffb640 1 -- 172.21.15.1:0/3895481319 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0b5c097ed0 con 0x5620b8b591b0 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b73a17740 10 client.15591 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b73a17740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b73a17740 20 client.15591 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5620b8b6ec20 0x5620b8b71010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b73a17740 4 client.15591 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b73a17740 1 -- 172.21.15.1:0/3895481319 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620b8ac1a20 con 0x5620b8b6ec20 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5620b8b6ec20 0x5620b8b71010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b51ffb640 10 client.15591 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.064+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5620b8b6ec20 0x5620b8b71010 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f231944d613ee20 server_cookie=4da201ed57d26d62 in_seq=0 out_seq=0 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b51ffb640 1 -- 172.21.15.1:0/3895481319 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620b8ac1a20 con 0x5620b8b6ec20 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b51ffb640 10 client.15591 handle_command_reply: tid=0 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 client.15591 shutdown 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 -- 172.21.15.1:0/3895481319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 msgr2=0x5620b8b634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b634a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c09bc50 tx=0x7f0b5c010f70 comp rx=0 tx=0).stop 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 -- 172.21.15.1:0/3895481319 shutdown_connections 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5620b8b6ec20 0x5620b8b71010 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b6a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b51ffb640 0 client.15591 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3895481319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b634a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.065+0000 7f0b73a17740 1 -- 172.21.15.1:0/3895481319 >> 172.21.15.1:0/3895481319 conn(0x5620b8b54820 msgr2=0x5620b8b4b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.066+0000 7f0b73a17740 1 -- 172.21.15.1:0/3895481319 shutdown_connections 2024-09-19T09:04:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.066+0000 7f0b73a17740 1 -- 172.21.15.1:0/3895481319 wait complete. 2024-09-19T09:04:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.066+0000 7f0b73a17740 20 client.15591 trim_cache size 0 max 16384 2024-09-19T09:04:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b73a17740 1 Processor -- start 2024-09-19T09:04:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b73a17740 1 -- start start 2024-09-19T09:04:58.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b591b0 0x5620b8b63a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b59af0 0x5620b8b59590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b5eb80 0x5620b8b6a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b73a17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1a99c0 con 0x5620b8b59af0 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b73a17740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1a7290 con 0x5620b8b591b0 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b73a17740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1a50e0 con 0x5620b8b5eb80 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b69d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b59af0 0x5620b8b59590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b69d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b59af0 0x5620b8b59590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36220/0 (socket says 172.21.15.1:36220) 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.080+0000 7f0b69d9b640 1 -- 172.21.15.1:0/3894779815 learned_addr learned my addr 172.21.15.1:0/3894779815 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b591b0 0x5620b8b63a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b6ad9d640 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b5eb80 0x5620b8b6a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b69d9b640 1 -- 172.21.15.1:0/3894779815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b5eb80 msgr2=0x5620b8b6a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b5eb80 0x5620b8b6a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b69d9b640 1 -- 172.21.15.1:0/3894779815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b591b0 msgr2=0x5620b8b63a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:58.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b591b0 0x5620b8b63a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b69d9b640 1 -- 172.21.15.1:0/3894779815 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620b8b60f70 con 0x5620b8b59af0 2024-09-19T09:04:58.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b591b0 0x5620b8b63a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:58.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b59af0 0x5620b8b59590 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0b60005d00 tx=0x7f0b60013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe26a528bddb0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b53fff640 1 -- 172.21.15.1:0/3894779815 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b600295f0 con 0x5620b8b59af0 2024-09-19T09:04:58.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b53fff640 1 -- 172.21.15.1:0/3894779815 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b60029c90 con 0x5620b8b59af0 2024-09-19T09:04:58.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.081+0000 7f0b53fff640 1 -- 172.21.15.1:0/3894779815 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6001f430 con 0x5620b8b59af0 2024-09-19T09:04:58.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 -- 172.21.15.1:0/3894779815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b59af0 msgr2=0x5620b8b59590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b59af0 0x5620b8b59590 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0b60005d00 tx=0x7f0b60013000 comp rx=0 tx=0).stop 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 -- 172.21.15.1:0/3894779815 shutdown_connections 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b5eb80 0x5620b8b6a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b59af0 0x5620b8b59590 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 --2- 172.21.15.1:0/3894779815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b591b0 0x5620b8b63a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 -- 172.21.15.1:0/3894779815 >> 172.21.15.1:0/3894779815 conn(0x5620b8b54820 msgr2=0x5620b8b4a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 -- 172.21.15.1:0/3894779815 shutdown_connections 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.082+0000 7f0b73a17740 1 -- 172.21.15.1:0/3894779815 wait complete. 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.083+0000 7f0b73a17740 1 -- start start 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.083+0000 7f0b73a17740 1 Processor -- start 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b68030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b68570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b68030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b73a17740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b69580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b68030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36224/0 (socket says 172.21.15.1:36224) 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6a59c640 1 -- 172.21.15.1:0/255789990 learned_addr learned my addr 172.21.15.1:0/255789990 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1a5750 con 0x5620b8b591b0 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1a6bc0 con 0x5620b8b5eb80 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1a5e20 con 0x5620b8b59af0 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b73a17740 10 client.0 _ll_register_callbacks cb 0x7f0b5c0984f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b68570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6ad9d640 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b69580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6a59c640 1 -- 172.21.15.1:0/255789990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 msgr2=0x5620b8b68570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b68570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6a59c640 1 -- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 msgr2=0x5620b8b69580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b69580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6a59c640 1 -- 172.21.15.1:0/255789990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620b8b69b90 con 0x5620b8b591b0 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.084+0000 7f0b6ad9d640 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b69580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b6a59c640 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b68030 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0058c0 tx=0x7f0b5c09bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd226fd7cb4c922 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b51ffb640 1 -- 172.21.15.1:0/255789990 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c09b3b0 con 0x5620b8b591b0 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b51ffb640 1 -- 172.21.15.1:0/255789990 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0b5c09c3e0 con 0x5620b8b591b0 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b60029c90 con 0x5620b8b591b0 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b51ffb640 1 -- 172.21.15.1:0/255789990 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b5c0a4df0 con 0x5620b8b591b0 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b73a17740 10 client.15597 fetch_fsmap learned FSMap version 24 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5620b8bd9810 con 0x5620b8b591b0 2024-09-19T09:04:58.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.085+0000 7f0b51ffb640 1 -- 172.21.15.1:0/255789990 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b60029c90 con 0x5620b8b591b0 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b51ffb640 1 -- 172.21.15.1:0/255789990 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0b5c0a4960 con 0x5620b8b591b0 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b73a17740 10 client.15597 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b73a17740 10 client.15597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b73a17740 20 client.15597 populate_metadata read hostname 'smithi001' 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b73a17740 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5620b8bd9fd0 0x5620b8bdc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b73a17740 4 client.15597 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620b8abbd70 con 0x5620b8bd9fd0 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5620b8bd9fd0 0x5620b8bdc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b51ffb640 10 client.15597 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:58.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.086+0000 7f0b69d9b640 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5620b8bd9fd0 0x5620b8bdc3f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2372bc41f580d8bd server_cookie=d47df5e4e140ada6 in_seq=0 out_seq=0 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.090+0000 7f0b51ffb640 1 -- 172.21.15.1:0/255789990 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620b8abbd70 con 0x5620b8bd9fd0 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.090+0000 7f0b51ffb640 10 client.15597 handle_command_reply: tid=0 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.090+0000 7f0b73a17740 1 client.15597 shutdown 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.090+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 msgr2=0x5620b8b68030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.090+0000 7f0b73a17740 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b68030 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0058c0 tx=0x7f0b5c09bae0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 shutdown_connections 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5620b8bd9fd0 0x5620b8bdc3f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620b8b5eb80 0x5620b8b69580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b51ffb640 0 client.15597 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5620b8b59af0 0x5620b8b68570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 1 --2- 172.21.15.1:0/255789990 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5620b8b591b0 0x5620b8b68030 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 >> 172.21.15.1:0/255789990 conn(0x5620b8b54820 msgr2=0x5620b8b4a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 shutdown_connections 2024-09-19T09:04:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 1 -- 172.21.15.1:0/255789990 wait complete. 2024-09-19T09:04:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b73a17740 20 client.15597 trim_cache size 0 max 16384 2024-09-19T09:04:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:04:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:04:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:04:58.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:04:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b70b9f640 1 -- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b540a3350 msgr2=0x7f0b540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.091+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b540a3350 0x7f0b540a5810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c19b620 tx=0x7f0b6000b410 comp rx=0 tx=0).stop 2024-09-19T09:04:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 -- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c100a30 msgr2=0x7f0b6c19a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c100a30 0x7f0b6c19a110 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00e9c0 tx=0x7f0b5c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:04:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 -- 172.21.15.1:0/688911885 shutdown_connections 2024-09-19T09:04:58.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b6c1025e0 0x7f0b6c1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b540a3350 0x7f0b540a5810 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b6c101c20 0x7f0b6c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 --2- 172.21.15.1:0/688911885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b6c100a30 0x7f0b6c19a110 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 -- 172.21.15.1:0/688911885 >> 172.21.15.1:0/688911885 conn(0x7f0b6c0fc190 msgr2=0x7f0b6c109830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 -- 172.21.15.1:0/688911885 shutdown_connections 2024-09-19T09:04:58.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:04:58.092+0000 7f0b70b9f640 1 -- 172.21.15.1:0/688911885 wait complete. 2024-09-19T09:04:58.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:57 smithi064 ceph-mon[35179]: pgmap v363: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T09:04:58.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:57 smithi022 ceph-mon[35107]: pgmap v363: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T09:05:00.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:04:59 smithi001 ceph-mon[30939]: pgmap v364: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:00.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:04:59 smithi064 ceph-mon[35179]: pgmap v364: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:00.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:04:59 smithi022 ceph-mon[35107]: pgmap v364: 97 pgs: 97 active+clean; 665 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:01 smithi001 ceph-mon[30939]: pgmap v365: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:05:02.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:01 smithi064 ceph-mon[35179]: pgmap v365: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:05:02.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:01 smithi022 ceph-mon[35107]: pgmap v365: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T09:05:03.564 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:05:03.564 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:05:03.564 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:03.834 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:03.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:03 smithi001 ceph-mon[30939]: pgmap v366: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:04.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:03 smithi064 ceph-mon[35179]: pgmap v366: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:04.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:03 smithi022 ceph-mon[35107]: pgmap v366: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 -- 172.21.15.1:0/3962676311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 msgr2=0x7f389c110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3962676311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 0x7f389c110910 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f388c009ca0 tx=0x7f388c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 -- 172.21.15.1:0/3962676311 shutdown_connections 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3962676311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 0x7f389c110910 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3962676311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c101440 0x7f389c10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3962676311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f389c100b20 0x7f389c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 -- 172.21.15.1:0/3962676311 >> 172.21.15.1:0/3962676311 conn(0x7f389c0fc7d0 msgr2=0x7f389c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 -- 172.21.15.1:0/3962676311 shutdown_connections 2024-09-19T09:05:04.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.346+0000 7f38a3b21640 1 -- 172.21.15.1:0/3962676311 wait complete. 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a3b21640 1 Processor -- start 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a3b21640 1 -- start start 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a3b21640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c100b20 0x7f389c1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a3b21640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f389c101440 0x7f389c1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a3b21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 0x7f389c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a3b21640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f389c114390 con 0x7f389c10e500 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a3b21640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f389c114210 con 0x7f389c101440 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a3b21640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f389c114510 con 0x7f389c100b20 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a20be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 0x7f389c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a20be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 0x7f389c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49820/0 (socket says 172.21.15.1:49820) 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a20be640 1 -- 172.21.15.1:0/3041099156 learned_addr learned my addr 172.21.15.1:0/3041099156 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a18bd640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c100b20 0x7f389c1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a10bc640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f389c101440 0x7f389c1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a20be640 1 -- 172.21.15.1:0/3041099156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c100b20 msgr2=0x7f389c1a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a20be640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c100b20 0x7f389c1a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a20be640 1 -- 172.21.15.1:0/3041099156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f389c101440 msgr2=0x7f389c1a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a20be640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f389c101440 0x7f389c1a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.347+0000 7f38a20be640 1 -- 172.21.15.1:0/3041099156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c19ad50 con 0x7f389c10e500 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.348+0000 7f38a20be640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 0x7f389c19a620 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f388c0319f0 tx=0x7f388c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.348+0000 7f389affd640 1 -- 172.21.15.1:0/3041099156 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c003c30 con 0x7f389c10e500 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.348+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c19afe0 con 0x7f389c10e500 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.348+0000 7f389affd640 1 -- 172.21.15.1:0/3041099156 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f388c003dd0 con 0x7f389c10e500 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.348+0000 7f389affd640 1 -- 172.21.15.1:0/3041099156 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c02fd50 con 0x7f389c10e500 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.348+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c1a7330 con 0x7f389c10e500 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.349+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389c100f00 con 0x7f389c10e500 2024-09-19T09:05:04.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.350+0000 7f389affd640 1 -- 172.21.15.1:0/3041099156 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f388c004050 con 0x7f389c10e500 2024-09-19T09:05:04.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.351+0000 7f389affd640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f38840a32d0 0x7f38840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:04.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.351+0000 7f38a18bd640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f38840a32d0 0x7f38840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:04.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.351+0000 7f389affd640 1 -- 172.21.15.1:0/3041099156 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f388c0f0b40 con 0x7f389c10e500 2024-09-19T09:05:04.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.351+0000 7f38a18bd640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f38840a32d0 0x7f38840a5790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f389400bbe0 tx=0x7f389400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:04.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.355+0000 7f389affd640 1 -- 172.21.15.1:0/3041099156 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f388c0bd910 con 0x7f389c10e500 2024-09-19T09:05:04.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.570+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f389c1a7500 con 0x7f389c10e500 2024-09-19T09:05:04.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.571+0000 7f389affd640 1 -- 172.21.15.1:0/3041099156 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f388c0bd210 con 0x7f389c10e500 2024-09-19T09:05:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:05:04.572 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:05:04.573 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:05:04.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f38840a32d0 msgr2=0x7f38840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f38840a32d0 0x7f38840a5790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f389400bbe0 tx=0x7f389400b390 comp rx=0 tx=0).stop 2024-09-19T09:05:04.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 msgr2=0x7f389c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:04.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 0x7f389c19a620 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f388c0319f0 tx=0x7f388c031a20 comp rx=0 tx=0).stop 2024-09-19T09:05:04.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 shutdown_connections 2024-09-19T09:05:04.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f389c10e500 0x7f389c19a620 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f389c101440 0x7f389c1a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f38840a32d0 0x7f38840a5790 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 --2- 172.21.15.1:0/3041099156 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f389c100b20 0x7f389c1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:04.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 >> 172.21.15.1:0/3041099156 conn(0x7f389c0fc7d0 msgr2=0x7f389c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:04.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 shutdown_connections 2024-09-19T09:05:04.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:04.573+0000 7f38a3b21640 1 -- 172.21.15.1:0/3041099156 wait complete. 2024-09-19T09:05:05.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:04 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3041099156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:05.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:04 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3041099156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:05.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:04 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3041099156' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:05.521 INFO:tasks.workunit.client.0.smithi001.stderr:Updating files: 90% (11649/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:05:05.609 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:05:05.609 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:05:05.881 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:06.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:05 smithi001 ceph-mon[30939]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:06.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:05 smithi064 ceph-mon[35179]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:06.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:05 smithi022 ceph-mon[35107]: pgmap v367: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:06.337 INFO:tasks.workunit.client.0.smithi001.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:05:06.337 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:05:06.337 INFO:tasks.workunit.client.0.smithi001.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:05:06.337 INFO:tasks.workunit.client.0.smithi001.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:05:06.337 INFO:tasks.workunit.client.0.smithi001.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:05:06.337 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:05:06.337 INFO:tasks.workunit.client.0.smithi001.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:05:06.337 INFO:tasks.workunit.client.0.smithi001.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr: git switch -c 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr:Or undo this operation with: 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr: git switch - 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:05:06.338 INFO:tasks.workunit.client.0.smithi001.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:05:06.343 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:05:06.417 INFO:tasks.workunit.client.0.smithi001.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:05:06.419 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:05:06.419 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:05:06.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 -- 172.21.15.1:0/758890537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec104990 msgr2=0x7f8bec1089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/758890537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec104990 0x7f8bec1089e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009900 tx=0x7f8be002a410 comp rx=0 tx=0).stop 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 -- 172.21.15.1:0/758890537 shutdown_connections 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/758890537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bec109110 0x7f8bec110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/758890537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec104990 0x7f8bec1089e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/758890537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec103fe0 0x7f8bec1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 -- 172.21.15.1:0/758890537 >> 172.21.15.1:0/758890537 conn(0x7f8bec0ffac0 msgr2=0x7f8bec101ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 -- 172.21.15.1:0/758890537 shutdown_connections 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.585+0000 7f8bf0b75640 1 -- 172.21.15.1:0/758890537 wait complete. 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.586+0000 7f8bf0b75640 1 Processor -- start 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.586+0000 7f8bf0b75640 1 -- start start 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.586+0000 7f8bf0b75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec103fe0 0x7f8bec19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.586+0000 7f8bf0b75640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bec104990 0x7f8bec19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bf0b75640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec109110 0x7f8bec19dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bf0b75640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1142e0 con 0x7f8bec103fe0 2024-09-19T09:05:06.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bf0b75640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec114160 con 0x7f8bec104990 2024-09-19T09:05:06.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bf0b75640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec114460 con 0x7f8bec109110 2024-09-19T09:05:06.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec103fe0 0x7f8bec19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec103fe0 0x7f8bec19a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49836/0 (socket says 172.21.15.1:49836) 2024-09-19T09:05:06.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 -- 172.21.15.1:0/938420863 learned_addr learned my addr 172.21.15.1:0/938420863 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bec104990 0x7f8bec19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bead9d640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec109110 0x7f8bec19dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 -- 172.21.15.1:0/938420863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec109110 msgr2=0x7f8bec19dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec109110 0x7f8bec19dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 -- 172.21.15.1:0/938420863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bec104990 msgr2=0x7f8bec19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bec104990 0x7f8bec19ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 -- 172.21.15.1:0/938420863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec19e6f0 con 0x7f8bec103fe0 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bea59c640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec103fe0 0x7f8bec19a7a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00d770 tx=0x7f8bdc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bdb7fe640 1 -- 172.21.15.1:0/938420863 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc017070 con 0x7f8bec103fe0 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bf0b75640 1 -- 172.21.15.1:0/938420863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bec19e9e0 con 0x7f8bec103fe0 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bdb7fe640 1 -- 172.21.15.1:0/938420863 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bdc005520 con 0x7f8bec103fe0 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bdb7fe640 1 -- 172.21.15.1:0/938420863 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc010460 con 0x7f8bec103fe0 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.587+0000 7f8bf0b75640 1 -- 172.21.15.1:0/938420863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bec1a7350 con 0x7f8bec103fe0 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bdb7fe640 1 -- 172.21.15.1:0/938420863 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f8bdc004ea0 con 0x7f8bec103fe0 2024-09-19T09:05:06.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bf2f4e740 1 Processor -- start 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bf2f4e740 1 -- start start 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906837850 0x55e906837c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 0x55e906844e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e90679c160 con 0x55e906838170 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e906743720 con 0x55e906842a30 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.590+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e906798120 con 0x55e906837850 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49848/0 (socket says 172.21.15.1:49848) 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 -- 172.21.15.1:0/2302050204 learned_addr learned my addr 172.21.15.1:0/2302050204 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:06.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bead9d640 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906837850 0x55e906837c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 0x55e906844e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 -- 172.21.15.1:0/2302050204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906837850 msgr2=0x55e906837c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906837850 0x55e906837c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 -- 172.21.15.1:0/2302050204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 msgr2=0x55e906844e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 0x55e906844e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 -- 172.21.15.1:0/2302050204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90650dba0 con 0x55e906838170 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bdb7fe640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bd40a32d0 0x7f8bd40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bead9d640 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906837850 0x55e906837c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bead9d640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bd40a32d0 0x7f8bd40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bea59c640 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068424f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0cce60 tx=0x7f8bdc097d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b3ee6b59054c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bdb7fe640 1 -- 172.21.15.1:0/938420863 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8bdc0cf590 con 0x7f8bec103fe0 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.591+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2302050204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc020030 con 0x55e906838170 2024-09-19T09:05:06.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2302050204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bdc099750 con 0x55e906838170 2024-09-19T09:05:06.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2302050204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc09b620 con 0x55e906838170 2024-09-19T09:05:06.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/2302050204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 msgr2=0x55e9068424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068424f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0cce60 tx=0x7f8bdc097d80 comp rx=0 tx=0).stop 2024-09-19T09:05:06.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bead9d640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bd40a32d0 0x7f8bd40a5790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8be4005fd0 tx=0x7f8be4009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/2302050204 shutdown_connections 2024-09-19T09:05:06.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 0x55e906844e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068424f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/2302050204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906837850 0x55e906837c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/2302050204 >> 172.21.15.1:0/2302050204 conn(0x55e906833de0 msgr2=0x55e9068341c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/2302050204 shutdown_connections 2024-09-19T09:05:06.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.592+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/2302050204 wait complete. 2024-09-19T09:05:06.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 1 -- start start 2024-09-19T09:05:06.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 1 Processor -- start 2024-09-19T09:05:06.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906837850 0x55e90683f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906838170 0x55e90683fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 0x55e9068403e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e906845600 con 0x55e906837850 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e906724900 con 0x55e906842a30 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e906845780 con 0x55e906838170 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bf2f4e740 10 client.0 _ll_register_callbacks cb 0x55e906722780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906837850 0x55e90683f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bea59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906837850 0x55e90683f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49854/0 (socket says 172.21.15.1:49854) 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bea59c640 1 -- 172.21.15.1:0/1650302833 learned_addr learned my addr 172.21.15.1:0/1650302833 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bead9d640 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 0x55e9068403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906838170 0x55e90683fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bea59c640 1 -- 172.21.15.1:0/1650302833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906838170 msgr2=0x55e90683fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bea59c640 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906838170 0x55e90683fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bea59c640 1 -- 172.21.15.1:0/1650302833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 msgr2=0x55e9068403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bea59c640 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 0x55e9068403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.593+0000 7f8bea59c640 1 -- 172.21.15.1:0/1650302833 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e906764c50 con 0x55e906837850 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bea59c640 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906837850 0x55e90683f960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0cd4a0 tx=0x7f8bdc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f0779ef2b943fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/1650302833 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc020050 con 0x55e906837850 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/1650302833 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8bdc009d50 con 0x55e906837850 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/1650302833 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bdc099750 con 0x55e906837850 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/1650302833 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8bdc0ba070 con 0x55e906837850 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 10 client.15615 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/1650302833 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e906851300 con 0x55e906837850 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/1650302833 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bdc099750 con 0x55e906837850 2024-09-19T09:05:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/1650302833 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8bdc098150 con 0x55e906837850 2024-09-19T09:05:06.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 10 client.15615 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:06.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 10 client.15615 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:05:06.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 20 client.15615 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:06.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e906852650 0x55e906854a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 4 client.15615 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.594+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/1650302833 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9067a9890 con 0x55e906852650 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.595+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e906852650 0x55e906854a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.595+0000 7f8bd1ffb640 10 client.15615 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.595+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e906852650 0x55e906854a40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e42ba7404b3f448 server_cookie=aad40ecc64e1a908 in_seq=0 out_seq=0 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/1650302833 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9067a9890 con 0x55e906852650 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bd1ffb640 10 client.15615 handle_command_reply: tid=0 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 client.15615 shutdown 2024-09-19T09:05:06.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/1650302833 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906837850 msgr2=0x55e90683f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906837850 0x55e90683f960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0cd4a0 tx=0x7f8bdc009c30 comp rx=0 tx=0).stop 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/1650302833 shutdown_connections 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e906852650 0x55e906854a40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906842a30 0x55e9068403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906838170 0x55e90683fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/1650302833 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906837850 0x55e90683f960 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bd1ffb640 0 client.15615 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/1650302833 >> 172.21.15.1:0/1650302833 conn(0x55e906833de0 msgr2=0x55e906839ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/1650302833 shutdown_connections 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/1650302833 wait complete. 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.596+0000 7f8bf2f4e740 20 client.15615 trim_cache size 0 max 16384 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bf2f4e740 1 Processor -- start 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bf2f4e740 1 -- start start 2024-09-19T09:05:06.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 0x55e90683a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068418d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 0x55e90683cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1b2160 con 0x55e906838170 2024-09-19T09:05:06.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1afa30 con 0x55e906837850 2024-09-19T09:05:06.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1ad880 con 0x55e906842a30 2024-09-19T09:05:06.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8be9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8be9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49866/0 (socket says 172.21.15.1:49866) 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8be9d9b640 1 -- 172.21.15.1:0/579534129 learned_addr learned my addr 172.21.15.1:0/579534129 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bead9d640 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 0x55e90683cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.613+0000 7f8bea59c640 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 0x55e90683a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8be9d9b640 1 -- 172.21.15.1:0/579534129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 msgr2=0x55e90683cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 0x55e90683cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8be9d9b640 1 -- 172.21.15.1:0/579534129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 msgr2=0x55e90683a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 0x55e90683a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8be9d9b640 1 -- 172.21.15.1:0/579534129 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e906837680 con 0x55e906838170 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068418d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009230 tx=0x7f8be0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc86061313f35d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8bd3fff640 1 -- 172.21.15.1:0/579534129 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0035040 con 0x55e906838170 2024-09-19T09:05:06.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8bd3fff640 1 -- 172.21.15.1:0/579534129 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8be0049070 con 0x55e906838170 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.614+0000 7f8bd3fff640 1 -- 172.21.15.1:0/579534129 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be00318a0 con 0x55e906838170 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/579534129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 msgr2=0x55e9068418d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068418d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009230 tx=0x7f8be0005e80 comp rx=0 tx=0).stop 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/579534129 shutdown_connections 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 0x55e90683cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068418d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/579534129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 0x55e90683a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/579534129 >> 172.21.15.1:0/579534129 conn(0x55e906833de0 msgr2=0x55e9068411c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/579534129 shutdown_connections 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/579534129 wait complete. 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- start start 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 Processor -- start 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 0x55e906855b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 0x55e9068bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1adef0 con 0x55e906838170 2024-09-19T09:05:06.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1af360 con 0x55e906837850 2024-09-19T09:05:06.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec1ae5c0 con 0x55e906842a30 2024-09-19T09:05:06.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.615+0000 7f8bf2f4e740 10 client.0 _ll_register_callbacks cb 0x7f8bdc0d5a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:06.660 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 24, 2024-09-19T09:05:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:05:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 6, 2024-09-19T09:05:06.660 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:05:06.661 INFO:teuthology.orchestra.run.smithi001.stdout: "eb1622fb": { 2024-09-19T09:05:06.661 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 6, 2024-09-19T09:05:06.661 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:05:06.661 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:05:06.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:05:06.661 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:05:06.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:05:06.662 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:05:06.662 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T09:05:06.662 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:05:06.662 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:05:06.662 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:05:06.662 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:05:06.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:05:06.663 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:05:06.663 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:06.663 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:06.663 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:06.663 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:06.663 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:06.663 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:06.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49878/0 (socket says 172.21.15.1:49878) 2024-09-19T09:05:06.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 -- 172.21.15.1:0/4225010051 learned_addr learned my addr 172.21.15.1:0/4225010051 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:06.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bea59c640 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 0x55e906855b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bead9d640 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 0x55e9068bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 -- 172.21.15.1:0/4225010051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 msgr2=0x55e9068bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 0x55e9068bbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 -- 172.21.15.1:0/4225010051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 msgr2=0x55e906855b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:06.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 0x55e906855b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 -- 172.21.15.1:0/4225010051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e90682f3f0 con 0x55e906838170 2024-09-19T09:05:06.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8be9d9b640 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068560c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8be002a930 tx=0x7f8be0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0e2390024a4d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/4225010051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0035040 con 0x55e906838170 2024-09-19T09:05:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/4225010051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8be0004ad0 con 0x55e906838170 2024-09-19T09:05:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/4225010051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be0049070 con 0x55e906838170 2024-09-19T09:05:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/4225010051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8be005b070 con 0x55e906838170 2024-09-19T09:05:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bf2f4e740 10 client.15621 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.616+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/4225010051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e9068bd420 con 0x55e906838170 2024-09-19T09:05:06.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/4225010051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8be0049070 con 0x55e906838170 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/4225010051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8be0031cc0 con 0x55e906838170 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bf2f4e740 10 client.15621 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bf2f4e740 10 client.15621 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bf2f4e740 20 client.15621 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e9068bdbe0 0x55e9068c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bf2f4e740 4 client.15621 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/4225010051 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55e9067a3be0 con 0x55e9068bdbe0 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bea59c640 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e9068bdbe0 0x55e9068c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bea59c640 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e9068bdbe0 0x55e9068c0000 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81cdd65dda342037 server_cookie=8fd451b1392f8f3d in_seq=0 out_seq=0 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.617+0000 7f8bd1ffb640 10 client.15621 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bd1ffb640 1 -- 172.21.15.1:0/4225010051 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e9067a3be0 con 0x55e9068bdbe0 2024-09-19T09:05:06.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bd1ffb640 10 client.15621 handle_command_reply: tid=0 2024-09-19T09:05:06.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 client.15621 shutdown 2024-09-19T09:05:06.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/4225010051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 msgr2=0x55e9068560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068560c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8be002a930 tx=0x7f8be0009650 comp rx=0 tx=0).stop 2024-09-19T09:05:06.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/4225010051 shutdown_connections 2024-09-19T09:05:06.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e9068bdbe0 0x55e9068c0000 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e906842a30 0x55e9068bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e906838170 0x55e9068560c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 --2- 172.21.15.1:0/4225010051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e906837850 0x55e906855b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bd1ffb640 0 client.15621 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/4225010051 >> 172.21.15.1:0/4225010051 conn(0x55e906833de0 msgr2=0x55e9068419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/4225010051 shutdown_connections 2024-09-19T09:05:06.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.623+0000 7f8bf2f4e740 1 -- 172.21.15.1:0/4225010051 wait complete. 2024-09-19T09:05:06.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf2f4e740 20 client.15621 trim_cache size 0 max 16384 2024-09-19T09:05:06.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 -- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bd40a32d0 msgr2=0x7f8bd40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bd40a32d0 0x7f8bd40a5790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8be4005fd0 tx=0x7f8be4009600 comp rx=0 tx=0).stop 2024-09-19T09:05:06.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 -- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec103fe0 msgr2=0x7f8bec19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:06.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec103fe0 0x7f8bec19a7a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00d770 tx=0x7f8bdc00dc30 comp rx=0 tx=0).stop 2024-09-19T09:05:06.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 -- 172.21.15.1:0/938420863 shutdown_connections 2024-09-19T09:05:06.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bd40a32d0 0x7f8bd40a5790 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec109110 0x7f8bec19dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bec104990 0x7f8bec19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 --2- 172.21.15.1:0/938420863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bec103fe0 0x7f8bec19a7a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:06.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 -- 172.21.15.1:0/938420863 >> 172.21.15.1:0/938420863 conn(0x7f8bec0ffac0 msgr2=0x7f8bec100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:06.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 -- 172.21.15.1:0/938420863 shutdown_connections 2024-09-19T09:05:06.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:06.624+0000 7f8bf0b75640 1 -- 172.21.15.1:0/938420863 wait complete. 2024-09-19T09:05:07.669 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'eb1622fb', quiesce took 4.1 seconds. Will release after: 16.25 2024-09-19T09:05:07.961 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:05:08.043 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:05:08.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:07 smithi001 ceph-mon[30939]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:05:08.087 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:05:08.089 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:05:08.089 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:05:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:07 smithi064 ceph-mon[35179]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:05:08.133 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:05:08.133 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:05:08.133 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:05:08.150 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-19T09:05:08.151 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-19T09:05:08.152 DEBUG:teuthology.orchestra.run.smithi001:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-19T09:05:08.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:07 smithi022 ceph-mon[35107]: pgmap v368: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:05:10.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:09 smithi001 ceph-mon[30939]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:09 smithi064 ceph-mon[35179]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:10.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:09 smithi022 ceph-mon[35107]: pgmap v369: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:05:11.105 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:11.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:10 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.184+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/1928528348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 msgr2=0x7f0b44109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.184+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/1928528348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 0x7f0b44109fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009ca0 tx=0x7f0b3c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.184+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/1928528348 shutdown_connections 2024-09-19T09:05:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.184+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/1928528348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 0x7f0b44109fb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.184+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/1928528348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b44102d60 0x7f0b441031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.184+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/1928528348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b44101b70 0x7f0b44101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.184+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/1928528348 >> 172.21.15.1:0/1928528348 conn(0x7f0b440fd2f0 msgr2=0x7f0b440ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/1928528348 shutdown_connections 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/1928528348 wait complete. 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 Processor -- start 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 -- start start 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b44101b70 0x7f0b44197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b44102d60 0x7f0b44198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 0x7f0b4419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4410d950 con 0x7f0b44103720 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4410d7d0 con 0x7f0b44101b70 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.185+0000 7f0b4a8a4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4410dad0 con 0x7f0b44102d60 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 0x7f0b4419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 0x7f0b4419f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49900/0 (socket says 172.21.15.1:49900) 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 -- 172.21.15.1:0/470649458 learned_addr learned my addr 172.21.15.1:0/470649458 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b437fe640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b44102d60 0x7f0b44198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b43fff640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b44101b70 0x7f0b44197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 -- 172.21.15.1:0/470649458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b44102d60 msgr2=0x7f0b44198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b44102d60 0x7f0b44198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 -- 172.21.15.1:0/470649458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b44101b70 msgr2=0x7f0b44197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b44101b70 0x7f0b44197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 -- 172.21.15.1:0/470649458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4419fb40 con 0x7f0b44103720 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b43fff640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b44101b70 0x7f0b44197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b48e41640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 0x7f0b4419f4d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c02f540 tx=0x7f0b3c009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b417fa640 1 -- 172.21.15.1:0/470649458 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c02fae0 con 0x7f0b44103720 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/470649458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4419fdd0 con 0x7f0b44103720 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b417fa640 1 -- 172.21.15.1:0/470649458 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b3c02fc80 con 0x7f0b44103720 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b417fa640 1 -- 172.21.15.1:0/470649458 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0468c0 con 0x7f0b44103720 2024-09-19T09:05:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.186+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/470649458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b441a02e0 con 0x7f0b44103720 2024-09-19T09:05:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.188+0000 7f0b417fa640 1 -- 172.21.15.1:0/470649458 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f0b3c030bc0 con 0x7f0b44103720 2024-09-19T09:05:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b4d636740 1 Processor -- start 2024-09-19T09:05:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b4d636740 1 -- start start 2024-09-19T09:05:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b417fa640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d0ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b4d636740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559537c622f0 con 0x559537d036f0 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b4d636740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559537c0a270 con 0x559537d02db0 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b4d636740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559537c5e2b0 con 0x559537d08780 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b417fa640 1 -- 172.21.15.1:0/470649458 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0b3c0f0e40 con 0x7f0b44103720 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b437fe640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d081b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49904/0 (socket says 172.21.15.1:49904) 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.189+0000 7f0b437fe640 1 -- 172.21.15.1:0/2871877820 learned_addr learned my addr 172.21.15.1:0/2871877820 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b43fff640 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b48e41640 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d0ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b437fe640 1 -- 172.21.15.1:0/2871877820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 msgr2=0x559537d0ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d0ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b437fe640 1 -- 172.21.15.1:0/2871877820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 msgr2=0x559537d031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b437fe640 1 -- 172.21.15.1:0/2871877820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537c09340 con 0x559537d036f0 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b48e41640 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d0ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b437fe640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b380119d0 tx=0x7f0b38009c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d081b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800f790 tx=0x7f0b3801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd2e683b6eceed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b2a7fc640 1 -- 172.21.15.1:0/2871877820 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38009780 con 0x559537d036f0 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b2a7fc640 1 -- 172.21.15.1:0/2871877820 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b3800fe50 con 0x559537d036f0 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.190+0000 7f0b2a7fc640 1 -- 172.21.15.1:0/2871877820 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3801f8d0 con 0x559537d036f0 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 -- 172.21.15.1:0/2871877820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 msgr2=0x559537d081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d081b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800f790 tx=0x7f0b3801d000 comp rx=0 tx=0).stop 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 -- 172.21.15.1:0/2871877820 shutdown_connections 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d0ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d081b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2871877820 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 -- 172.21.15.1:0/2871877820 >> 172.21.15.1:0/2871877820 conn(0x559537cfa010 msgr2=0x559537cfa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 -- 172.21.15.1:0/2871877820 shutdown_connections 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 -- 172.21.15.1:0/2871877820 wait complete. 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.191+0000 7f0b4d636740 1 -- start start 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b4d636740 1 Processor -- start 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d0cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d036f0 0x559537d0d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d08780 0x559537d144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b4d636740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559537d0b6f0 con 0x559537d08780 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b4d636740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559537beb290 con 0x559537d02db0 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b4d636740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559537d0b870 con 0x559537d036f0 2024-09-19T09:05:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b4d636740 10 client.0 _ll_register_callbacks cb 0x559537c1c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d0cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b48e41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d08780 0x559537d144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d0cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59682/0 (socket says 172.21.15.1:59682) 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b48e41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d08780 0x559537d144d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49916/0 (socket says 172.21.15.1:49916) 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 -- 172.21.15.1:0/2473449780 learned_addr learned my addr 172.21.15.1:0/2473449780 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d036f0 0x559537d0d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 -- 172.21.15.1:0/2473449780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d036f0 msgr2=0x559537d0d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d036f0 0x559537d0d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 -- 172.21.15.1:0/2473449780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d08780 msgr2=0x559537d144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d08780 0x559537d144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 -- 172.21.15.1:0/2473449780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559537975210 con 0x559537d02db0 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.192+0000 7f0b43fff640 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d0cf50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400bf70 tx=0x7f0b340128e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e3d356810085791 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b237fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b237fe640 1 -- 172.21.15.1:0/2473449780 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34004220 con 0x559537d02db0 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 1 -- 172.21.15.1:0/2473449780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b3800fe50 con 0x559537d02db0 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b237fe640 1 -- 172.21.15.1:0/2473449780 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0b340043c0 con 0x559537d02db0 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b237fe640 1 -- 172.21.15.1:0/2473449780 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b34005020 con 0x559537d02db0 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 10 client.25250 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 1 -- 172.21.15.1:0/2473449780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559537a41620 con 0x559537d02db0 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b237fe640 1 -- 172.21.15.1:0/2473449780 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b3800fe50 con 0x559537d02db0 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b237fe640 1 -- 172.21.15.1:0/2473449780 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0b34019030 con 0x559537d02db0 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 10 client.25250 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 10 client.25250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 20 client.25250 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559537d18b90 0x559537d1b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 4 client.25250 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:11.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.193+0000 7f0b4d636740 1 -- 172.21.15.1:0/2473449780 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559537c6fa20 con 0x559537d18b90 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.194+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559537d18b90 0x559537d1b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.194+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559537d18b90 0x559537d1b000 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beedc7e9de0b58ad server_cookie=cae4a38b25cac7c9 in_seq=0 out_seq=0 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.194+0000 7f0b237fe640 10 client.25250 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.194+0000 7f0b237fe640 1 -- 172.21.15.1:0/2473449780 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559537c6fa20 con 0x559537d18b90 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.194+0000 7f0b237fe640 10 client.25250 handle_command_reply: tid=0 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.194+0000 7f0b4d636740 1 client.25250 shutdown 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 -- 172.21.15.1:0/2473449780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 msgr2=0x559537d0cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d0cf50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400bf70 tx=0x7f0b340128e0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 -- 172.21.15.1:0/2473449780 shutdown_connections 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559537d18b90 0x559537d1b000 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d08780 0x559537d144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d036f0 0x559537d0d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b237fe640 0 client.25250 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2473449780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d0cf50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 -- 172.21.15.1:0/2473449780 >> 172.21.15.1:0/2473449780 conn(0x559537cfa010 msgr2=0x559537cfb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 -- 172.21.15.1:0/2473449780 shutdown_connections 2024-09-19T09:05:11.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 1 -- 172.21.15.1:0/2473449780 wait complete. 2024-09-19T09:05:11.204 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.195+0000 7f0b4d636740 20 client.25250 trim_cache size 0 max 16384 2024-09-19T09:05:11.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:11.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:11.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:10 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b4d636740 1 Processor -- start 2024-09-19T09:05:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b4d636740 1 -- start start 2024-09-19T09:05:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d02db0 0x559537d0d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d143f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d08780 0x559537cf90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b4d636740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441a98b0 con 0x559537d036f0 2024-09-19T09:05:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b4d636740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441a7180 con 0x559537d08780 2024-09-19T09:05:11.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b4d636740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441a4fd0 con 0x559537d02db0 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d143f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d143f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49930/0 (socket says 172.21.15.1:49930) 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b437fe640 1 -- 172.21.15.1:0/894431506 learned_addr learned my addr 172.21.15.1:0/894431506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b48e41640 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d08780 0x559537cf90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b43fff640 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d02db0 0x559537d0d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b437fe640 1 -- 172.21.15.1:0/894431506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d02db0 msgr2=0x559537d0d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b437fe640 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d02db0 0x559537d0d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b437fe640 1 -- 172.21.15.1:0/894431506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d08780 msgr2=0x559537cf90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b437fe640 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d08780 0x559537cf90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b437fe640 1 -- 172.21.15.1:0/894431506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537d03bd0 con 0x559537d036f0 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b48e41640 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d08780 0x559537cf90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.210+0000 7f0b43fff640 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d02db0 0x559537d0d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.211+0000 7f0b437fe640 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d143f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800a010 tx=0x7f0b38005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197722c7533c7ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.211+0000 7f0b29ffb640 1 -- 172.21.15.1:0/894431506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3801a040 con 0x559537d036f0 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.211+0000 7f0b29ffb640 1 -- 172.21.15.1:0/894431506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b3800fe50 con 0x559537d036f0 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.211+0000 7f0b29ffb640 1 -- 172.21.15.1:0/894431506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38003850 con 0x559537d036f0 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 -- 172.21.15.1:0/894431506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 msgr2=0x559537d143f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d143f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800a010 tx=0x7f0b38005850 comp rx=0 tx=0).stop 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 -- 172.21.15.1:0/894431506 shutdown_connections 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d08780 0x559537cf90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d143f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 --2- 172.21.15.1:0/894431506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d02db0 0x559537d0d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 -- 172.21.15.1:0/894431506 >> 172.21.15.1:0/894431506 conn(0x559537cfa010 msgr2=0x559537cf89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 -- 172.21.15.1:0/894431506 shutdown_connections 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 -- 172.21.15.1:0/894431506 wait complete. 2024-09-19T09:05:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 -- start start 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.212+0000 7f0b4d636740 1 Processor -- start 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d11cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d12230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b4d636740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d13240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b4d636740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441a5640 con 0x559537d036f0 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b4d636740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441a6ab0 con 0x559537d02db0 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b4d636740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441a5d10 con 0x559537d08780 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b4d636740 10 client.0 _ll_register_callbacks cb 0x7f0b3400b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d12230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d11cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d12230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49946/0 (socket says 172.21.15.1:49946) 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 -- 172.21.15.1:0/2015282332 learned_addr learned my addr 172.21.15.1:0/2015282332 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b48e41640 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d13240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 -- 172.21.15.1:0/2015282332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 msgr2=0x559537d13240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d13240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 -- 172.21.15.1:0/2015282332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 msgr2=0x559537d11cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d11cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 -- 172.21.15.1:0/2015282332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559537d13850 con 0x559537d036f0 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b43fff640 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d11cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b48e41640 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d13240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b437fe640 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d12230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0b380058c0 tx=0x7f0b380112d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef4e8f1a6024f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b237fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b237fe640 1 -- 172.21.15.1:0/2015282332 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3801a040 con 0x559537d036f0 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b237fe640 1 -- 172.21.15.1:0/2015282332 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0b38020a80 con 0x559537d036f0 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.213+0000 7f0b4d636740 1 -- 172.21.15.1:0/2015282332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b3800fe50 con 0x559537d036f0 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b237fe640 1 -- 172.21.15.1:0/2015282332 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b38005020 con 0x559537d036f0 2024-09-19T09:05:11.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b4d636740 10 client.15639 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b4d636740 1 -- 172.21.15.1:0/2015282332 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559537d839a0 con 0x559537d036f0 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b237fe640 1 -- 172.21.15.1:0/2015282332 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b3800fe50 con 0x559537d036f0 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b237fe640 1 -- 172.21.15.1:0/2015282332 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0b38033360 con 0x559537d036f0 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b4d636740 10 client.15639 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b4d636740 10 client.15639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b4d636740 20 client.15639 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559537d841a0 0x559537d865c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b4d636740 4 client.15639 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b4d636740 1 -- 172.21.15.1:0/2015282332 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559537c69d70 con 0x559537d841a0 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.214+0000 7f0b43fff640 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559537d841a0 0x559537d865c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.215+0000 7f0b43fff640 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559537d841a0 0x559537d865c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b27d916059b32bac server_cookie=9ef204954a50424c in_seq=0 out_seq=0 2024-09-19T09:05:11.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.215+0000 7f0b237fe640 10 client.15639 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:11.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.219+0000 7f0b237fe640 1 -- 172.21.15.1:0/2015282332 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559537c69d70 con 0x559537d841a0 2024-09-19T09:05:11.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.219+0000 7f0b237fe640 10 client.15639 handle_command_reply: tid=0 2024-09-19T09:05:11.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.219+0000 7f0b4d636740 1 client.15639 shutdown 2024-09-19T09:05:11.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 -- 172.21.15.1:0/2015282332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 msgr2=0x559537d12230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d12230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0b380058c0 tx=0x7f0b380112d0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 -- 172.21.15.1:0/2015282332 shutdown_connections 2024-09-19T09:05:11.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559537d841a0 0x559537d865c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559537d08780 0x559537d13240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559537d036f0 0x559537d12230 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b237fe640 0 client.15639 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 --2- 172.21.15.1:0/2015282332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559537d02db0 0x559537d11cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 -- 172.21.15.1:0/2015282332 >> 172.21.15.1:0/2015282332 conn(0x559537cfa010 msgr2=0x559537cf91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 -- 172.21.15.1:0/2015282332 shutdown_connections 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 1 -- 172.21.15.1:0/2015282332 wait complete. 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4d636740 20 client.15639 trim_cache size 0 max 16384 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:05:11.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:05:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:05:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b2c0a3240 msgr2=0x7f0b2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b380119d0 tx=0x7f0b38009c00 comp rx=0 tx=0).stop 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 msgr2=0x7f0b4419f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.220+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 0x7f0b4419f4d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c02f540 tx=0x7f0b3c009890 comp rx=0 tx=0).stop 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.221+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/470649458 shutdown_connections 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.221+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b44103720 0x7f0b4419f4d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.221+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.221+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b44102d60 0x7f0b44198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.221+0000 7f0b4a8a4640 1 --2- 172.21.15.1:0/470649458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b44101b70 0x7f0b44197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.221+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/470649458 >> 172.21.15.1:0/470649458 conn(0x7f0b440fd2f0 msgr2=0x7f0b441060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.221+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/470649458 shutdown_connections 2024-09-19T09:05:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:11.221+0000 7f0b4a8a4640 1 -- 172.21.15.1:0/470649458 wait complete. 2024-09-19T09:05:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:05:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:11.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:10 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:11 smithi064 ceph-mon[35179]: pgmap v370: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:05:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:11 smithi064 ceph-mon[35179]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T09:05:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:11 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:12.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:11 smithi022 ceph-mon[35107]: pgmap v370: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:05:12.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:11 smithi022 ceph-mon[35107]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T09:05:12.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:12.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:12.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:11 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:12.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:11 smithi001 ceph-mon[30939]: pgmap v370: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:05:12.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:11 smithi001 ceph-mon[30939]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T09:05:12.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:05:12.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:05:12.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:11 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:05:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:13 smithi064 ceph-mon[35179]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T09:05:14.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:13 smithi022 ceph-mon[35107]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T09:05:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:13 smithi001 ceph-mon[30939]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T09:05:15.771 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:05:16.041 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:16.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:15 smithi064 ceph-mon[35179]: pgmap v372: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:05:16.163 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:15 smithi001 ceph-mon[30939]: pgmap v372: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:05:16.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:15 smithi022 ceph-mon[35107]: pgmap v372: 97 pgs: 97 active+clean; 666 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:05:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 -- 172.21.15.1:0/2030146427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 msgr2=0x7fcbdc103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/2030146427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 0x7fcbdc103170 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009930 tx=0x7fcbcc02a420 comp rx=0 tx=0).stop 2024-09-19T09:05:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 -- 172.21.15.1:0/2030146427 shutdown_connections 2024-09-19T09:05:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/2030146427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbdc108290 0x7fcbdc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/2030146427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbdc103740 0x7fcbdc107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/2030146427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 0x7fcbdc103170 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 -- 172.21.15.1:0/2030146427 >> 172.21.15.1:0/2030146427 conn(0x7fcbdc0fc7d0 msgr2=0x7fcbdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 -- 172.21.15.1:0/2030146427 shutdown_connections 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.597+0000 7fcbe0c89640 1 -- 172.21.15.1:0/2030146427 wait complete. 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.598+0000 7fcbe0c89640 1 Processor -- start 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.598+0000 7fcbe0c89640 1 -- start start 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.598+0000 7fcbe0c89640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 0x7fcbdc198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.598+0000 7fcbe0c89640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbdc103740 0x7fcbdc198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.598+0000 7fcbe0c89640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbdc108290 0x7fcbdc19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.598+0000 7fcbe0c89640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc1121b0 con 0x7fcbdc102d90 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.598+0000 7fcbe0c89640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc112030 con 0x7fcbdc108290 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.598+0000 7fcbe0c89640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc112330 con 0x7fcbdc103740 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 0x7fcbdc198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 0x7fcbdc198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50880/0 (socket says 172.21.15.1:50880) 2024-09-19T09:05:16.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 -- 172.21.15.1:0/1642335283 learned_addr learned my addr 172.21.15.1:0/1642335283 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbdc103740 0x7fcbdc198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbdad9d640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbdc108290 0x7fcbdc19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 -- 172.21.15.1:0/1642335283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbdc103740 msgr2=0x7fcbdc198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbdc103740 0x7fcbdc198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 -- 172.21.15.1:0/1642335283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbdc108290 msgr2=0x7fcbdc19cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbdc108290 0x7fcbdc19cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 -- 172.21.15.1:0/1642335283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc19d630 con 0x7fcbdc102d90 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbdad9d640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbdc108290 0x7fcbdc19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbda59c640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 0x7fcbdc198680 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009230 tx=0x7fcbcc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbcb7fe640 1 -- 172.21.15.1:0/1642335283 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc03f030 con 0x7fcbdc102d90 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbcb7fe640 1 -- 172.21.15.1:0/1642335283 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbcc004440 con 0x7fcbdc102d90 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbe0c89640 1 -- 172.21.15.1:0/1642335283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbdc19d8c0 con 0x7fcbdc102d90 2024-09-19T09:05:16.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbcb7fe640 1 -- 172.21.15.1:0/1642335283 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc035070 con 0x7fcbdc102d90 2024-09-19T09:05:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.599+0000 7fcbe0c89640 1 -- 172.21.15.1:0/1642335283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbdc1a5200 con 0x7fcbdc102d90 2024-09-19T09:05:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.602+0000 7fcbcb7fe640 1 -- 172.21.15.1:0/1642335283 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fcbcc042030 con 0x7fcbdc102d90 2024-09-19T09:05:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.602+0000 7fcbcb7fe640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcbc40a32c0 0x7fcbc40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.603+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcbc40a32c0 0x7fcbc40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.603+0000 7fcbcb7fe640 1 -- 172.21.15.1:0/1642335283 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fcbcc0efd60 con 0x7fcbdc102d90 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.603+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcbc40a32c0 0x7fcbc40a5780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0feda0 tx=0x7fcbd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.603+0000 7fcbe3062740 1 Processor -- start 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.603+0000 7fcbe3062740 1 -- start start 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fb4a0 0x55b70a6fb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 0x55b70a706140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a706680 0x55b70a708a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbe3062740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b70a6612e0 con 0x55b70a706680 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbe3062740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b70a608ce0 con 0x55b70a6fb4a0 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbe3062740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b70a65d2a0 con 0x55b70a6fbdc0 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbdad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a706680 0x55b70a708a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fb4a0 0x55b70a6fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbdad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a706680 0x55b70a708a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50886/0 (socket says 172.21.15.1:50886) 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbdad9d640 1 -- 172.21.15.1:0/523575346 learned_addr learned my addr 172.21.15.1:0/523575346 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 0x55b70a706140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbda59c640 1 -- 172.21.15.1:0/523575346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 msgr2=0x55b70a706140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbda59c640 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 0x55b70a706140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbda59c640 1 -- 172.21.15.1:0/523575346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a706680 msgr2=0x55b70a708a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbda59c640 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a706680 0x55b70a708a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbda59c640 1 -- 172.21.15.1:0/523575346 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70a5ed440 con 0x55b70a6fb4a0 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.604+0000 7fcbdad9d640 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a706680 0x55b70a708a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.605+0000 7fcbda59c640 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fb4a0 0x55b70a6fb880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc032c50 tx=0x7fcbcc02a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26d5aab7901feaad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.605+0000 7fcbc8ff9640 1 -- 172.21.15.1:0/523575346 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc049040 con 0x55b70a6fb4a0 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.605+0000 7fcbc8ff9640 1 -- 172.21.15.1:0/523575346 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbcc0bc360 con 0x55b70a6fb4a0 2024-09-19T09:05:16.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.605+0000 7fcbc8ff9640 1 -- 172.21.15.1:0/523575346 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0b8b70 con 0x55b70a6fb4a0 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 -- 172.21.15.1:0/523575346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fb4a0 msgr2=0x55b70a6fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fb4a0 0x55b70a6fb880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc032c50 tx=0x7fcbcc02a420 comp rx=0 tx=0).stop 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 -- 172.21.15.1:0/523575346 shutdown_connections 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a706680 0x55b70a708a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 0x55b70a706140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 --2- 172.21.15.1:0/523575346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fb4a0 0x55b70a6fb880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 -- 172.21.15.1:0/523575346 >> 172.21.15.1:0/523575346 conn(0x55b70a6f7a30 msgr2=0x55b70a6f7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 -- 172.21.15.1:0/523575346 shutdown_connections 2024-09-19T09:05:16.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 -- 172.21.15.1:0/523575346 wait complete. 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.606+0000 7fcbe3062740 1 -- start start 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbe3062740 1 Processor -- start 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a706010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fbdc0 0x55b70a7032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a706680 0x55b70a703840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbe3062740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b70a70d420 con 0x55b70a6fb4a0 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbe3062740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b70a61c050 con 0x55b70a6fbdc0 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbe3062740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55b70a70d5a0 con 0x55b70a706680 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbe3062740 10 client.0 _ll_register_callbacks cb 0x55b70a65c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a706010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a706010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50898/0 (socket says 172.21.15.1:50898) 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbda59c640 1 -- 172.21.15.1:0/2688865736 learned_addr learned my addr 172.21.15.1:0/2688865736 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fbdc0 0x55b70a7032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbdad9d640 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a706680 0x55b70a703840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.607+0000 7fcbda59c640 1 -- 172.21.15.1:0/2688865736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a706680 msgr2=0x55b70a703840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbda59c640 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a706680 0x55b70a703840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbda59c640 1 -- 172.21.15.1:0/2688865736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fbdc0 msgr2=0x55b70a7032c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbda59c640 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fbdc0 0x55b70a7032c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbda59c640 1 -- 172.21.15.1:0/2688865736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b70a3d23c0 con 0x55b70a6fb4a0 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbda59c640 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a706010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc03d040 tx=0x7fcbcc005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeda346c33e92bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/2688865736 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc049040 con 0x55b70a6fb4a0 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/2688865736 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fcbcc0d5170 con 0x55b70a6fb4a0 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbe3062740 1 -- 172.21.15.1:0/2688865736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbcc0bc360 con 0x55b70a6fb4a0 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/2688865736 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcbcc0c0710 con 0x55b70a6fb4a0 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbe3062740 10 client.15651 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:16.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbe3062740 1 -- 172.21.15.1:0/2688865736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b70a70d420 con 0x55b70a6fb4a0 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.608+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/2688865736 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbcc0bc360 con 0x55b70a6fb4a0 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/2688865736 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcbcc03bb30 con 0x55b70a6fb4a0 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbe3062740 10 client.15651 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbe3062740 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbe3062740 20 client.15651 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b70a71a010 0x55b70a71c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbe3062740 4 client.15651 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbe3062740 1 -- 172.21.15.1:0/2688865736 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b70a66e850 con 0x55b70a71a010 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b70a71a010 0x55b70a71c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbc1ffb640 10 client.15651 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:16.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.609+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b70a71a010 0x55b70a71c400 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff2de06d3d1ec00a server_cookie=922703a4b6269c82 in_seq=0 out_seq=0 2024-09-19T09:05:16.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/2688865736 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b70a66e850 con 0x55b70a71a010 2024-09-19T09:05:16.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbc1ffb640 10 client.15651 handle_command_reply: tid=0 2024-09-19T09:05:16.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 client.15651 shutdown 2024-09-19T09:05:16.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 -- 172.21.15.1:0/2688865736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 msgr2=0x55b70a706010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a706010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc03d040 tx=0x7fcbcc005b50 comp rx=0 tx=0).stop 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 -- 172.21.15.1:0/2688865736 shutdown_connections 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b70a71a010 0x55b70a71c400 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbc1ffb640 0 client.15651 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a706680 0x55b70a703840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a6fbdc0 0x55b70a7032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2688865736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a706010 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.610+0000 7fcbe3062740 1 -- 172.21.15.1:0/2688865736 >> 172.21.15.1:0/2688865736 conn(0x55b70a6f7a30 msgr2=0x55b70a6fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.611+0000 7fcbe3062740 1 -- 172.21.15.1:0/2688865736 shutdown_connections 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.611+0000 7fcbe3062740 1 -- 172.21.15.1:0/2688865736 wait complete. 2024-09-19T09:05:16.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.611+0000 7fcbe3062740 20 client.15651 trim_cache size 0 max 16384 2024-09-19T09:05:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbe3062740 1 Processor -- start 2024-09-19T09:05:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbe3062740 1 -- start start 2024-09-19T09:05:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fb4a0 0x55b70a716680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fbdc0 0x55b70a721cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 0x55b70a722210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbe3062740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc1ade50 con 0x55b70a6fbdc0 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbe3062740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc1ab720 con 0x55b70a706680 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbe3062740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc1a9570 con 0x55b70a6fb4a0 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbd9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fbdc0 0x55b70a721cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbd9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fbdc0 0x55b70a721cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50906/0 (socket says 172.21.15.1:50906) 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbd9d9b640 1 -- 172.21.15.1:0/2883334851 learned_addr learned my addr 172.21.15.1:0/2883334851 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbda59c640 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fb4a0 0x55b70a716680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.646+0000 7fcbdad9d640 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 0x55b70a722210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbd9d9b640 1 -- 172.21.15.1:0/2883334851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fb4a0 msgr2=0x55b70a716680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fb4a0 0x55b70a716680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbd9d9b640 1 -- 172.21.15.1:0/2883334851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 msgr2=0x55b70a722210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 0x55b70a722210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbd9d9b640 1 -- 172.21.15.1:0/2883334851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70a703bb0 con 0x55b70a6fbdc0 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fbdc0 0x55b70a721cd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009a20 tx=0x7fcbd0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8afb3954bedf47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:16.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbc3fff640 1 -- 172.21.15.1:0/2883334851 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0004220 con 0x55b70a6fbdc0 2024-09-19T09:05:16.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbc3fff640 1 -- 172.21.15.1:0/2883334851 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbd00043c0 con 0x55b70a6fbdc0 2024-09-19T09:05:16.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.647+0000 7fcbc3fff640 1 -- 172.21.15.1:0/2883334851 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0003da0 con 0x55b70a6fbdc0 2024-09-19T09:05:16.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 -- 172.21.15.1:0/2883334851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fbdc0 msgr2=0x55b70a721cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fbdc0 0x55b70a721cd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009a20 tx=0x7fcbd0014000 comp rx=0 tx=0).stop 2024-09-19T09:05:16.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 -- 172.21.15.1:0/2883334851 shutdown_connections 2024-09-19T09:05:16.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 0x55b70a722210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fbdc0 0x55b70a721cd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 --2- 172.21.15.1:0/2883334851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fb4a0 0x55b70a716680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 -- 172.21.15.1:0/2883334851 >> 172.21.15.1:0/2883334851 conn(0x55b70a6f7a30 msgr2=0x55b70a6fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 -- 172.21.15.1:0/2883334851 shutdown_connections 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 -- 172.21.15.1:0/2883334851 wait complete. 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 -- start start 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.648+0000 7fcbe3062740 1 Processor -- start 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a70df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 0x55b70a70e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbe3062740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 0x55b70a712610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbe3062740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc1a9be0 con 0x55b70a6fb4a0 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbe3062740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc1ab050 con 0x55b70a706680 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbe3062740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc1aa2b0 con 0x55b70a6fbdc0 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbe3062740 10 client.0 _ll_register_callbacks cb 0x7fcbcc0c0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a70df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a70df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50916/0 (socket says 172.21.15.1:50916) 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 -- 172.21.15.1:0/3809262748 learned_addr learned my addr 172.21.15.1:0/3809262748 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 0x55b70a70e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbdad9d640 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 0x55b70a712610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 -- 172.21.15.1:0/3809262748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 msgr2=0x55b70a70e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 0x55b70a70e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 -- 172.21.15.1:0/3809262748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 msgr2=0x55b70a712610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 0x55b70a712610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 -- 172.21.15.1:0/3809262748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b70a712d00 con 0x55b70a6fb4a0 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbda59c640 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a70df90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0c4aa0 tx=0x7fcbcc0b8a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c096fec4f12a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.649+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/3809262748 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc049070 con 0x55b70a6fb4a0 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/3809262748 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fcbcc0c4d40 con 0x55b70a6fb4a0 2024-09-19T09:05:16.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 1 -- 172.21.15.1:0/3809262748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbd00043c0 con 0x55b70a6fb4a0 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/3809262748 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcbcc03bd40 con 0x55b70a6fb4a0 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 10 client.15657 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 1 -- 172.21.15.1:0/3809262748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b70a712d00 con 0x55b70a6fb4a0 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/3809262748 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbd00043c0 con 0x55b70a6fb4a0 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/3809262748 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcbcc0dc0b0 con 0x55b70a6fb4a0 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 10 client.15657 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 20 client.15657 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b70a71a010 0x55b70a786c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 4 client.15657 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbe3062740 1 -- 172.21.15.1:0/3809262748 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b70a668d60 con 0x55b70a71a010 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.650+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b70a71a010 0x55b70a786c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbd9d9b640 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b70a71a010 0x55b70a786c20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd15ce9c910b83a7 server_cookie=650df5475a8deb6c in_seq=0 out_seq=0 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbc1ffb640 10 client.15657 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbc1ffb640 1 -- 172.21.15.1:0/3809262748 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b70a668d60 con 0x55b70a71a010 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbc1ffb640 10 client.15657 handle_command_reply: tid=0 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 client.15657 shutdown 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 -- 172.21.15.1:0/3809262748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 msgr2=0x55b70a70df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a70df90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0c4aa0 tx=0x7fcbcc0b8a50 comp rx=0 tx=0).stop 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 -- 172.21.15.1:0/3809262748 shutdown_connections 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55b70a71a010 0x55b70a786c20 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b70a706680 0x55b70a712610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b70a6fbdc0 0x55b70a70e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 --2- 172.21.15.1:0/3809262748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b70a6fb4a0 0x55b70a70df90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 -- 172.21.15.1:0/3809262748 >> 172.21.15.1:0/3809262748 conn(0x55b70a6f7a30 msgr2=0x55b70a6f6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbc1ffb640 0 client.15657 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 -- 172.21.15.1:0/3809262748 shutdown_connections 2024-09-19T09:05:16.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.651+0000 7fcbe3062740 1 -- 172.21.15.1:0/3809262748 wait complete. 2024-09-19T09:05:16.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe3062740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T09:05:16.658 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:16.658 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:05:16.658 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:05:16.658 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 -- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcbc40a32c0 msgr2=0x7fcbc40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcbc40a32c0 0x7fcbc40a5780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0feda0 tx=0x7fcbd0005f90 comp rx=0 tx=0).stop 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 -- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 msgr2=0x7fcbdc198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 0x7fcbdc198680 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009230 tx=0x7fcbcc004040 comp rx=0 tx=0).stop 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 -- 172.21.15.1:0/1642335283 shutdown_connections 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcbdc108290 0x7fcbdc19cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcbc40a32c0 0x7fcbc40a5780 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbdc103740 0x7fcbdc198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 --2- 172.21.15.1:0/1642335283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcbdc102d90 0x7fcbdc198680 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 -- 172.21.15.1:0/1642335283 >> 172.21.15.1:0/1642335283 conn(0x7fcbdc0fc7d0 msgr2=0x7fcbdc106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 -- 172.21.15.1:0/1642335283 shutdown_connections 2024-09-19T09:05:16.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:16.652+0000 7fcbe0c89640 1 -- 172.21.15.1:0/1642335283 wait complete. 2024-09-19T09:05:17.511 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:05:17.512 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:17.771 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:17 smithi064 ceph-mon[35179]: pgmap v373: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:05:18.154 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:17 smithi001 ceph-mon[30939]: pgmap v373: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:05:18.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:17 smithi022 ceph-mon[35107]: pgmap v373: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:05:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 -- 172.21.15.1:0/1388897644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 msgr2=0x7fddb410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 --2- 172.21.15.1:0/1388897644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 0x7fddb410e610 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fddac009ca0 tx=0x7fddac02a950 comp rx=0 tx=0).stop 2024-09-19T09:05:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 -- 172.21.15.1:0/1388897644 shutdown_connections 2024-09-19T09:05:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 --2- 172.21.15.1:0/1388897644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 0x7fddb410e610 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 --2- 172.21.15.1:0/1388897644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb4103660 0x7fddb410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 --2- 172.21.15.1:0/1388897644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb4102d40 0x7fddb4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 -- 172.21.15.1:0/1388897644 >> 172.21.15.1:0/1388897644 conn(0x7fddb40fc7a0 msgr2=0x7fddb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 -- 172.21.15.1:0/1388897644 shutdown_connections 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.236+0000 7fddb89b7640 1 -- 172.21.15.1:0/1388897644 wait complete. 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb89b7640 1 Processor -- start 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb89b7640 1 -- start start 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb89b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb4102d40 0x7fddb41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb89b7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb4103660 0x7fddb41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb89b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 0x7fddb419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb89b7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4112090 con 0x7fddb410c170 2024-09-19T09:05:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb89b7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4111f10 con 0x7fddb4102d40 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb89b7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fddb4112210 con 0x7fddb4103660 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 0x7fddb419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 0x7fddb419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50932/0 (socket says 172.21.15.1:50932) 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.237+0000 7fddb2d9d640 1 -- 172.21.15.1:0/2078062746 learned_addr learned my addr 172.21.15.1:0/2078062746 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb1d9b640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb4103660 0x7fddb41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb259c640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb4102d40 0x7fddb41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb2d9d640 1 -- 172.21.15.1:0/2078062746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb4103660 msgr2=0x7fddb41989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb2d9d640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb4103660 0x7fddb41989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb2d9d640 1 -- 172.21.15.1:0/2078062746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb4102d40 msgr2=0x7fddb41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb2d9d640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb4102d40 0x7fddb41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb2d9d640 1 -- 172.21.15.1:0/2078062746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb419d460 con 0x7fddb410c170 2024-09-19T09:05:18.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb259c640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb4102d40 0x7fddb41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb2d9d640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 0x7fddb419cd80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fddac005cc0 tx=0x7fddac030e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddab7fe640 1 -- 172.21.15.1:0/2078062746 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac034040 con 0x7fddb410c170 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddab7fe640 1 -- 172.21.15.1:0/2078062746 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fddac003e00 con 0x7fddb410c170 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb419d6f0 con 0x7fddb410c170 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddab7fe640 1 -- 172.21.15.1:0/2078062746 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0456e0 con 0x7fddb410c170 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.238+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb41a5030 con 0x7fddb410c170 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.239+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb406b070 con 0x7fddb410c170 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.240+0000 7fddab7fe640 1 -- 172.21.15.1:0/2078062746 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fddac037020 con 0x7fddb410c170 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.242+0000 7fddab7fe640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdda00a3240 0x7fdda00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.242+0000 7fddb259c640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdda00a3240 0x7fdda00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.242+0000 7fddab7fe640 1 -- 172.21.15.1:0/2078062746 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fddac0f0b00 con 0x7fddb410c170 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.242+0000 7fddb259c640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdda00a3240 0x7fdda00a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdda40058c0 tx=0x7fdda4005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.246+0000 7fddab7fe640 1 -- 172.21.15.1:0/2078062746 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fddac0bd7a0 con 0x7fddb410c170 2024-09-19T09:05:18.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.462+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddb4199810 con 0x7fddb410c170 2024-09-19T09:05:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.463+0000 7fddab7fe640 1 -- 172.21.15.1:0/2078062746 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7fddac0bd0a0 con 0x7fddb410c170 2024-09-19T09:05:18.464 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:05:18.464 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:05:18.464 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdda00a3240 msgr2=0x7fdda00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdda00a3240 0x7fdda00a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdda40058c0 tx=0x7fdda4005d20 comp rx=0 tx=0).stop 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 msgr2=0x7fddb419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 0x7fddb419cd80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fddac005cc0 tx=0x7fddac030e10 comp rx=0 tx=0).stop 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 shutdown_connections 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddb410c170 0x7fddb419cd80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fdda00a3240 0x7fdda00a5700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb4103660 0x7fddb41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 --2- 172.21.15.1:0/2078062746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb4102d40 0x7fddb41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 >> 172.21.15.1:0/2078062746 conn(0x7fddb40fc7a0 msgr2=0x7fddb40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 shutdown_connections 2024-09-19T09:05:18.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:18.465+0000 7fddb89b7640 1 -- 172.21.15.1:0/2078062746 wait complete. 2024-09-19T09:05:19.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:18 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2078062746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:19.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:18 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2078062746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:19.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:05:19.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:18 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2078062746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:19.409 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:19.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 -- 172.21.15.1:0/4076365599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c102570 msgr2=0x7f810c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 --2- 172.21.15.1:0/4076365599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c102570 0x7f810c1029b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009900 tx=0x7f80f402a480 comp rx=0 tx=0).stop 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 -- 172.21.15.1:0/4076365599 shutdown_connections 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 --2- 172.21.15.1:0/4076365599 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810c102ef0 0x7f810c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 --2- 172.21.15.1:0/4076365599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c102570 0x7f810c1029b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 --2- 172.21.15.1:0/4076365599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f810c100e20 0x7f810c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 -- 172.21.15.1:0/4076365599 >> 172.21.15.1:0/4076365599 conn(0x7f810c0fc7d0 msgr2=0x7f810c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 -- 172.21.15.1:0/4076365599 shutdown_connections 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.828+0000 7f81122df640 1 -- 172.21.15.1:0/4076365599 wait complete. 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f81122df640 1 Processor -- start 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f81122df640 1 -- start start 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f81122df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c100e20 0x7f810c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f81122df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f810c102570 0x7f810c198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f81122df640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810c102ef0 0x7f810c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f81122df640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f810c112180 con 0x7f810c100e20 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f81122df640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f810c112000 con 0x7f810c102570 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f81122df640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f810c112300 con 0x7f810c102ef0 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f810bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c100e20 0x7f810c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f810bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c100e20 0x7f810c1985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50948/0 (socket says 172.21.15.1:50948) 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f810bfff640 1 -- 172.21.15.1:0/3854138999 learned_addr learned my addr 172.21.15.1:0/3854138999 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f811087c640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810c102ef0 0x7f810c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f8103fff640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f810c102570 0x7f810c198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f810bfff640 1 -- 172.21.15.1:0/3854138999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810c102ef0 msgr2=0x7f810c19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f810bfff640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810c102ef0 0x7f810c19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f810bfff640 1 -- 172.21.15.1:0/3854138999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f810c102570 msgr2=0x7f810c198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f810bfff640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f810c102570 0x7f810c198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f810bfff640 1 -- 172.21.15.1:0/3854138999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c19d590 con 0x7f810c100e20 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.829+0000 7f8103fff640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f810c102570 0x7f810c198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.830+0000 7f810bfff640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c100e20 0x7f810c1985e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00e9f0 tx=0x7f80fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.830+0000 7f8109ffb640 1 -- 172.21.15.1:0/3854138999 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00cd80 con 0x7f810c100e20 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.830+0000 7f8109ffb640 1 -- 172.21.15.1:0/3854138999 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80fc010930 con 0x7f810c100e20 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.830+0000 7f81122df640 1 -- 172.21.15.1:0/3854138999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810c19d880 con 0x7f810c100e20 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.830+0000 7f8109ffb640 1 -- 172.21.15.1:0/3854138999 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc018b00 con 0x7f810c100e20 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.830+0000 7f81122df640 1 -- 172.21.15.1:0/3854138999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810c1a5160 con 0x7f810c100e20 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f8109ffb640 1 -- 172.21.15.1:0/3854138999 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f80fc018ca0 con 0x7f810c100e20 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f81146b8740 1 Processor -- start 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f81146b8740 1 -- start start 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f81146b8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f74090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f81146b8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f745d0 0x560eb0f74a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f81146b8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f83780 0x560eb0f85b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f81146b8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eb0eda2f0 con 0x560eb0f75b40 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f81146b8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560eb0e81cf0 con 0x560eb0f745d0 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f81146b8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560eb0ed62b0 con 0x560eb0f83780 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f811087c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f74090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f811087c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f74090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50952/0 (socket says 172.21.15.1:50952) 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.833+0000 7f811087c640 1 -- 172.21.15.1:0/3146448355 learned_addr learned my addr 172.21.15.1:0/3146448355 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f8103fff640 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f83780 0x560eb0f85b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f810bfff640 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f745d0 0x560eb0f74a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f811087c640 1 -- 172.21.15.1:0/3146448355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f83780 msgr2=0x560eb0f85b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f811087c640 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f83780 0x560eb0f85b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f811087c640 1 -- 172.21.15.1:0/3146448355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f745d0 msgr2=0x560eb0f74a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f811087c640 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f745d0 0x560eb0f74a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f811087c640 1 -- 172.21.15.1:0/3146448355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb0e663a0 con 0x560eb0f75b40 2024-09-19T09:05:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f8109ffb640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80f80a3240 0x7f80f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f811087c640 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f74090 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8104010370 tx=0x7f8104010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad48ad1247ac93d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f810bfff640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80f80a3240 0x7f80f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f8109ffb640 1 -- 172.21.15.1:0/3854138999 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f80fc0cfda0 con 0x7f810c100e20 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f81027fc640 1 -- 172.21.15.1:0/3146448355 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104016070 con 0x560eb0f75b40 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f81027fc640 1 -- 172.21.15.1:0/3146448355 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8104004d20 con 0x560eb0f75b40 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.834+0000 7f81027fc640 1 -- 172.21.15.1:0/3146448355 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81040054e0 con 0x560eb0f75b40 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 -- 172.21.15.1:0/3146448355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 msgr2=0x560eb0f74090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f810bfff640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80f80a3240 0x7f80f80a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0cdbf0 tx=0x7f80fc01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f74090 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8104010370 tx=0x7f8104010830 comp rx=0 tx=0).stop 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 -- 172.21.15.1:0/3146448355 shutdown_connections 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f83780 0x560eb0f85b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f745d0 0x560eb0f74a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 --2- 172.21.15.1:0/3146448355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f74090 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 -- 172.21.15.1:0/3146448355 >> 172.21.15.1:0/3146448355 conn(0x560eb0f3d310 msgr2=0x560eb0f70c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 -- 172.21.15.1:0/3146448355 shutdown_connections 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 -- 172.21.15.1:0/3146448355 wait complete. 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.835+0000 7f81146b8740 1 -- start start 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f81146b8740 1 Processor -- start 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f81146b8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f831b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f81146b8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f80460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f81146b8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f80bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f81146b8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eb0f86480 con 0x560eb0f75b40 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f81146b8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560eb0e95060 con 0x560eb0f83780 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f81146b8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560eb0f86600 con 0x560eb0f745d0 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f81146b8740 10 client.0 _ll_register_callbacks cb 0x560eb0be88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f8103fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f80460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f8103fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f80460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50958/0 (socket says 172.21.15.1:50958) 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f8103fff640 1 -- 172.21.15.1:0/2158145286 learned_addr learned my addr 172.21.15.1:0/2158145286 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f811087c640 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.836+0000 7f811087c640 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f80bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f8103fff640 1 -- 172.21.15.1:0/2158145286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 msgr2=0x560eb0f831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f8103fff640 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f8103fff640 1 -- 172.21.15.1:0/2158145286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 msgr2=0x560eb0f80bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f8103fff640 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f80bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f8103fff640 1 -- 172.21.15.1:0/2158145286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb0c4b3c0 con 0x560eb0f75b40 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f8103fff640 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f80460 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f80f402a9a0 tx=0x7f80f4031890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf508f8186bbd303 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f80eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2158145286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4035070 con 0x560eb0f75b40 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2158145286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f80f4004240 con 0x560eb0f75b40 2024-09-19T09:05:19.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f81146b8740 1 -- 172.21.15.1:0/2158145286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8104004d20 con 0x560eb0f75b40 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2158145286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80f4031a00 con 0x560eb0f75b40 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f81146b8740 10 client.15675 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.837+0000 7f81146b8740 1 -- 172.21.15.1:0/2158145286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560eb0f91f60 con 0x560eb0f75b40 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2158145286 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8104004d20 con 0x560eb0f75b40 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2158145286 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f80f4004b10 con 0x560eb0f75b40 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f81146b8740 10 client.15675 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f81146b8740 10 client.15675 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f81146b8740 20 client.15675 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f81146b8740 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560eb0f93420 0x560eb0f95840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f81146b8740 4 client.15675 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f81146b8740 1 -- 172.21.15.1:0/2158145286 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eb0ee7860 con 0x560eb0f93420 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f811087c640 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560eb0f93420 0x560eb0f95840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f811087c640 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560eb0f93420 0x560eb0f95840 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=73453a98bf00f9b6 server_cookie=219396b53ac8d50f in_seq=0 out_seq=0 2024-09-19T09:05:19.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.838+0000 7f80eb7fe640 10 client.15675 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2158145286 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560eb0ee7860 con 0x560eb0f93420 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f80eb7fe640 10 client.15675 handle_command_reply: tid=0 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 client.15675 shutdown 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 -- 172.21.15.1:0/2158145286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 msgr2=0x560eb0f80460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f80460 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f80f402a9a0 tx=0x7f80f4031890 comp rx=0 tx=0).stop 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 -- 172.21.15.1:0/2158145286 shutdown_connections 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560eb0f93420 0x560eb0f95840 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f80bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f80460 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 --2- 172.21.15.1:0/2158145286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f831b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f81146b8740 1 -- 172.21.15.1:0/2158145286 >> 172.21.15.1:0/2158145286 conn(0x560eb0f3d310 msgr2=0x560eb0f76960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.839+0000 7f80eb7fe640 0 client.15675 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:05:19.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.840+0000 7f81146b8740 1 -- 172.21.15.1:0/2158145286 shutdown_connections 2024-09-19T09:05:19.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.840+0000 7f81146b8740 1 -- 172.21.15.1:0/2158145286 wait complete. 2024-09-19T09:05:19.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.840+0000 7f81146b8740 20 client.15675 trim_cache size 0 max 16384 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f81146b8740 1 Processor -- start 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f81146b8740 1 -- start start 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f81146b8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f80430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f81146b8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f9b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f81146b8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f9b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f81146b8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f810c1adde0 con 0x560eb0f75b40 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f81146b8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f810c1ab6b0 con 0x560eb0f83780 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f81146b8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f810c1a9500 con 0x560eb0f745d0 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f9b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f9b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50968/0 (socket says 172.21.15.1:50968) 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 -- 172.21.15.1:0/1895121847 learned_addr learned my addr 172.21.15.1:0/1895121847 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f811087c640 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f9b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f811087c640 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f80430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 -- 172.21.15.1:0/1895121847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 msgr2=0x560eb0f80430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f80430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 -- 172.21.15.1:0/1895121847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 msgr2=0x560eb0f9b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f9b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 -- 172.21.15.1:0/1895121847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb0f70ed0 con 0x560eb0f75b40 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f811087c640 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f80430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.853+0000 7f8103fff640 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f9b110 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f80f4003640 tx=0x7f80f4005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb892707e4b3e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f8101ffb640 1 -- 172.21.15.1:0/1895121847 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4035070 con 0x560eb0f75b40 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f8101ffb640 1 -- 172.21.15.1:0/1895121847 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80f40046c0 con 0x560eb0f75b40 2024-09-19T09:05:19.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f8101ffb640 1 -- 172.21.15.1:0/1895121847 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4003d80 con 0x560eb0f75b40 2024-09-19T09:05:19.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 -- 172.21.15.1:0/1895121847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 msgr2=0x560eb0f9b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f9b110 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f80f4003640 tx=0x7f80f4005a20 comp rx=0 tx=0).stop 2024-09-19T09:05:19.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 -- 172.21.15.1:0/1895121847 shutdown_connections 2024-09-19T09:05:19.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f9b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0f9b110 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 --2- 172.21.15.1:0/1895121847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0f80430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 -- 172.21.15.1:0/1895121847 >> 172.21.15.1:0/1895121847 conn(0x560eb0f3d310 msgr2=0x560eb0f7fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 -- 172.21.15.1:0/1895121847 shutdown_connections 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.854+0000 7f81146b8740 1 -- 172.21.15.1:0/1895121847 wait complete. 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 1 -- start start 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 1 Processor -- start 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0ff63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0ff6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f86eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f810c1a9b70 con 0x560eb0f75b40 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f810c1aafe0 con 0x560eb0f83780 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f810c1aa240 con 0x560eb0f745d0 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f81146b8740 10 client.0 _ll_register_callbacks cb 0x7f80fc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f8103fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0ff6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f8103fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0ff6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50970/0 (socket says 172.21.15.1:50970) 2024-09-19T09:05:19.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f8103fff640 1 -- 172.21.15.1:0/2722256645 learned_addr learned my addr 172.21.15.1:0/2722256645 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f811087c640 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f86eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f811087c640 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0ff63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.855+0000 7f8103fff640 1 -- 172.21.15.1:0/2722256645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 msgr2=0x560eb0ff63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f8103fff640 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0ff63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f8103fff640 1 -- 172.21.15.1:0/2722256645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 msgr2=0x560eb0f86eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f8103fff640 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f86eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f8103fff640 1 -- 172.21.15.1:0/2722256645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb0f875a0 con 0x560eb0f75b40 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f811087c640 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0ff63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f8103fff640 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0ff6910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f80f4033000 tx=0x7f80f4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b95b94e3afeaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f80eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2722256645 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4035040 con 0x560eb0f75b40 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2722256645 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f80f4005140 con 0x560eb0f75b40 2024-09-19T09:05:19.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f81146b8740 1 -- 172.21.15.1:0/2722256645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80f40046c0 con 0x560eb0f75b40 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2722256645 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80f4067050 con 0x560eb0f75b40 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f81146b8740 10 client.15681 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f81146b8740 1 -- 172.21.15.1:0/2722256645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560eb0ffdba0 con 0x560eb0f75b40 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2722256645 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80f40046c0 con 0x560eb0f75b40 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.856+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2722256645 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f80f4057470 con 0x560eb0f75b40 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f81146b8740 10 client.15681 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f81146b8740 10 client.15681 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f81146b8740 20 client.15681 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f81146b8740 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560eb0ffe230 0x560eb1000650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f81146b8740 4 client.15681 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f81146b8740 1 -- 172.21.15.1:0/2722256645 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560eb0ee1d70 con 0x560eb0ffe230 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f811087c640 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560eb0ffe230 0x560eb1000650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:19.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f811087c640 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560eb0ffe230 0x560eb1000650 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=939f85c54d929b5 server_cookie=f4d5e79fbb5fa187 in_seq=0 out_seq=0 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.857+0000 7f80eb7fe640 10 client.15681 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f80eb7fe640 1 -- 172.21.15.1:0/2722256645 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560eb0ee1d70 con 0x560eb0ffe230 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f80eb7fe640 10 client.15681 handle_command_reply: tid=0 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 client.15681 shutdown 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 -- 172.21.15.1:0/2722256645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 msgr2=0x560eb0ff6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0ff6910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f80f4033000 tx=0x7f80f4005c90 comp rx=0 tx=0).stop 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 -- 172.21.15.1:0/2722256645 shutdown_connections 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560eb0ffe230 0x560eb1000650 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eb0f83780 0x560eb0f86eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eb0f75b40 0x560eb0ff6910 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f80eb7fe640 0 client.15681 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 --2- 172.21.15.1:0/2722256645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560eb0f745d0 0x560eb0ff63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 -- 172.21.15.1:0/2722256645 >> 172.21.15.1:0/2722256645 conn(0x560eb0f3d310 msgr2=0x560eb0f824e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 -- 172.21.15.1:0/2722256645 shutdown_connections 2024-09-19T09:05:19.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 1 -- 172.21.15.1:0/2722256645 wait complete. 2024-09-19T09:05:19.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.858+0000 7f81146b8740 20 client.15681 trim_cache size 0 max 16384 2024-09-19T09:05:19.865 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:05:19.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 -- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80f80a3240 msgr2=0x7f80f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80f80a3240 0x7f80f80a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0cdbf0 tx=0x7f80fc01f000 comp rx=0 tx=0).stop 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 -- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c100e20 msgr2=0x7f810c1985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c100e20 0x7f810c1985e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00e9f0 tx=0x7f80fc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 -- 172.21.15.1:0/3854138999 shutdown_connections 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80f80a3240 0x7f80f80a5700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f810c102ef0 0x7f810c19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f810c102570 0x7f810c198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 --2- 172.21.15.1:0/3854138999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810c100e20 0x7f810c1985e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 -- 172.21.15.1:0/3854138999 >> 172.21.15.1:0/3854138999 conn(0x7f810c0fc7d0 msgr2=0x7f810c1068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 -- 172.21.15.1:0/3854138999 shutdown_connections 2024-09-19T09:05:19.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:19.859+0000 7f81122df640 1 -- 172.21.15.1:0/3854138999 wait complete. 2024-09-19T09:05:20.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:19 smithi064 ceph-mon[35179]: pgmap v374: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:05:20.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:19 smithi022 ceph-mon[35107]: pgmap v374: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:05:20.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:19 smithi001 ceph-mon[30939]: pgmap v374: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:05:20.684 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:05:20.949 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:21.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.388+0000 7f1710e9d640 1 -- 172.21.15.1:0/1017872200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 msgr2=0x7f170c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.388+0000 7f1710e9d640 1 --2- 172.21.15.1:0/1017872200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 0x7f170c10d950 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1704009cd0 tx=0x7f170402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.388+0000 7f1710e9d640 1 -- 172.21.15.1:0/1017872200 shutdown_connections 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.388+0000 7f1710e9d640 1 --2- 172.21.15.1:0/1017872200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 0x7f170c10d950 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.388+0000 7f1710e9d640 1 --2- 172.21.15.1:0/1017872200 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f170c100a80 0x7f170c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.389+0000 7f1710e9d640 1 --2- 172.21.15.1:0/1017872200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f170c106a80 0x7f170c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.389+0000 7f1710e9d640 1 -- 172.21.15.1:0/1017872200 >> 172.21.15.1:0/1017872200 conn(0x7f170c0fc7a0 msgr2=0x7f170c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.389+0000 7f1710e9d640 1 -- 172.21.15.1:0/1017872200 shutdown_connections 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.389+0000 7f1710e9d640 1 -- 172.21.15.1:0/1017872200 wait complete. 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.389+0000 7f1710e9d640 1 Processor -- start 2024-09-19T09:05:21.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.389+0000 7f1710e9d640 1 -- start start 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1710e9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f170c100a80 0x7f170c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1710e9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 0x7f170c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1710e9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f170c106a80 0x7f170c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1710e9d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f170c110fa0 con 0x7f170c101420 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1710e9d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f170c110e20 con 0x7f170c100a80 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1710e9d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f170c111120 con 0x7f170c106a80 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1703fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 0x7f170c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1703fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 0x7f170c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50982/0 (socket says 172.21.15.1:50982) 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1703fff640 1 -- 172.21.15.1:0/932749394 learned_addr learned my addr 172.21.15.1:0/932749394 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f170a59c640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f170c100a80 0x7f170c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f170ad9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f170c106a80 0x7f170c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1703fff640 1 -- 172.21.15.1:0/932749394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f170c106a80 msgr2=0x7f170c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1703fff640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f170c106a80 0x7f170c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1703fff640 1 -- 172.21.15.1:0/932749394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f170c100a80 msgr2=0x7f170c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1703fff640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f170c100a80 0x7f170c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f1703fff640 1 -- 172.21.15.1:0/932749394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c19f5c0 con 0x7f170c101420 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.390+0000 7f170ad9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f170c106a80 0x7f170c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.391+0000 7f1703fff640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 0x7f170c19ab50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c920 tx=0x7f16f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.391+0000 7f17037fe640 1 -- 172.21.15.1:0/932749394 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4007c70 con 0x7f170c101420 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.391+0000 7f1710e9d640 1 -- 172.21.15.1:0/932749394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c19f8b0 con 0x7f170c101420 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.391+0000 7f17037fe640 1 -- 172.21.15.1:0/932749394 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16f4007e10 con 0x7f170c101420 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.391+0000 7f17037fe640 1 -- 172.21.15.1:0/932749394 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4018940 con 0x7f170c101420 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.391+0000 7f1710e9d640 1 -- 172.21.15.1:0/932749394 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c1a7190 con 0x7f170c101420 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.393+0000 7f17037fe640 1 -- 172.21.15.1:0/932749394 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f16f4018b20 con 0x7f170c101420 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.393+0000 7f1713276740 1 Processor -- start 2024-09-19T09:05:21.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1713276740 1 -- start start 2024-09-19T09:05:21.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1713276740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8856090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1713276740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8856a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1713276740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c8863760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1713276740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5634c87bc2f0 con 0x5634c88565d0 2024-09-19T09:05:21.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1713276740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5634c8763cf0 con 0x5634c8857b40 2024-09-19T09:05:21.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1713276740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5634c87b82b0 con 0x5634c8861370 2024-09-19T09:05:21.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8856a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8856a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50998/0 (socket says 172.21.15.1:50998) 2024-09-19T09:05:21.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170a59c640 1 -- 172.21.15.1:0/629771941 learned_addr learned my addr 172.21.15.1:0/629771941 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:21.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f17037fe640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f16f80a3240 0x7f16f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170ad9d640 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8856090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1703fff640 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c8863760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f17037fe640 1 -- 172.21.15.1:0/932749394 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f16f40cfb10 con 0x7f170c101420 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170a59c640 1 -- 172.21.15.1:0/629771941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 msgr2=0x5634c8863760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170a59c640 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c8863760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170a59c640 1 -- 172.21.15.1:0/629771941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 msgr2=0x5634c8856090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170a59c640 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8856090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170a59c640 1 -- 172.21.15.1:0/629771941 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634c87483a0 con 0x5634c88565d0 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f1703fff640 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c8863760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170ad9d640 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8856090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.394+0000 7f170ad9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f16f80a3240 0x7f16f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.395+0000 7f170a59c640 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8856a10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00bc50 tx=0x7f16fc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2531e007460f0079 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:21.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.395+0000 7f1700ff9640 1 -- 172.21.15.1:0/629771941 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc01c480 con 0x5634c88565d0 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.395+0000 7f1700ff9640 1 -- 172.21.15.1:0/629771941 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16fc01cb20 con 0x5634c88565d0 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.395+0000 7f1700ff9640 1 -- 172.21.15.1:0/629771941 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc011c80 con 0x5634c88565d0 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- 172.21.15.1:0/629771941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 msgr2=0x5634c8856a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f170ad9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f16f80a3240 0x7f16f80a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1704009430 tx=0x7f170403e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8856a10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00bc50 tx=0x7f16fc0107a0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- 172.21.15.1:0/629771941 shutdown_connections 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c8863760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8856a10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 --2- 172.21.15.1:0/629771941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8856090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- 172.21.15.1:0/629771941 >> 172.21.15.1:0/629771941 conn(0x5634c881f310 msgr2=0x5634c8852c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- 172.21.15.1:0/629771941 shutdown_connections 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- 172.21.15.1:0/629771941 wait complete. 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- start start 2024-09-19T09:05:21.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 Processor -- start 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c88565d0 0x5634c8860d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8857b40 0x5634c885dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c885e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5634c8864070 con 0x5634c8857b40 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5634c8777060 con 0x5634c88565d0 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.396+0000 7f1713276740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5634c88641f0 con 0x5634c8861370 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1713276740 10 client.0 _ll_register_callbacks cb 0x5634c84ca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8857b40 0x5634c885dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8857b40 0x5634c885dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51010/0 (socket says 172.21.15.1:51010) 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 -- 172.21.15.1:0/1263254169 learned_addr learned my addr 172.21.15.1:0/1263254169 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f170a59c640 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c88565d0 0x5634c8860d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 -- 172.21.15.1:0/1263254169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 msgr2=0x5634c885e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c885e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 -- 172.21.15.1:0/1263254169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c88565d0 msgr2=0x5634c8860d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c88565d0 0x5634c8860d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 -- 172.21.15.1:0/1263254169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634c852d3c0 con 0x5634c8857b40 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f170a59c640 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c88565d0 0x5634c8860d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1703fff640 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8857b40 0x5634c885dff0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f16f40cd590 tx=0x7f16f401def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2d4936a791d09f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f16f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1263254169 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f409c0b0 con 0x5634c8857b40 2024-09-19T09:05:21.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1263254169 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f16f4015d70 con 0x5634c8857b40 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1713276740 1 -- 172.21.15.1:0/1263254169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16fc01cb20 con 0x5634c8857b40 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1263254169 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f16f40a0460 con 0x5634c8857b40 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1713276740 10 client.15693 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f1713276740 1 -- 172.21.15.1:0/1263254169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5634c886fa50 con 0x5634c8857b40 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.397+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1263254169 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16fc01cb20 con 0x5634c8857b40 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1263254169 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f16f4098720 con 0x5634c8857b40 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f1713276740 10 client.15693 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f1713276740 10 client.15693 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f1713276740 20 client.15693 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f1713276740 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5634c8870f10 0x5634c88733a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f1713276740 4 client.15693 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f1713276740 1 -- 172.21.15.1:0/1263254169 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634c87c9860 con 0x5634c8870f10 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f170a59c640 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5634c8870f10 0x5634c88733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f16f1ffb640 10 client.15693 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.398+0000 7f170a59c640 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5634c8870f10 0x5634c88733a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b9f0e5240507476 server_cookie=407aacf3e9f7e19f in_seq=0 out_seq=0 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1263254169 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634c87c9860 con 0x5634c8870f10 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f16f1ffb640 10 client.15693 handle_command_reply: tid=0 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 client.15693 shutdown 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 -- 172.21.15.1:0/1263254169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8857b40 msgr2=0x5634c885dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8857b40 0x5634c885dff0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f16f40cd590 tx=0x7f16f401def0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 -- 172.21.15.1:0/1263254169 shutdown_connections 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5634c8870f10 0x5634c88733a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c885e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8857b40 0x5634c885dff0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f16f1ffb640 0 client.15693 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 --2- 172.21.15.1:0/1263254169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c88565d0 0x5634c8860d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 -- 172.21.15.1:0/1263254169 >> 172.21.15.1:0/1263254169 conn(0x5634c881f310 msgr2=0x5634c8858930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 -- 172.21.15.1:0/1263254169 shutdown_connections 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.399+0000 7f1713276740 1 -- 172.21.15.1:0/1263254169 wait complete. 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.400+0000 7f1713276740 20 client.15693 trim_cache size 0 max 16384 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1713276740 1 Processor -- start 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1713276740 1 -- start start 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1713276740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c88565d0 0x5634c886d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1713276740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8859120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1713276740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8861370 0x5634c8859660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1713276740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1b20d0 con 0x5634c8861370 2024-09-19T09:05:21.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1713276740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1af9a0 con 0x5634c8857b40 2024-09-19T09:05:21.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1713276740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1ad7f0 con 0x5634c88565d0 2024-09-19T09:05:21.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8861370 0x5634c8859660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8861370 0x5634c8859660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51018/0 (socket says 172.21.15.1:51018) 2024-09-19T09:05:21.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170ad9d640 1 -- 172.21.15.1:0/1724406703 learned_addr learned my addr 172.21.15.1:0/1724406703 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:21.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170a59c640 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c88565d0 0x5634c886d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f1703fff640 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8859120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170ad9d640 1 -- 172.21.15.1:0/1724406703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c88565d0 msgr2=0x5634c886d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170ad9d640 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c88565d0 0x5634c886d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170ad9d640 1 -- 172.21.15.1:0/1724406703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 msgr2=0x5634c8859120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170ad9d640 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8859120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.413+0000 7f170ad9d640 1 -- 172.21.15.1:0/1724406703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634c885e950 con 0x5634c8861370 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f170ad9d640 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8861370 0x5634c8859660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1704035000 tx=0x7f170402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a010f0b2f0f3ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f16f3fff640 1 -- 172.21.15.1:0/1724406703 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704003970 con 0x5634c8861370 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f16f3fff640 1 -- 172.21.15.1:0/1724406703 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f170404b070 con 0x5634c8861370 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f16f3fff640 1 -- 172.21.15.1:0/1724406703 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704030800 con 0x5634c8861370 2024-09-19T09:05:21.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 -- 172.21.15.1:0/1724406703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8861370 msgr2=0x5634c8859660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8861370 0x5634c8859660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1704035000 tx=0x7f170402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 -- 172.21.15.1:0/1724406703 shutdown_connections 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c8861370 0x5634c8859660 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c8859120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 --2- 172.21.15.1:0/1724406703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c88565d0 0x5634c886d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 -- 172.21.15.1:0/1724406703 >> 172.21.15.1:0/1724406703 conn(0x5634c881f310 msgr2=0x5634c885d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 -- 172.21.15.1:0/1724406703 shutdown_connections 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.414+0000 7f1713276740 1 -- 172.21.15.1:0/1724406703 wait complete. 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 1 -- start start 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 1 Processor -- start 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8869d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c885ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c885b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1ade60 con 0x5634c88565d0 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1af2d0 con 0x5634c8857b40 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1ae530 con 0x5634c8861370 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1713276740 10 client.0 _ll_register_callbacks cb 0x7f16f400fee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f170a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8869d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f170a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8869d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51022/0 (socket says 172.21.15.1:51022) 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f170a59c640 1 -- 172.21.15.1:0/1942139828 learned_addr learned my addr 172.21.15.1:0/1942139828 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f170ad9d640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c885b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f1703fff640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c885ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f170a59c640 1 -- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 msgr2=0x5634c885b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f170a59c640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c885b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.415+0000 7f170a59c640 1 -- 172.21.15.1:0/1942139828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 msgr2=0x5634c885ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f170a59c640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c885ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f170a59c640 1 -- 172.21.15.1:0/1942139828 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634c885bcc0 con 0x5634c88565d0 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f170ad9d640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c885b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f1703fff640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c885ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f170a59c640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8869d00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0117b0 tx=0x7f16fc010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3143140410a28afc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f16f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1942139828 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc011d20 con 0x5634c88565d0 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1942139828 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f16fc005040 con 0x5634c88565d0 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f1713276740 1 -- 172.21.15.1:0/1942139828 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f170404b070 con 0x5634c88565d0 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1942139828 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f16fc011590 con 0x5634c88565d0 2024-09-19T09:05:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f1713276740 10 client.15699 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f1713276740 1 -- 172.21.15.1:0/1942139828 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5634c88dbdc0 con 0x5634c88565d0 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1942139828 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f170404b070 con 0x5634c88565d0 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1942139828 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f16fc01dce0 con 0x5634c88565d0 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f1713276740 10 client.15699 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f1713276740 10 client.15699 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f1713276740 20 client.15699 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.416+0000 7f1713276740 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5634c88dc1b0 0x5634c88de5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 4 client.15699 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 1 -- 172.21.15.1:0/1942139828 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634c87c3d70 con 0x5634c88dc1b0 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1703fff640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5634c88dc1b0 0x5634c88de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f16f1ffb640 10 client.15699 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1703fff640 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5634c88dc1b0 0x5634c88de5a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e207bde94c7ae7d server_cookie=a3470a6f8ce2c767 in_seq=0 out_seq=0 2024-09-19T09:05:21.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f16f1ffb640 1 -- 172.21.15.1:0/1942139828 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634c87c3d70 con 0x5634c88dc1b0 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f16f1ffb640 10 client.15699 handle_command_reply: tid=0 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 1 client.15699 shutdown 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 1 -- 172.21.15.1:0/1942139828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 msgr2=0x5634c8869d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8869d00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0117b0 tx=0x7f16fc010fd0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 1 -- 172.21.15.1:0/1942139828 shutdown_connections 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5634c88dc1b0 0x5634c88de5a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5634c8861370 0x5634c885b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f16f1ffb640 0 client.15699 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.417+0000 7f1713276740 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5634c8857b40 0x5634c885ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1713276740 1 --2- 172.21.15.1:0/1942139828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5634c88565d0 0x5634c8869d00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1713276740 1 -- 172.21.15.1:0/1942139828 >> 172.21.15.1:0/1942139828 conn(0x5634c881f310 msgr2=0x5634c8851500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1713276740 1 -- 172.21.15.1:0/1942139828 shutdown_connections 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1713276740 1 -- 172.21.15.1:0/1942139828 wait complete. 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1713276740 20 client.15699 trim_cache size 0 max 16384 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 -- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f16f80a3240 msgr2=0x7f16f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f16f80a3240 0x7f16f80a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1704009430 tx=0x7f170403e040 comp rx=0 tx=0).stop 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 -- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 msgr2=0x7f170c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 0x7f170c19ab50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c920 tx=0x7f16f400cde0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 -- 172.21.15.1:0/932749394 shutdown_connections 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f16f80a3240 0x7f16f80a5700 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f170c106a80 0x7f170c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f170c101420 0x7f170c19ab50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 --2- 172.21.15.1:0/932749394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f170c100a80 0x7f170c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 -- 172.21.15.1:0/932749394 >> 172.21.15.1:0/932749394 conn(0x7f170c0fc7a0 msgr2=0x7f170c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 -- 172.21.15.1:0/932749394 shutdown_connections 2024-09-19T09:05:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:21.418+0000 7f1710e9d640 1 -- 172.21.15.1:0/932749394 wait complete. 2024-09-19T09:05:22.085 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:21 smithi001 ceph-mon[30939]: pgmap v375: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:05:22.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:21 smithi064 ceph-mon[35179]: pgmap v375: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:05:22.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:05:22.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:21 smithi022 ceph-mon[35107]: pgmap v375: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:05:22.371 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 -- 172.21.15.1:0/1482175892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c410c170 msgr2=0x7f84c410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 --2- 172.21.15.1:0/1482175892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c410c170 0x7f84c410e610 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009ca0 tx=0x7f84bc02a950 comp rx=0 tx=0).stop 2024-09-19T09:05:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 -- 172.21.15.1:0/1482175892 shutdown_connections 2024-09-19T09:05:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 --2- 172.21.15.1:0/1482175892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c410c170 0x7f84c410e610 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 --2- 172.21.15.1:0/1482175892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c4103660 0x7f84c410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 --2- 172.21.15.1:0/1482175892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c4102d40 0x7f84c4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 -- 172.21.15.1:0/1482175892 >> 172.21.15.1:0/1482175892 conn(0x7f84c40fc7a0 msgr2=0x7f84c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:22.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 -- 172.21.15.1:0/1482175892 shutdown_connections 2024-09-19T09:05:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 -- 172.21.15.1:0/1482175892 wait complete. 2024-09-19T09:05:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.824+0000 7f84cab55640 1 Processor -- start 2024-09-19T09:05:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84cab55640 1 -- start start 2024-09-19T09:05:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84cab55640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c4102d40 0x7f84c41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84cab55640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c4103660 0x7f84c4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84cab55640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c410c170 0x7f84c4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84cab55640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84c41120e0 con 0x7f84c4103660 2024-09-19T09:05:22.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84cab55640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4111f60 con 0x7f84c410c170 2024-09-19T09:05:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84cab55640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4112260 con 0x7f84c4102d40 2024-09-19T09:05:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c4103660 0x7f84c4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c4103660 0x7f84c4100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36400/0 (socket says 172.21.15.1:36400) 2024-09-19T09:05:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c3fff640 1 -- 172.21.15.1:0/4108480095 learned_addr learned my addr 172.21.15.1:0/4108480095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c88f1640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c4102d40 0x7f84c41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c90f2640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c410c170 0x7f84c4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c3fff640 1 -- 172.21.15.1:0/4108480095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c4102d40 msgr2=0x7f84c41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c3fff640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c4102d40 0x7f84c41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c3fff640 1 -- 172.21.15.1:0/4108480095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c410c170 msgr2=0x7f84c4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c3fff640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c410c170 0x7f84c4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.825+0000 7f84c3fff640 1 -- 172.21.15.1:0/4108480095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c41a6980 con 0x7f84c4103660 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.826+0000 7f84c3fff640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c4103660 0x7f84c4100ee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f84b000d950 tx=0x7f84b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.826+0000 7f84c1ffb640 1 -- 172.21.15.1:0/4108480095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0017030 con 0x7f84c4103660 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.826+0000 7f84c1ffb640 1 -- 172.21.15.1:0/4108480095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84b0004020 con 0x7f84c4103660 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.826+0000 7f84cab55640 1 -- 172.21.15.1:0/4108480095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c41a6c70 con 0x7f84c4103660 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.826+0000 7f84c1ffb640 1 -- 172.21.15.1:0/4108480095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00047a0 con 0x7f84c4103660 2024-09-19T09:05:22.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.826+0000 7f84cab55640 1 -- 172.21.15.1:0/4108480095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c41a71b0 con 0x7f84c4103660 2024-09-19T09:05:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.828+0000 7f84c1ffb640 1 -- 172.21.15.1:0/4108480095 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f84b00041d0 con 0x7f84c4103660 2024-09-19T09:05:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84ccf2e740 1 Processor -- start 2024-09-19T09:05:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84ccf2e740 1 -- start start 2024-09-19T09:05:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84c1ffb640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f84b40a32c0 0x7f84b40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfdab40 0x55793cfd9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfd95d0 0x55793cfd9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84c90f2640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f84b40a32c0 0x7f84b40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55793cf3f2f0 con 0x55793cfe4370 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55793cee6cf0 con 0x55793cfd95d0 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55793cf3b2b0 con 0x55793cfdab40 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84c1ffb640 1 -- 172.21.15.1:0/4108480095 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f84b00cf120 con 0x7f84c4103660 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84c90f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84c90f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36406/0 (socket says 172.21.15.1:36406) 2024-09-19T09:05:22.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84c90f2640 1 -- 172.21.15.1:0/1830933604 learned_addr learned my addr 172.21.15.1:0/1830933604 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84c88f1640 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfdab40 0x55793cfd9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.829+0000 7f84c3fff640 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfd95d0 0x55793cfd9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84c90f2640 1 -- 172.21.15.1:0/1830933604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfdab40 msgr2=0x55793cfd9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84c90f2640 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfdab40 0x55793cfd9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84c90f2640 1 -- 172.21.15.1:0/1830933604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfd95d0 msgr2=0x55793cfd9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84c90f2640 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfd95d0 0x55793cfd9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84c90f2640 1 -- 172.21.15.1:0/1830933604 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793cecb3a0 con 0x55793cfe4370 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84c90f2640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f84b40a32c0 0x7f84b40a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f84bc02ae70 tx=0x7f84bc02f860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84c90f2640 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe6760 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f84bc035000 tx=0x7f84bc048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d4e2bffd942366 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84aeffd640 1 -- 172.21.15.1:0/1830933604 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc034040 con 0x55793cfe4370 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84aeffd640 1 -- 172.21.15.1:0/1830933604 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84bc050070 con 0x55793cfe4370 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.830+0000 7f84aeffd640 1 -- 172.21.15.1:0/1830933604 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc004da0 con 0x55793cfe4370 2024-09-19T09:05:22.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1830933604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 msgr2=0x55793cfe6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe6760 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f84bc035000 tx=0x7f84bc048000 comp rx=0 tx=0).stop 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1830933604 shutdown_connections 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe6760 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfd95d0 0x55793cfd9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1830933604 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfdab40 0x55793cfd9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1830933604 >> 172.21.15.1:0/1830933604 conn(0x55793cfa2310 msgr2=0x55793cfd5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1830933604 shutdown_connections 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1830933604 wait complete. 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 -- start start 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.831+0000 7f84ccf2e740 1 Processor -- start 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cfe3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfdab40 0x55793cfe0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55793cfe7010 con 0x55793cfe4370 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55793cefa060 con 0x55793cfdab40 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55793cfe7190 con 0x55793cfd95d0 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84ccf2e740 10 client.0 _ll_register_callbacks cb 0x55793cc4d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfdab40 0x55793cfe0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36408/0 (socket says 172.21.15.1:36408) 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 -- 172.21.15.1:0/2166202581 learned_addr learned my addr 172.21.15.1:0/2166202581 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfdab40 0x55793cfe0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:36440/0 (socket says 172.21.15.1:36440) 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c88f1640 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cfe3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 -- 172.21.15.1:0/2166202581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 msgr2=0x55793cfe3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cfe3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 -- 172.21.15.1:0/2166202581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfdab40 msgr2=0x55793cfe0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfdab40 0x55793cfe0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 -- 172.21.15.1:0/2166202581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55793ccb03c0 con 0x55793cfe4370 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84c90f2640 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe15e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f84bc005dc0 tx=0x7f84bc004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff6893025783e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.832+0000 7f84a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84a3fff640 1 -- 172.21.15.1:0/2166202581 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc058020 con 0x55793cfe4370 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84a3fff640 1 -- 172.21.15.1:0/2166202581 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f84bc004240 con 0x55793cfe4370 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 1 -- 172.21.15.1:0/2166202581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84bc050070 con 0x55793cfe4370 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84a3fff640 1 -- 172.21.15.1:0/2166202581 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f84bc063050 con 0x55793cfe4370 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 10 client.15711 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 1 -- 172.21.15.1:0/2166202581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55793cff2ad0 con 0x55793cfe4370 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84a3fff640 1 -- 172.21.15.1:0/2166202581 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84bc050070 con 0x55793cfe4370 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84a3fff640 1 -- 172.21.15.1:0/2166202581 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f84bc030440 con 0x55793cfe4370 2024-09-19T09:05:22.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 10 client.15711 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 20 client.15711 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55793cff3e20 0x55793cff6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 4 client.15711 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.833+0000 7f84ccf2e740 1 -- 172.21.15.1:0/2166202581 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55793cf4c860 con 0x55793cff3e20 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.834+0000 7f84c88f1640 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55793cff3e20 0x55793cff6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.834+0000 7f84c88f1640 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55793cff3e20 0x55793cff6210 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c00c6239da02e7 server_cookie=8d198f555dbe8b7e in_seq=0 out_seq=0 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.834+0000 7f84a3fff640 10 client.15711 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84a3fff640 1 -- 172.21.15.1:0/2166202581 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55793cf4c860 con 0x55793cff3e20 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84a3fff640 10 client.15711 handle_command_reply: tid=0 2024-09-19T09:05:22.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 client.15711 shutdown 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 -- 172.21.15.1:0/2166202581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 msgr2=0x55793cfe15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe15e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f84bc005dc0 tx=0x7f84bc004f60 comp rx=0 tx=0).stop 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 -- 172.21.15.1:0/2166202581 shutdown_connections 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55793cff3e20 0x55793cff6210 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfe4370 0x55793cfe15e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfdab40 0x55793cfe0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/2166202581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cfe3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 -- 172.21.15.1:0/2166202581 >> 172.21.15.1:0/2166202581 conn(0x55793cfa2310 msgr2=0x55793cfdb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84a3fff640 0 client.15711 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 -- 172.21.15.1:0/2166202581 shutdown_connections 2024-09-19T09:05:22.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 1 -- 172.21.15.1:0/2166202581 wait complete. 2024-09-19T09:05:22.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.835+0000 7f84ccf2e740 20 client.15711 trim_cache size 0 max 16384 2024-09-19T09:05:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.848+0000 7f84ccf2e740 1 Processor -- start 2024-09-19T09:05:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.848+0000 7f84ccf2e740 1 -- start start 2024-09-19T09:05:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cfdf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cfdfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84c41b2270 con 0x55793cfdab40 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f84c41afb40 con 0x55793cfe4370 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84c41ad990 con 0x55793cfd95d0 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cfdfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cfdfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36416/0 (socket says 172.21.15.1:36416) 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 -- 172.21.15.1:0/3388177408 learned_addr learned my addr 172.21.15.1:0/3388177408 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c90f2640 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c88f1640 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cfdf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 -- 172.21.15.1:0/3388177408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 msgr2=0x55793cfdf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cfdf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 -- 172.21.15.1:0/3388177408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 msgr2=0x55793cff8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 -- 172.21.15.1:0/3388177408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55793cfd5ed0 con 0x55793cfdab40 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c90f2640 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84c3fff640 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cfdfe00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f84b00ccba0 tx=0x7f84b0005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d4cb7a41a2d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.849+0000 7f84ae7fc640 1 -- 172.21.15.1:0/3388177408 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b3070 con 0x55793cfdab40 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ae7fc640 1 -- 172.21.15.1:0/3388177408 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84b009bdc0 con 0x55793cfdab40 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ae7fc640 1 -- 172.21.15.1:0/3388177408 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00afbe0 con 0x55793cfdab40 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 -- 172.21.15.1:0/3388177408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 msgr2=0x55793cfdfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cfdfe00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f84b00ccba0 tx=0x7f84b0005230 comp rx=0 tx=0).stop 2024-09-19T09:05:22.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 -- 172.21.15.1:0/3388177408 shutdown_connections 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cfdfe00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/3388177408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cfdf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 -- 172.21.15.1:0/3388177408 >> 172.21.15.1:0/3388177408 conn(0x55793cfa2310 msgr2=0x55793cfe0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 -- 172.21.15.1:0/3388177408 shutdown_connections 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.850+0000 7f84ccf2e740 1 -- 172.21.15.1:0/3388177408 wait complete. 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 1 -- start start 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 1 Processor -- start 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cff5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cff6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84c41ae000 con 0x55793cfdab40 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f84c41af470 con 0x55793cfe4370 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f84c41ae6d0 con 0x55793cfd95d0 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84ccf2e740 10 client.0 _ll_register_callbacks cb 0x7f84b0005130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cff6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cff6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36426/0 (socket says 172.21.15.1:36426) 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84c3fff640 1 -- 172.21.15.1:0/1056863941 learned_addr learned my addr 172.21.15.1:0/1056863941 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84c88f1640 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cff5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.851+0000 7f84c90f2640 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84c3fff640 1 -- 172.21.15.1:0/1056863941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 msgr2=0x55793cff5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84c3fff640 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cff5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84c3fff640 1 -- 172.21.15.1:0/1056863941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 msgr2=0x55793cff69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84c3fff640 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84c3fff640 1 -- 172.21.15.1:0/1056863941 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55793d05ca20 con 0x55793cfdab40 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84c3fff640 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cff6480 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f84b0097b20 tx=0x7f84b00ccda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5817295650da9776 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84a3fff640 1 -- 172.21.15.1:0/1056863941 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0081060 con 0x55793cfdab40 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84a3fff640 1 -- 172.21.15.1:0/1056863941 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f84b00afde0 con 0x55793cfdab40 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1056863941 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84b009bdc0 con 0x55793cfdab40 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84a3fff640 1 -- 172.21.15.1:0/1056863941 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f84b00b3050 con 0x55793cfdab40 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84ccf2e740 10 client.15717 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1056863941 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55793d05dd20 con 0x55793cfdab40 2024-09-19T09:05:22.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84a3fff640 1 -- 172.21.15.1:0/1056863941 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f84b009bdc0 con 0x55793cfdab40 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.852+0000 7f84a3fff640 1 -- 172.21.15.1:0/1056863941 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f84b007b070 con 0x55793cfdab40 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 10 client.15717 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 20 client.15717 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55793d05e390 0x55793d060780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 4 client.15717 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1056863941 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55793cf46d70 con 0x55793d05e390 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84c88f1640 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55793d05e390 0x55793d060780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84c88f1640 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55793d05e390 0x55793d060780 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=225eed3282d20ea7 server_cookie=4a36f306923fe61a in_seq=0 out_seq=0 2024-09-19T09:05:22.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84a3fff640 10 client.15717 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:22.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84a3fff640 1 -- 172.21.15.1:0/1056863941 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55793cf46d70 con 0x55793d05e390 2024-09-19T09:05:22.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84a3fff640 10 client.15717 handle_command_reply: tid=0 2024-09-19T09:05:22.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 1 client.15717 shutdown 2024-09-19T09:05:22.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1056863941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 msgr2=0x55793cff6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.853+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cff6480 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f84b0097b20 tx=0x7f84b00ccda0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1056863941 shutdown_connections 2024-09-19T09:05:22.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55793d05e390 0x55793d060780 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55793cfe4370 0x55793cff69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55793cfdab40 0x55793cff6480 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84a3fff640 0 client.15717 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:22.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 1 --2- 172.21.15.1:0/1056863941 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55793cfd95d0 0x55793cff5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1056863941 >> 172.21.15.1:0/1056863941 conn(0x55793cfa2310 msgr2=0x55793cfe2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:22.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1056863941 shutdown_connections 2024-09-19T09:05:22.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 1 -- 172.21.15.1:0/1056863941 wait complete. 2024-09-19T09:05:22.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84ccf2e740 20 client.15717 trim_cache size 0 max 16384 2024-09-19T09:05:22.863 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:05:22.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 -- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f84b40a32c0 msgr2=0x7f84b40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f84b40a32c0 0x7f84b40a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f84bc02ae70 tx=0x7f84bc02f860 comp rx=0 tx=0).stop 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 -- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c4103660 msgr2=0x7f84c4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c4103660 0x7f84c4100ee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f84b000d950 tx=0x7f84b000de10 comp rx=0 tx=0).stop 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 -- 172.21.15.1:0/4108480095 shutdown_connections 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84c410c170 0x7f84c4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84c4103660 0x7f84c4100ee0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f84b40a32c0 0x7f84b40a5780 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 --2- 172.21.15.1:0/4108480095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84c4102d40 0x7f84c41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.854+0000 7f84cab55640 1 -- 172.21.15.1:0/4108480095 >> 172.21.15.1:0/4108480095 conn(0x7f84c40fc7a0 msgr2=0x7f84c40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.855+0000 7f84cab55640 1 -- 172.21.15.1:0/4108480095 shutdown_connections 2024-09-19T09:05:22.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:22.855+0000 7f84cab55640 1 -- 172.21.15.1:0/4108480095 wait complete. 2024-09-19T09:05:23.920 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:24.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:23 smithi064 ceph-mon[35179]: pgmap v376: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:05:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:24.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:23 smithi022 ceph-mon[35107]: pgmap v376: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:05:24.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:23 smithi001 ceph-mon[30939]: pgmap v376: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:05:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.310+0000 7f30f4227640 1 -- 172.21.15.1:0/3678713447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec101da0 msgr2=0x7f30ec108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.310+0000 7f30f4227640 1 --2- 172.21.15.1:0/3678713447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec101da0 0x7f30ec108630 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009ca0 tx=0x7f30e402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.310+0000 7f30f4227640 1 -- 172.21.15.1:0/3678713447 shutdown_connections 2024-09-19T09:05:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.310+0000 7f30f4227640 1 --2- 172.21.15.1:0/3678713447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec101da0 0x7f30ec108630 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.310+0000 7f30f4227640 1 --2- 172.21.15.1:0/3678713447 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30ec1013e0 0x7f30ec101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.310+0000 7f30f4227640 1 --2- 172.21.15.1:0/3678713447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30ec1001f0 0x7f30ec1005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.310+0000 7f30f4227640 1 -- 172.21.15.1:0/3678713447 >> 172.21.15.1:0/3678713447 conn(0x7f30ec0fb970 msgr2=0x7f30ec0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 -- 172.21.15.1:0/3678713447 shutdown_connections 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 -- 172.21.15.1:0/3678713447 wait complete. 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 Processor -- start 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 -- start start 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30ec1001f0 0x7f30ec0fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec1013e0 0x7f30ec19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30ec101da0 0x7f30ec19f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10bfd0 con 0x7f30ec1013e0 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10be50 con 0x7f30ec101da0 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f4227640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10c150 con 0x7f30ec1001f0 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f17c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec1013e0 0x7f30ec19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.311+0000 7f30f17c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec1013e0 0x7f30ec19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36456/0 (socket says 172.21.15.1:36456) 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f17c2640 1 -- 172.21.15.1:0/106421689 learned_addr learned my addr 172.21.15.1:0/106421689 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f27c4640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30ec101da0 0x7f30ec19f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30ec1001f0 0x7f30ec0fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f17c2640 1 -- 172.21.15.1:0/106421689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30ec1001f0 msgr2=0x7f30ec0fdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f17c2640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30ec1001f0 0x7f30ec0fdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f17c2640 1 -- 172.21.15.1:0/106421689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30ec101da0 msgr2=0x7f30ec19f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f17c2640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30ec101da0 0x7f30ec19f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f17c2640 1 -- 172.21.15.1:0/106421689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ec19fbb0 con 0x7f30ec1013e0 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f27c4640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30ec101da0 0x7f30ec19f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30ec1001f0 0x7f30ec0fdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f17c2640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec1013e0 0x7f30ec19cca0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00c970 tx=0x7f30dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30e2ffd640 1 -- 172.21.15.1:0/106421689 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc007bb0 con 0x7f30ec1013e0 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30e2ffd640 1 -- 172.21.15.1:0/106421689 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30dc007d50 con 0x7f30ec1013e0 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f4227640 1 -- 172.21.15.1:0/106421689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ec19fea0 con 0x7f30ec1013e0 2024-09-19T09:05:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30e2ffd640 1 -- 172.21.15.1:0/106421689 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00f4b0 con 0x7f30ec1013e0 2024-09-19T09:05:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.312+0000 7f30f4227640 1 -- 172.21.15.1:0/106421689 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ec1a0310 con 0x7f30ec1013e0 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30e2ffd640 1 -- 172.21.15.1:0/106421689 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f30dc0046c0 con 0x7f30ec1013e0 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30f6fc4740 1 Processor -- start 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30f6fc4740 1 -- start start 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 0x55752b1c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1ca2e0 0x55752b1ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1cf370 0x55752b1d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55752b12d2f0 con 0x55752b1ca2e0 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55752b0d5270 con 0x55752b1cf370 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.315+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55752b1292b0 con 0x55752b1c99a0 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1ca2e0 0x55752b1ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1ca2e0 0x55752b1ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36472/0 (socket says 172.21.15.1:36472) 2024-09-19T09:05:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 -- 172.21.15.1:0/945344463 learned_addr learned my addr 172.21.15.1:0/945344463 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f17c2640 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1cf370 0x55752b1d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30e2ffd640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30d80a3240 0x7f30d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f27c4640 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 0x55752b1c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 -- 172.21.15.1:0/945344463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 msgr2=0x55752b1c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 0x55752b1c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 -- 172.21.15.1:0/945344463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1cf370 msgr2=0x55752b1d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1cf370 0x55752b1d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 -- 172.21.15.1:0/945344463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752b0d4340 con 0x55752b1ca2e0 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f27c4640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30d80a3240 0x7f30d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f17c2640 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1cf370 0x55752b1d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30e2ffd640 1 -- 172.21.15.1:0/106421689 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f30dc0cf800 con 0x7f30ec1013e0 2024-09-19T09:05:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1ca2e0 0x55752b1ceda0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f30e800cc50 tx=0x7f30e800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786dc67f7c506321 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30d7fff640 1 -- 172.21.15.1:0/945344463 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8014070 con 0x55752b1ca2e0 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30d7fff640 1 -- 172.21.15.1:0/945344463 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30e80047a0 con 0x55752b1ca2e0 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.316+0000 7f30d7fff640 1 -- 172.21.15.1:0/945344463 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e80107d0 con 0x55752b1ca2e0 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 -- 172.21.15.1:0/945344463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1ca2e0 msgr2=0x55752b1ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f27c4640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30d80a3240 0x7f30d80a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30e402f540 tx=0x7f30e403e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1ca2e0 0x55752b1ceda0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f30e800cc50 tx=0x7f30e800e720 comp rx=0 tx=0).stop 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 -- 172.21.15.1:0/945344463 shutdown_connections 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1cf370 0x55752b1d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1ca2e0 0x55752b1ceda0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/945344463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 0x55752b1c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 -- 172.21.15.1:0/945344463 >> 172.21.15.1:0/945344463 conn(0x55752b1c5010 msgr2=0x55752b1c5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 -- 172.21.15.1:0/945344463 shutdown_connections 2024-09-19T09:05:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 -- 172.21.15.1:0/945344463 wait complete. 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.317+0000 7f30f6fc4740 1 -- start start 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f6fc4740 1 Processor -- start 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1c99a0 0x55752b1d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1d4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1cf370 0x55752b1db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55752b1d2340 con 0x55752b1c99a0 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55752b0b6290 con 0x55752b1ca2e0 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55752b1d24c0 con 0x55752b1cf370 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f6fc4740 10 client.0 _ll_register_callbacks cb 0x55752b0e7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f1fc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1c99a0 0x55752b1d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f1fc3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1c99a0 0x55752b1d3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36480/0 (socket says 172.21.15.1:36480) 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f1fc3640 1 -- 172.21.15.1:0/1066567729 learned_addr learned my addr 172.21.15.1:0/1066567729 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f17c2640 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f27c4640 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1cf370 0x55752b1db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f1fc3640 1 -- 172.21.15.1:0/1066567729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1cf370 msgr2=0x55752b1db140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1cf370 0x55752b1db140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f1fc3640 1 -- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 msgr2=0x55752b1d4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1d4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f1fc3640 1 -- 172.21.15.1:0/1066567729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752ae40210 con 0x55752b1c99a0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.318+0000 7f30f17c2640 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1d4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1c99a0 0x55752b1d3bc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f30e80051c0 tx=0x7f30e80051f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca383ff2bcfef383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30d57fa640 1 -- 172.21.15.1:0/1066567729 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8014070 con 0x55752b1c99a0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30d57fa640 1 -- 172.21.15.1:0/1066567729 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f30e8004030 con 0x55752b1c99a0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 1 -- 172.21.15.1:0/1066567729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e80047a0 con 0x55752b1c99a0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30d57fa640 1 -- 172.21.15.1:0/1066567729 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f30e80055a0 con 0x55752b1c99a0 2024-09-19T09:05:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 10 client.15729 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 1 -- 172.21.15.1:0/1066567729 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55752af0c620 con 0x55752b1c99a0 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30d57fa640 1 -- 172.21.15.1:0/1066567729 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30e80047a0 con 0x55752b1c99a0 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30d57fa640 1 -- 172.21.15.1:0/1066567729 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f30e8010510 con 0x55752b1c99a0 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 10 client.15729 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 20 client.15729 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55752b1df550 0x55752b1e1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 4 client.15729 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.319+0000 7f30f6fc4740 1 -- 172.21.15.1:0/1066567729 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55752b13aa20 con 0x55752b1df550 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.320+0000 7f30f17c2640 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55752b1df550 0x55752b1e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.320+0000 7f30f17c2640 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55752b1df550 0x55752b1e1940 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9f46eeab56dd166 server_cookie=3704ed40ecd59386 in_seq=0 out_seq=0 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.320+0000 7f30d57fa640 10 client.15729 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30d57fa640 1 -- 172.21.15.1:0/1066567729 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55752b13aa20 con 0x55752b1df550 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30d57fa640 10 client.15729 handle_command_reply: tid=0 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 client.15729 shutdown 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 -- 172.21.15.1:0/1066567729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1c99a0 msgr2=0x55752b1d3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1c99a0 0x55752b1d3bc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f30e80051c0 tx=0x7f30e80051f0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 -- 172.21.15.1:0/1066567729 shutdown_connections 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55752b1df550 0x55752b1e1940 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1cf370 0x55752b1db140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30d57fa640 0 client.15729 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1d4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/1066567729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1c99a0 0x55752b1d3bc0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 -- 172.21.15.1:0/1066567729 >> 172.21.15.1:0/1066567729 conn(0x55752b1c5010 msgr2=0x55752b1c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 -- 172.21.15.1:0/1066567729 shutdown_connections 2024-09-19T09:05:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 1 -- 172.21.15.1:0/1066567729 wait complete. 2024-09-19T09:05:24.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.321+0000 7f30f6fc4740 20 client.15729 trim_cache size 0 max 16384 2024-09-19T09:05:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.335+0000 7f30f6fc4740 1 Processor -- start 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.335+0000 7f30f6fc4740 1 -- start start 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 0x55752b1c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1db100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec1abae0 con 0x55752b1cf370 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec1a93b0 con 0x55752b1ca2e0 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec1a7200 con 0x55752b1c99a0 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36490/0 (socket says 172.21.15.1:36490) 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 -- 172.21.15.1:0/3679545695 learned_addr learned my addr 172.21.15.1:0/3679545695 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 0x55752b1c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f17c2640 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 -- 172.21.15.1:0/3679545695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 msgr2=0x55752b1c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 0x55752b1c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 -- 172.21.15.1:0/3679545695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 msgr2=0x55752b1db100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1db100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 -- 172.21.15.1:0/3679545695 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752b1e1cb0 con 0x55752b1cf370 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f17c2640 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1db100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30f27c4640 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1c5930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f30e4035000 tx=0x7f30e4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c18982f34feb7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.336+0000 7f30d77fe640 1 -- 172.21.15.1:0/3679545695 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40318e0 con 0x55752b1cf370 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30d77fe640 1 -- 172.21.15.1:0/3679545695 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30e4036040 con 0x55752b1cf370 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30d77fe640 1 -- 172.21.15.1:0/3679545695 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e402fd50 con 0x55752b1cf370 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 -- 172.21.15.1:0/3679545695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 msgr2=0x55752b1c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1c5930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f30e4035000 tx=0x7f30e4040000 comp rx=0 tx=0).stop 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 -- 172.21.15.1:0/3679545695 shutdown_connections 2024-09-19T09:05:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1c5930 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1ca2e0 0x55752b1db100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/3679545695 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1c99a0 0x55752b1c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 -- 172.21.15.1:0/3679545695 >> 172.21.15.1:0/3679545695 conn(0x55752b1c5010 msgr2=0x55752b1d3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 -- 172.21.15.1:0/3679545695 shutdown_connections 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.337+0000 7f30f6fc4740 1 -- 172.21.15.1:0/3679545695 wait complete. 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 1 -- start start 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 1 Processor -- start 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1c99a0 0x55752b1d8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1ca2e0 0x55752b1d8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1d9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec1a7870 con 0x55752b1cf370 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec1a8ce0 con 0x55752b1c99a0 2024-09-19T09:05:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec1a7f40 con 0x55752b1ca2e0 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f6fc4740 10 client.0 _ll_register_callbacks cb 0x7f30e800cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f27c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1d9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f27c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1d9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36504/0 (socket says 172.21.15.1:36504) 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f27c4640 1 -- 172.21.15.1:0/289924253 learned_addr learned my addr 172.21.15.1:0/289924253 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1c99a0 0x55752b1d8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.338+0000 7f30f17c2640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1ca2e0 0x55752b1d8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f27c4640 1 -- 172.21.15.1:0/289924253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1ca2e0 msgr2=0x55752b1d8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f27c4640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1ca2e0 0x55752b1d8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f27c4640 1 -- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1c99a0 msgr2=0x55752b1d8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f27c4640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1c99a0 0x55752b1d8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f27c4640 1 -- 172.21.15.1:0/289924253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752b1da030 con 0x55752b1cf370 2024-09-19T09:05:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1c99a0 0x55752b1d8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f17c2640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1ca2e0 0x55752b1d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f27c4640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1d9a20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f30e402ade0 tx=0x7f30e4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac321312e63efa50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30d57fa640 1 -- 172.21.15.1:0/289924253 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4004b40 con 0x55752b1cf370 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f6fc4740 1 -- 172.21.15.1:0/289924253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e4036040 con 0x55752b1cf370 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30d57fa640 1 -- 172.21.15.1:0/289924253 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f30e404d040 con 0x55752b1cf370 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30d57fa640 1 -- 172.21.15.1:0/289924253 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f30e4004ce0 con 0x55752b1cf370 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f6fc4740 10 client.15735 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.339+0000 7f30f6fc4740 1 -- 172.21.15.1:0/289924253 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55752b1db2b0 con 0x55752b1cf370 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30d57fa640 1 -- 172.21.15.1:0/289924253 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30e4036040 con 0x55752b1cf370 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30d57fa640 1 -- 172.21.15.1:0/289924253 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f30e4030820 con 0x55752b1cf370 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30f6fc4740 10 client.15735 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30f6fc4740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:24.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30f6fc4740 20 client.15735 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55752b24a760 0x55752b24cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30f6fc4740 4 client.15735 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30f6fc4740 1 -- 172.21.15.1:0/289924253 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55752b134d70 con 0x55752b24a760 2024-09-19T09:05:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55752b24a760 0x55752b24cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30f1fc3640 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55752b24a760 0x55752b24cb80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=607ede9e5098dee5 server_cookie=b6561a35444fbc30 in_seq=0 out_seq=0 2024-09-19T09:05:24.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.340+0000 7f30d57fa640 10 client.15735 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30d57fa640 1 -- 172.21.15.1:0/289924253 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55752b134d70 con 0x55752b24a760 2024-09-19T09:05:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30d57fa640 10 client.15735 handle_command_reply: tid=0 2024-09-19T09:05:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 client.15735 shutdown 2024-09-19T09:05:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 -- 172.21.15.1:0/289924253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 msgr2=0x55752b1d9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1d9a20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f30e402ade0 tx=0x7f30e4005bd0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 -- 172.21.15.1:0/289924253 shutdown_connections 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55752b24a760 0x55752b24cb80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55752b1cf370 0x55752b1d9a20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30d57fa640 0 client.15735 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55752b1ca2e0 0x55752b1d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 --2- 172.21.15.1:0/289924253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55752b1c99a0 0x55752b1d8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 -- 172.21.15.1:0/289924253 >> 172.21.15.1:0/289924253 conn(0x55752b1c5010 msgr2=0x55752b1c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 -- 172.21.15.1:0/289924253 shutdown_connections 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 1 -- 172.21.15.1:0/289924253 wait complete. 2024-09-19T09:05:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.344+0000 7f30f6fc4740 20 client.15735 trim_cache size 0 max 16384 2024-09-19T09:05:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:05:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:05:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:05:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 -- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30d80a3240 msgr2=0x7f30d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30d80a3240 0x7f30d80a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30e402f540 tx=0x7f30e403e040 comp rx=0 tx=0).stop 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 -- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec1013e0 msgr2=0x7f30ec19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec1013e0 0x7f30ec19cca0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00c970 tx=0x7f30dc00ce30 comp rx=0 tx=0).stop 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 -- 172.21.15.1:0/106421689 shutdown_connections 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30ec101da0 0x7f30ec19f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30ec1013e0 0x7f30ec19cca0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30d80a3240 0x7f30d80a5700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 --2- 172.21.15.1:0/106421689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30ec1001f0 0x7f30ec0fdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 -- 172.21.15.1:0/106421689 >> 172.21.15.1:0/106421689 conn(0x7f30ec0fb970 msgr2=0x7f30ec1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 -- 172.21.15.1:0/106421689 shutdown_connections 2024-09-19T09:05:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:24.345+0000 7f30f4227640 1 -- 172.21.15.1:0/106421689 wait complete. 2024-09-19T09:05:24.584 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:05:24.585 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 -- 172.21.15.1:0/536420837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 msgr2=0x7f03e41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 --2- 172.21.15.1:0/536420837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 0x7f03e41029b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009900 tx=0x7f03d802a480 comp rx=0 tx=0).stop 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 -- 172.21.15.1:0/536420837 shutdown_connections 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 --2- 172.21.15.1:0/536420837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e4102ef0 0x7f03e410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 --2- 172.21.15.1:0/536420837 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 0x7f03e41029b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 --2- 172.21.15.1:0/536420837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03e4100e20 0x7f03e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 -- 172.21.15.1:0/536420837 >> 172.21.15.1:0/536420837 conn(0x7f03e40fc7d0 msgr2=0x7f03e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 -- 172.21.15.1:0/536420837 shutdown_connections 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.706+0000 7f03e9e29640 1 -- 172.21.15.1:0/536420837 wait complete. 2024-09-19T09:05:24.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.707+0000 7f03e9e29640 1 Processor -- start 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.707+0000 7f03e9e29640 1 -- start start 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e9e29640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03e4100e20 0x7f03e41974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e9e29640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 0x7f03e41979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e9e29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e4102ef0 0x7f03e419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e9e29640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41110a0 con 0x7f03e4102570 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e9e29640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f03e4110f20 con 0x7f03e4102ef0 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e9e29640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f03e4111220 con 0x7f03e4100e20 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 0x7f03e41979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 0x7f03e41979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36514/0 (socket says 172.21.15.1:36514) 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e2ffd640 1 -- 172.21.15.1:0/3474433300 learned_addr learned my addr 172.21.15.1:0/3474433300 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e3fff640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e4102ef0 0x7f03e419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e37fe640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03e4100e20 0x7f03e41974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e2ffd640 1 -- 172.21.15.1:0/3474433300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03e4100e20 msgr2=0x7f03e41974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e2ffd640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03e4100e20 0x7f03e41974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e2ffd640 1 -- 172.21.15.1:0/3474433300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e4102ef0 msgr2=0x7f03e419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e2ffd640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e4102ef0 0x7f03e419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.708+0000 7f03e2ffd640 1 -- 172.21.15.1:0/3474433300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e419c450 con 0x7f03e4102570 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.709+0000 7f03e2ffd640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 0x7f03e41979e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006010 tx=0x7f03d8004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.709+0000 7f03e0ff9640 1 -- 172.21.15.1:0/3474433300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8046070 con 0x7f03e4102570 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.709+0000 7f03e0ff9640 1 -- 172.21.15.1:0/3474433300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03d8005000 con 0x7f03e4102570 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.709+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e419c6e0 con 0x7f03e4102570 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.709+0000 7f03e0ff9640 1 -- 172.21.15.1:0/3474433300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8035050 con 0x7f03e4102570 2024-09-19T09:05:24.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.709+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e4069f70 con 0x7f03e4102570 2024-09-19T09:05:24.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.710+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e41021b0 con 0x7f03e4102570 2024-09-19T09:05:24.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.711+0000 7f03e0ff9640 1 -- 172.21.15.1:0/3474433300 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f03d8049070 con 0x7f03e4102570 2024-09-19T09:05:24.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.712+0000 7f03e0ff9640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f03cc0a3240 0x7f03cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.712+0000 7f03e0ff9640 1 -- 172.21.15.1:0/3474433300 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f03d80f17e0 con 0x7f03e4102570 2024-09-19T09:05:24.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.712+0000 7f03e37fe640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f03cc0a3240 0x7f03cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.712+0000 7f03e37fe640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f03cc0a3240 0x7f03cc0a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f03d4005fd0 tx=0x7f03d4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.720+0000 7f03e0ff9640 1 -- 172.21.15.1:0/3474433300 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03d8050080 con 0x7f03e4102570 2024-09-19T09:05:24.852 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:24.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.947+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03e4198800 con 0x7f03e4102570 2024-09-19T09:05:24.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.948+0000 7f03e0ff9640 1 -- 172.21.15.1:0/3474433300 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f03d80be4e0 con 0x7f03e4102570 2024-09-19T09:05:24.948 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:05:24.948 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:05:24.948 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:05:24.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f03cc0a3240 msgr2=0x7f03cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f03cc0a3240 0x7f03cc0a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f03d4005fd0 tx=0x7f03d4005850 comp rx=0 tx=0).stop 2024-09-19T09:05:24.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 msgr2=0x7f03e41979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 0x7f03e41979e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006010 tx=0x7f03d8004b80 comp rx=0 tx=0).stop 2024-09-19T09:05:24.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 shutdown_connections 2024-09-19T09:05:24.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e4102ef0 0x7f03e419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03e4102570 0x7f03e41979e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f03cc0a3240 0x7f03cc0a5700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 --2- 172.21.15.1:0/3474433300 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03e4100e20 0x7f03e41974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 >> 172.21.15.1:0/3474433300 conn(0x7f03e40fc7d0 msgr2=0x7f03e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 shutdown_connections 2024-09-19T09:05:24.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:24.950+0000 7f03e9e29640 1 -- 172.21.15.1:0/3474433300 wait complete. 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 -- 172.21.15.1:0/2685593923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4410c1a0 msgr2=0x7f5e4410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 --2- 172.21.15.1:0/2685593923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4410c1a0 0x7f5e4410e610 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009ca0 tx=0x7f5e3c02a950 comp rx=0 tx=0).stop 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 -- 172.21.15.1:0/2685593923 shutdown_connections 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 --2- 172.21.15.1:0/2685593923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e4410c1a0 0x7f5e4410e610 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 --2- 172.21.15.1:0/2685593923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e44103720 0x7f5e4410bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 --2- 172.21.15.1:0/2685593923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e44102e00 0x7f5e441031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 -- 172.21.15.1:0/2685593923 >> 172.21.15.1:0/2685593923 conn(0x7f5e440fc7a0 msgr2=0x7f5e440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 -- 172.21.15.1:0/2685593923 shutdown_connections 2024-09-19T09:05:25.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.674+0000 7f5e4911b640 1 -- 172.21.15.1:0/2685593923 wait complete. 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e4911b640 1 Processor -- start 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e4911b640 1 -- start start 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e4911b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e44102e00 0x7f5e44100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e4911b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e44103720 0x7f5e44100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e4911b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4410c1a0 0x7f5e441014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e4911b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e44112070 con 0x7f5e44103720 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e4911b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e44111ef0 con 0x7f5e4410c1a0 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e4911b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e441121f0 con 0x7f5e44102e00 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e44103720 0x7f5e44100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e44103720 0x7f5e44100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36536/0 (socket says 172.21.15.1:36536) 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.675+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1921920017 learned_addr learned my addr 172.21.15.1:0/1921920017 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:25.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e44102e00 0x7f5e44100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1921920017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e44102e00 msgr2=0x7f5e44100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4410c1a0 0x7f5e441014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e44102e00 0x7f5e44100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1921920017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4410c1a0 msgr2=0x7f5e441014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4410c1a0 0x7f5e441014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1921920017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e441a6850 con 0x7f5e44103720 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4410c1a0 0x7f5e441014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e44103720 0x7f5e44100fa0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c920 tx=0x7f5e2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e40d99640 1 -- 172.21.15.1:0/1921920017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c007c70 con 0x7f5e44103720 2024-09-19T09:05:25.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e40d99640 1 -- 172.21.15.1:0/1921920017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e2c007e10 con 0x7f5e44103720 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e4911b640 1 -- 172.21.15.1:0/1921920017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e441a6b40 con 0x7f5e44103720 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e40d99640 1 -- 172.21.15.1:0/1921920017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c018940 con 0x7f5e44103720 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.676+0000 7f5e4911b640 1 -- 172.21.15.1:0/1921920017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e441a70d0 con 0x7f5e44103720 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.678+0000 7f5e40d99640 1 -- 172.21.15.1:0/1921920017 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f5e2c018b20 con 0x7f5e44103720 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4b4f4740 1 Processor -- start 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4b4f4740 1 -- start start 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426bf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55994261a280 con 0x5599426bfd40 2024-09-19T09:05:25.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5599425c1b10 con 0x5599426b5480 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559942616240 con 0x5599426b4b60 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e40d99640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e300a32c0 0x7f5e300a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e42d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e4359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36546/0 (socket says 172.21.15.1:36546) 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.679+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1538575099 learned_addr learned my addr 172.21.15.1:0/1538575099 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e40d99640 1 -- 172.21.15.1:0/1921920017 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5e2c0cfa70 con 0x7f5e44103720 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e42d9d640 1 -- 172.21.15.1:0/1538575099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 msgr2=0x5599426b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1538575099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e300a32c0 0x7f5e300a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e42d9d640 1 -- 172.21.15.1:0/1538575099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 msgr2=0x5599426c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:25.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1538575099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e42d9d640 1 -- 172.21.15.1:0/1538575099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599425ce1f0 con 0x5599426b5480 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1538575099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426bf800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400cba0 tx=0x7f5e3400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b007dab4e73d5e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e300a32c0 0x7f5e300a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c030040 tx=0x7f5e3c02a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e397fa640 1 -- 172.21.15.1:0/1538575099 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34004220 con 0x5599426b5480 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e397fa640 1 -- 172.21.15.1:0/1538575099 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e340043c0 con 0x5599426b5480 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.680+0000 7f5e397fa640 1 -- 172.21.15.1:0/1538575099 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e340035f0 con 0x5599426b5480 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1538575099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 msgr2=0x5599426bf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1538575099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426bf800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400cba0 tx=0x7f5e3400e720 comp rx=0 tx=0).stop 2024-09-19T09:05:25.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1538575099 shutdown_connections 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1538575099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1538575099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426bf800 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1538575099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1538575099 >> 172.21.15.1:0/1538575099 conn(0x5599426b10f0 msgr2=0x5599426b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1538575099 shutdown_connections 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1538575099 wait complete. 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.681+0000 7f5e4b4f4740 1 -- start start 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4b4f4740 1 Processor -- start 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426bf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426bfd40 0x5599426bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5599426c2910 con 0x5599426b5480 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5599425d4f10 con 0x5599426bfd40 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5599426c2a90 con 0x5599426b4b60 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4b4f4740 10 client.0 _ll_register_callbacks cb 0x55994259da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36554/0 (socket says 172.21.15.1:36554) 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1862981183 learned_addr learned my addr 172.21.15.1:0/1862981183 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426bf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426bfd40 0x5599426bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1862981183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 msgr2=0x5599426bf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426bf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426bfd40 msgr2=0x5599426bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426bfd40 0x5599426bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 -- 172.21.15.1:0/1862981183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55994238b6a0 con 0x5599426b5480 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426bf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426bfd40 0x5599426bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bcb00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0cfd10 tx=0x7f5e2c09bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b39795627ba89a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.682+0000 7f5e2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1862981183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0cfe60 con 0x5599426b5480 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1862981183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5e2c00fbe0 con 0x5599426b5480 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1862981183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e340043c0 con 0x5599426b5480 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1862981183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5e2c09c010 con 0x5599426b5480 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 10 client.15753 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1862981183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5599426ce510 con 0x5599426b5480 2024-09-19T09:05:25.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1862981183 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e340043c0 con 0x5599426b5480 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1862981183 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5e2c09b460 con 0x5599426b5480 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 10 client.15753 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 20 client.15753 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599426cf9d0 0x5599426d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 4 client.15753 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.683+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1862981183 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599426277f0 con 0x5599426cf9d0 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.684+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599426cf9d0 0x5599426d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.684+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599426cf9d0 0x5599426d1dc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abef5da5301ebb0 server_cookie=17b95bbab587ddf in_seq=0 out_seq=0 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.684+0000 7f5e2a7fc640 10 client.15753 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1862981183 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599426277f0 con 0x5599426cf9d0 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e2a7fc640 10 client.15753 handle_command_reply: tid=0 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 client.15753 shutdown 2024-09-19T09:05:25.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1862981183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 msgr2=0x5599426bcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bcb00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0cfd10 tx=0x7f5e2c09bc10 comp rx=0 tx=0).stop 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1862981183 shutdown_connections 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599426cf9d0 0x5599426d1dc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426bfd40 0x5599426bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bcb00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1862981183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426bf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1862981183 >> 172.21.15.1:0/1862981183 conn(0x5599426b10f0 msgr2=0x5599426b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e2a7fc640 0 client.15753 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1862981183 shutdown_connections 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1862981183 wait complete. 2024-09-19T09:05:25.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.685+0000 7f5e4b4f4740 20 client.15753 trim_cache size 0 max 16384 2024-09-19T09:05:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.702+0000 7f5e4b4f4740 1 Processor -- start 2024-09-19T09:05:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.702+0000 7f5e4b4f4740 1 -- start start 2024-09-19T09:05:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b4b60 0x5599426cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426bfd40 0x5599426d7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e441b2030 con 0x5599426b5480 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e441af900 con 0x5599426b4b60 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e441ad750 con 0x5599426bfd40 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36564/0 (socket says 172.21.15.1:36564) 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 -- 172.21.15.1:0/3152389895 learned_addr learned my addr 172.21.15.1:0/3152389895 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e4359e640 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426bfd40 0x5599426d7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b4b60 0x5599426cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 -- 172.21.15.1:0/3152389895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426bfd40 msgr2=0x5599426d7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426bfd40 0x5599426d7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 -- 172.21.15.1:0/3152389895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b4b60 msgr2=0x5599426cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:25.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b4b60 0x5599426cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 -- 172.21.15.1:0/3152389895 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599426b0f20 con 0x5599426b5480 2024-09-19T09:05:25.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e4359e640 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426bfd40 0x5599426d7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:25.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.703+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bbae0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c09b900 tx=0x7f5e2c09bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15708e254b469efc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e38ff9640 1 -- 172.21.15.1:0/3152389895 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0a4c80 con 0x5599426b5480 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e38ff9640 1 -- 172.21.15.1:0/3152389895 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e2c018e10 con 0x5599426b5480 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e38ff9640 1 -- 172.21.15.1:0/3152389895 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0a47f0 con 0x5599426b5480 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/3152389895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 msgr2=0x5599426bbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bbae0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c09b900 tx=0x7f5e2c09bc80 comp rx=0 tx=0).stop 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/3152389895 shutdown_connections 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426bfd40 0x5599426d7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426b5480 0x5599426bbae0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/3152389895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b4b60 0x5599426cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/3152389895 >> 172.21.15.1:0/3152389895 conn(0x5599426b10f0 msgr2=0x5599426bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:25.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/3152389895 shutdown_connections 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.704+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/3152389895 wait complete. 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 1 -- start start 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 1 Processor -- start 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426b9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e441addc0 con 0x5599426bfd40 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e441af230 con 0x5599426b5480 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e441ae490 con 0x5599426b4b60 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4b4f4740 10 client.0 _ll_register_callbacks cb 0x7f5e2c09be90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426b9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426b9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36568/0 (socket says 172.21.15.1:36568) 2024-09-19T09:05:25.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e4359e640 1 -- 172.21.15.1:0/1684982940 learned_addr learned my addr 172.21.15.1:0/1684982940 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.705+0000 7f5e3bfff640 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426b97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4359e640 1 -- 172.21.15.1:0/1684982940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 msgr2=0x5599426c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4359e640 1 -- 172.21.15.1:0/1684982940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 msgr2=0x5599426b97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426b97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4359e640 1 -- 172.21.15.1:0/1684982940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599426ba500 con 0x5599426bfd40 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4359e640 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426b9d20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c003c20 tx=0x7f5e3c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455e7b00e6421d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1684982940 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c034040 con 0x5599426bfd40 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1684982940 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5e3c0047c0 con 0x5599426bfd40 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1684982940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e2c018e10 con 0x5599426bfd40 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1684982940 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5e3c05a070 con 0x5599426bfd40 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4b4f4740 10 client.15759 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:25.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.706+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1684982940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55994273a660 con 0x5599426bfd40 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1684982940 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e2c018e10 con 0x5599426bfd40 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1684982940 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5e3c04b5f0 con 0x5599426bfd40 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e4b4f4740 10 client.15759 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e4b4f4740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e4b4f4740 20 client.15759 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55994273ad00 0x55994273d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e4b4f4740 4 client.15759 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1684982940 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559942621d00 con 0x55994273ad00 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.707+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55994273ad00 0x55994273d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.708+0000 7f5e42d9d640 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55994273ad00 0x55994273d120 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=605d581d9f143c1e server_cookie=54df0d572c4ebdcd in_seq=0 out_seq=0 2024-09-19T09:05:25.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.708+0000 7f5e2a7fc640 10 client.15759 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:25.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.708+0000 7f5e2a7fc640 1 -- 172.21.15.1:0/1684982940 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559942621d00 con 0x55994273ad00 2024-09-19T09:05:25.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.708+0000 7f5e2a7fc640 10 client.15759 handle_command_reply: tid=0 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 client.15759 shutdown 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1684982940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 msgr2=0x5599426b9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426b9d20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c003c20 tx=0x7f5e3c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1684982940 shutdown_connections 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55994273ad00 0x55994273d120 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599426bfd40 0x5599426b9d20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599426b5480 0x5599426b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e2a7fc640 0 client.15759 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 --2- 172.21.15.1:0/1684982940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599426b4b60 0x5599426c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1684982940 >> 172.21.15.1:0/1684982940 conn(0x5599426b10f0 msgr2=0x5599426bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1684982940 shutdown_connections 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 1 -- 172.21.15.1:0/1684982940 wait complete. 2024-09-19T09:05:25.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.709+0000 7f5e4b4f4740 20 client.15759 trim_cache size 0 max 16384 2024-09-19T09:05:25.714 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:25.714 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:05:25.714 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "b9ae95a9-8317-4156-9941-e0a792fc80c5", 2024-09-19T09:05:25.714 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:05:25.714 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 -- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e300a32c0 msgr2=0x7f5e300a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e300a32c0 0x7f5e300a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c030040 tx=0x7f5e3c02a950 comp rx=0 tx=0).stop 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 -- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e44103720 msgr2=0x7f5e44100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e44103720 0x7f5e44100fa0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00c920 tx=0x7f5e2c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 -- 172.21.15.1:0/1921920017 shutdown_connections 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4410c1a0 0x7f5e441014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e44103720 0x7f5e44100fa0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f5e300a32c0 0x7f5e300a5780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 --2- 172.21.15.1:0/1921920017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e44102e00 0x7f5e44100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 -- 172.21.15.1:0/1921920017 >> 172.21.15.1:0/1921920017 conn(0x7f5e440fc7a0 msgr2=0x7f5e440fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 -- 172.21.15.1:0/1921920017 shutdown_connections 2024-09-19T09:05:25.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:25.710+0000 7f5e4911b640 1 -- 172.21.15.1:0/1921920017 wait complete. 2024-09-19T09:05:26.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:25 smithi001 ceph-mon[30939]: pgmap v377: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T09:05:26.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:25 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3474433300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:26.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:25 smithi064 ceph-mon[35179]: pgmap v377: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T09:05:26.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:25 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3474433300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:26.167 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db --set-id eb1622fb --release --await' 2024-09-19T09:05:26.167 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db --set-id eb1622fb --release --await 2024-09-19T09:05:26.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:25 smithi022 ceph-mon[35107]: pgmap v377: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T09:05:26.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:25 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3474433300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:26.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:05:26.858 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:27.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:26 smithi001 ceph-mon[30939]: scrub queued for path: / 2024-09-19T09:05:27.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:26 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:27.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:26 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:05:27.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:26 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:27.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:26 smithi064 ceph-mon[35179]: scrub queued for path: / 2024-09-19T09:05:27.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:26 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:27.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:26 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:05:27.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:26 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:27.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:26 smithi022 ceph-mon[35107]: scrub queued for path: / 2024-09-19T09:05:27.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:26 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:27.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:26 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:05:27.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:26 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/466580331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4101df0 msgr2=0x7f7cd41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/466580331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4101df0 0x7f7cd41021d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4009900 tx=0x7f7cc402a410 comp rx=0 tx=0).stop 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/466580331 shutdown_connections 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/466580331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd4106f20 0x7f7cd410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/466580331 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cd41027a0 0x7f7cd41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/466580331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4101df0 0x7f7cd41021d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/466580331 >> 172.21.15.1:0/466580331 conn(0x7f7cd40fd8b0 msgr2=0x7f7cd40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/466580331 shutdown_connections 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/466580331 wait complete. 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.328+0000 7f7cd9c5d640 1 Processor -- start 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd9c5d640 1 -- start start 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd9c5d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd4101df0 0x7f7cd419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd9c5d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cd41027a0 0x7f7cd419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd9c5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4106f20 0x7f7cd419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd9c5d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd41120a0 con 0x7f7cd4106f20 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd9c5d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd4111f20 con 0x7f7cd4101df0 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd9c5d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd4112220 con 0x7f7cd41027a0 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4106f20 0x7f7cd419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4106f20 0x7f7cd419eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36588/0 (socket says 172.21.15.1:36588) 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd3fff640 1 -- 172.21.15.1:0/1673033717 learned_addr learned my addr 172.21.15.1:0/1673033717 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd4101df0 0x7f7cd419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cd41027a0 0x7f7cd419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd3fff640 1 -- 172.21.15.1:0/1673033717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cd41027a0 msgr2=0x7f7cd419ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd3fff640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cd41027a0 0x7f7cd419ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd3fff640 1 -- 172.21.15.1:0/1673033717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd4101df0 msgr2=0x7f7cd419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd3fff640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd4101df0 0x7f7cd419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.329+0000 7f7cd3fff640 1 -- 172.21.15.1:0/1673033717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd419f6d0 con 0x7f7cd4106f20 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.330+0000 7f7cd3fff640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4106f20 0x7f7cd419eff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00eb10 tx=0x7f7ccc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.330+0000 7f7cd0ff9640 1 -- 172.21.15.1:0/1673033717 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc004b20 con 0x7f7cd4106f20 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.330+0000 7f7cd0ff9640 1 -- 172.21.15.1:0/1673033717 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ccc004cc0 con 0x7f7cd4106f20 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.330+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/1673033717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd419f9c0 con 0x7f7cd4106f20 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.330+0000 7f7cd0ff9640 1 -- 172.21.15.1:0/1673033717 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0107f0 con 0x7f7cd4106f20 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.330+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/1673033717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd41a72a0 con 0x7f7cd4106f20 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.332+0000 7f7cd0ff9640 1 -- 172.21.15.1:0/1673033717 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f7ccc005020 con 0x7f7cd4106f20 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.332+0000 7f7cdc036740 1 Processor -- start 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cdc036740 1 -- start start 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 0x5596b27c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27cb240 0x5596b27cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cdc036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5596b2725620 con 0x5596b27cb240 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cdc036740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596b26cce50 con 0x5596b27c0980 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cdc036740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5596b27215e0 con 0x5596b27c0060 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27cb240 0x5596b27cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27cb240 0x5596b27cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36594/0 (socket says 172.21.15.1:36594) 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd2ffd640 1 -- 172.21.15.1:0/645593419 learned_addr learned my addr 172.21.15.1:0/645593419 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd0ff9640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7cbc0a3240 0x7f7cbc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd3fff640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7cbc0a3240 0x7f7cbc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/645593419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 0x5596b27c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd0ff9640 1 -- 172.21.15.1:0/1673033717 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f7ccc0cff10 con 0x7f7cd4106f20 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd37fe640 1 -- 172.21.15.1:0/645593419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 msgr2=0x5596b27c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/645593419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 0x5596b27c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd37fe640 1 -- 172.21.15.1:0/645593419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27cb240 msgr2=0x5596b27cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/645593419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27cb240 0x5596b27cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.333+0000 7f7cd37fe640 1 -- 172.21.15.1:0/645593419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b26bdd40 con 0x5596b27c0980 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.334+0000 7f7cd3fff640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7cbc0a3240 0x7f7cbc0a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc09c210 tx=0x7f7ccc066ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.334+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/645593419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27cad00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4005940 tx=0x7f7cc4005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bdcd11f8cd9fd06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.334+0000 7f7cb9ffb640 1 -- 172.21.15.1:0/645593419 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4040070 con 0x5596b27c0980 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.334+0000 7f7cb9ffb640 1 -- 172.21.15.1:0/645593419 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7cc4031980 con 0x5596b27c0980 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.334+0000 7f7cb9ffb640 1 -- 172.21.15.1:0/645593419 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4035040 con 0x5596b27c0980 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 -- 172.21.15.1:0/645593419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 msgr2=0x5596b27cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 --2- 172.21.15.1:0/645593419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27cad00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4005940 tx=0x7f7cc4005c00 comp rx=0 tx=0).stop 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 -- 172.21.15.1:0/645593419 shutdown_connections 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 --2- 172.21.15.1:0/645593419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27cb240 0x5596b27cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 --2- 172.21.15.1:0/645593419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27cad00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 --2- 172.21.15.1:0/645593419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 0x5596b27c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 -- 172.21.15.1:0/645593419 >> 172.21.15.1:0/645593419 conn(0x5596b27bc5f0 msgr2=0x5596b27bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 -- 172.21.15.1:0/645593419 shutdown_connections 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 -- 172.21.15.1:0/645593419 wait complete. 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 -- start start 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.335+0000 7f7cdc036740 1 Processor -- start 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0060 0x5596b27c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cdc036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5596b27cde10 con 0x5596b27c0060 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cdc036740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596b26adf10 con 0x5596b27c0980 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cdc036740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5596b27cdf90 con 0x5596b27cb240 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cdc036740 10 client.0 _ll_register_callbacks cb 0x5596b26d1db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0060 0x5596b27c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0060 0x5596b27c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36608/0 (socket says 172.21.15.1:36608) 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 -- 172.21.15.1:0/3419784991 learned_addr learned my addr 172.21.15.1:0/3419784991 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 -- 172.21.15.1:0/3419784991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 msgr2=0x5596b27c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 -- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 msgr2=0x5596b27c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 -- 172.21.15.1:0/3419784991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b2434580 con 0x5596b27c0060 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0060 0x5596b27c8120 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8012d60 tx=0x7f7cc800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e994115149ad3624 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/3419784991 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc801c040 con 0x5596b27c0060 2024-09-19T09:05:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/3419784991 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f7cc800f680 con 0x5596b27c0060 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.336+0000 7f7cdc036740 1 -- 172.21.15.1:0/3419784991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cc4031980 con 0x5596b27c0060 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/3419784991 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7cc8028050 con 0x5596b27c0060 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cdc036740 10 client.15771 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cdc036740 1 -- 172.21.15.1:0/3419784991 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5596b24fe960 con 0x5596b27c0060 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/3419784991 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7cc4031980 con 0x5596b27c0060 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/3419784991 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7cc800e930 con 0x5596b27c0060 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cdc036740 10 client.15771 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cdc036740 10 client.15771 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cdc036740 20 client.15771 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5596b27dad60 0x5596b27dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cdc036740 4 client.15771 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cdc036740 1 -- 172.21.15.1:0/3419784991 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596b2732b90 con 0x5596b27dad60 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.337+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5596b27dad60 0x5596b27dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.338+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5596b27dad60 0x5596b27dd1e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=907b0fadbc9ab065 server_cookie=f8ca2fed60fc347c in_seq=0 out_seq=0 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.338+0000 7f7cb2ffd640 10 client.15771 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.338+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/3419784991 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596b2732b90 con 0x5596b27dad60 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.338+0000 7f7cb2ffd640 10 client.15771 handle_command_reply: tid=0 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.338+0000 7f7cdc036740 1 client.15771 shutdown 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 -- 172.21.15.1:0/3419784991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0060 msgr2=0x5596b27c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0060 0x5596b27c8120 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8012d60 tx=0x7f7cc800c930 comp rx=0 tx=0).stop 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 -- 172.21.15.1:0/3419784991 shutdown_connections 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5596b27dad60 0x5596b27dd1e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cb2ffd640 0 client.15771 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0980 0x5596b27c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3419784991 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0060 0x5596b27c8120 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 -- 172.21.15.1:0/3419784991 >> 172.21.15.1:0/3419784991 conn(0x5596b27bc5f0 msgr2=0x5596b27c22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 -- 172.21.15.1:0/3419784991 shutdown_connections 2024-09-19T09:05:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 1 -- 172.21.15.1:0/3419784991 wait complete. 2024-09-19T09:05:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.339+0000 7f7cdc036740 20 client.15771 trim_cache size 0 max 16384 2024-09-19T09:05:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cdc036740 1 Processor -- start 2024-09-19T09:05:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cdc036740 1 -- start start 2024-09-19T09:05:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0060 0x5596b27c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27bb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cdc036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd41b2200 con 0x5596b27c0980 2024-09-19T09:05:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cdc036740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd41afad0 con 0x5596b27c0060 2024-09-19T09:05:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cdc036740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd41ad920 con 0x5596b27cb240 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cd37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cd37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27bb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36614/0 (socket says 172.21.15.1:36614) 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cd37fe640 1 -- 172.21.15.1:0/3496562891 learned_addr learned my addr 172.21.15.1:0/3496562891 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0060 0x5596b27c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.357+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cd37fe640 1 -- 172.21.15.1:0/3496562891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 msgr2=0x5596b27e2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27e2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cd37fe640 1 -- 172.21.15.1:0/3496562891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0060 msgr2=0x5596b27c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0060 0x5596b27c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cd37fe640 1 -- 172.21.15.1:0/3496562891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596b27b7910 con 0x5596b27c0980 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27bb640 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4005dc0 tx=0x7f7cc4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c549a468b66e5a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cb97fa640 1 -- 172.21.15.1:0/3496562891 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4040050 con 0x5596b27c0980 2024-09-19T09:05:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cb97fa640 1 -- 172.21.15.1:0/3496562891 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7cc4005320 con 0x5596b27c0980 2024-09-19T09:05:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.358+0000 7f7cb97fa640 1 -- 172.21.15.1:0/3496562891 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4035040 con 0x5596b27c0980 2024-09-19T09:05:27.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 -- 172.21.15.1:0/3496562891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 msgr2=0x5596b27bb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27bb640 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4005dc0 tx=0x7f7cc4005fd0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 -- 172.21.15.1:0/3496562891 shutdown_connections 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27cb240 0x5596b27e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27bb640 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 --2- 172.21.15.1:0/3496562891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27c0060 0x5596b27c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 -- 172.21.15.1:0/3496562891 >> 172.21.15.1:0/3496562891 conn(0x5596b27bc5f0 msgr2=0x5596b27baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 -- 172.21.15.1:0/3496562891 shutdown_connections 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 -- 172.21.15.1:0/3496562891 wait complete. 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.359+0000 7f7cdc036740 1 -- start start 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cdc036740 1 Processor -- start 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 0x5596b27cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cdc036740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27cb240 0x5596b283eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cdc036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd41adf90 con 0x5596b27c0980 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cdc036740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd41af400 con 0x5596b27cb240 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cdc036740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd41ae660 con 0x5596b27c0060 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cdc036740 10 client.0 _ll_register_callbacks cb 0x7f7cc8012810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cd37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cd37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36630/0 (socket says 172.21.15.1:36630) 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cd37fe640 1 -- 172.21.15.1:0/1636356736 learned_addr learned my addr 172.21.15.1:0/1636356736 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 0x5596b27cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.360+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27cb240 0x5596b283eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cd37fe640 1 -- 172.21.15.1:0/1636356736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 msgr2=0x5596b27cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 0x5596b27cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cd37fe640 1 -- 172.21.15.1:0/1636356736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27cb240 msgr2=0x5596b283eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27cb240 0x5596b283eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cd37fe640 1 -- 172.21.15.1:0/1636356736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596b283f100 con 0x5596b27c0980 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cd37fe640 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27cfd50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7cc402a930 tx=0x7f7cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1751612ce2407794 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/1636356736 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc405d060 con 0x5596b27c0980 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/1636356736 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f7cc4004030 con 0x5596b27c0980 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cdc036740 1 -- 172.21.15.1:0/1636356736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cc4005320 con 0x5596b27c0980 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.361+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/1636356736 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7cc4035040 con 0x5596b27c0980 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cdc036740 10 client.15777 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cdc036740 1 -- 172.21.15.1:0/1636356736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5596b2846490 con 0x5596b27c0980 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/1636356736 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7cc4005320 con 0x5596b27c0980 2024-09-19T09:05:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/1636356736 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7cc40035f0 con 0x5596b27c0980 2024-09-19T09:05:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cdc036740 10 client.15777 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cdc036740 10 client.15777 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:05:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cdc036740 20 client.15777 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cdc036740 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5596b2846760 0x5596b2848b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cdc036740 4 client.15777 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "eb1622fb", "release": true, "await": true}] 2024-09-19T09:05:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cdc036740 1 -- 172.21.15.1:0/1636356736 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "set_id": "eb1622fb", "release": true, "await": true}) -- 0x5596b272d0a0 con 0x5596b2846760 2024-09-19T09:05:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.362+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5596b2846760 0x5596b2848b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.363+0000 7f7cd2ffd640 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5596b2846760 0x5596b2848b50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5948e1921a804c62 server_cookie=de4b8df1eb7d5276 in_seq=0 out_seq=0 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.363+0000 7f7cb2ffd640 10 client.15777 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.365+0000 7f7cb2ffd640 1 -- 172.21.15.1:0/1636356736 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5596b272d0a0 con 0x5596b2846760 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cb2ffd640 10 client.15777 handle_command_reply: tid=0 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 client.15777 shutdown 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 -- 172.21.15.1:0/1636356736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 msgr2=0x5596b27cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27cfd50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7cc402a930 tx=0x7f7cc40046c0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 -- 172.21.15.1:0/1636356736 shutdown_connections 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5596b2846760 0x5596b2848b50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596b27cb240 0x5596b283eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5596b27c0980 0x5596b27cfd50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 --2- 172.21.15.1:0/1636356736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5596b27c0060 0x5596b27cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 -- 172.21.15.1:0/1636356736 >> 172.21.15.1:0/1636356736 conn(0x5596b27bc5f0 msgr2=0x5596b27bb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cb2ffd640 0 client.15777 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 -- 172.21.15.1:0/1636356736 shutdown_connections 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 1 -- 172.21.15.1:0/1636356736 wait complete. 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.366+0000 7f7cdc036740 20 client.15777 trim_cache size 0 max 16384 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 24, 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 8, 2024-09-19T09:05:27.369 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "eb1622fb": { 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 8, 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:05:27.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:05:27.371 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:05:27.371 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:27.371 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:27.371 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:27.371 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:27.371 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:27.371 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7cbc0a3240 msgr2=0x7f7cbc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7cbc0a3240 0x7f7cbc0a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc09c210 tx=0x7f7ccc066ea0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4106f20 msgr2=0x7f7cd419eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4106f20 0x7f7cd419eff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00eb10 tx=0x7f7ccc00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/1673033717 shutdown_connections 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7cd4106f20 0x7f7cd419eff0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f7cbc0a3240 0x7f7cbc0a5700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cd41027a0 0x7f7cd419ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 --2- 172.21.15.1:0/1673033717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd4101df0 0x7f7cd419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.367+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/1673033717 >> 172.21.15.1:0/1673033717 conn(0x7f7cd40fd8b0 msgr2=0x7f7cd40feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.368+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/1673033717 shutdown_connections 2024-09-19T09:05:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:27.368+0000 7f7cd9c5d640 1 -- 172.21.15.1:0/1673033717 wait complete. 2024-09-19T09:05:27.373 INFO:tasks.workunit.client.0.smithi001.stderr:+ KERNEL=linux-4.0.5 2024-09-19T09:05:27.373 INFO:tasks.workunit.client.0.smithi001.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-19T09:05:27.382 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:27.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:27 smithi001 ceph-mon[30939]: pgmap v378: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-19T09:05:27.994 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:27 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:05:28.024 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'eb1622fb', total seconds elapsed: 24.5 2024-09-19T09:05:28.024 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:05:28.025 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:28.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:27 smithi064 ceph-mon[35179]: pgmap v378: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-19T09:05:28.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:27 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:05:28.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:27 smithi022 ceph-mon[35107]: pgmap v378: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-19T09:05:28.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:27 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 -- 172.21.15.1:0/3001456531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 msgr2=0x7f90bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/3001456531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 0x7f90bc10ea90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009ca0 tx=0x7f90b402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 -- 172.21.15.1:0/3001456531 shutdown_connections 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/3001456531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 0x7f90bc10ea90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/3001456531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90bc102790 0x7f90bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/3001456531 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90bc101de0 0x7f90bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 -- 172.21.15.1:0/3001456531 >> 172.21.15.1:0/3001456531 conn(0x7f90bc0fd8e0 msgr2=0x7f90bc0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 -- 172.21.15.1:0/3001456531 shutdown_connections 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.538+0000 7f90c1a2d640 1 -- 172.21.15.1:0/3001456531 wait complete. 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.539+0000 7f90c1a2d640 1 Processor -- start 2024-09-19T09:05:28.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.539+0000 7f90c1a2d640 1 -- start start 2024-09-19T09:05:28.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90c1a2d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90bc101de0 0x7f90bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90c1a2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90bc102790 0x7f90bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90c1a2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 0x7f90bc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90c1a2d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc112120 con 0x7f90bc106f10 2024-09-19T09:05:28.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90c1a2d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc111fa0 con 0x7f90bc102790 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90c1a2d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1122a0 con 0x7f90bc101de0 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90bb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 0x7f90bc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90bb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 0x7f90bc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36646/0 (socket says 172.21.15.1:36646) 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90bb7fe640 1 -- 172.21.15.1:0/1823177522 learned_addr learned my addr 172.21.15.1:0/1823177522 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90baffd640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90bc101de0 0x7f90bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.540+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90bc102790 0x7f90bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90bb7fe640 1 -- 172.21.15.1:0/1823177522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90bc101de0 msgr2=0x7f90bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90bc101de0 0x7f90bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90bb7fe640 1 -- 172.21.15.1:0/1823177522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90bc102790 msgr2=0x7f90bc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90bc102790 0x7f90bc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90bb7fe640 1 -- 172.21.15.1:0/1823177522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc1aae30 con 0x7f90bc106f10 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90bc102790 0x7f90bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:28.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 0x7f90bc074f70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f90b4003f40 tx=0x7f90b4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:28.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90c0a2b640 1 -- 172.21.15.1:0/1823177522 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4031800 con 0x7f90bc106f10 2024-09-19T09:05:28.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90c0a2b640 1 -- 172.21.15.1:0/1823177522 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90b40319a0 con 0x7f90bc106f10 2024-09-19T09:05:28.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90c1a2d640 1 -- 172.21.15.1:0/1823177522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90bc1ab060 con 0x7f90bc106f10 2024-09-19T09:05:28.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90c0a2b640 1 -- 172.21.15.1:0/1823177522 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b402fe00 con 0x7f90bc106f10 2024-09-19T09:05:28.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.541+0000 7f90c1a2d640 1 -- 172.21.15.1:0/1823177522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90bc1ab5f0 con 0x7f90bc106f10 2024-09-19T09:05:28.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c3e06740 1 Processor -- start 2024-09-19T09:05:28.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c0a2b640 1 -- 172.21.15.1:0/1823177522 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f90b4004040 con 0x7f90bc106f10 2024-09-19T09:05:28.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c3e06740 1 -- start start 2024-09-19T09:05:28.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b1d4a0 0x557a40b1d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b28140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b28680 0x557a40b2aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c3e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557a40a832e0 con 0x557a40b1ddc0 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c3e06740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a40a2ace0 con 0x557a40b28680 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.544+0000 7f90c3e06740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557a40a7f2a0 con 0x557a40b1d4a0 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b28140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b28140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36658/0 (socket says 172.21.15.1:36658) 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 -- 172.21.15.1:0/853227103 learned_addr learned my addr 172.21.15.1:0/853227103 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90b27fc640 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b28680 0x557a40b2aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90b27fc640 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b1d4a0 0x557a40b1d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 -- 172.21.15.1:0/853227103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b1d4a0 msgr2=0x557a40b1d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b1d4a0 0x557a40b1d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 -- 172.21.15.1:0/853227103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b28680 msgr2=0x557a40b2aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b28680 0x557a40b2aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90c0a2b640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90a80a32c0 0x7f90a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 -- 172.21.15.1:0/853227103 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a40a0f440 con 0x557a40b1ddc0 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90a80a32c0 0x7f90a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90baffd640 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b28140 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00ad00 tx=0x7f90ac00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1667ddcf20876378 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.545+0000 7f90c0a2b640 1 -- 172.21.15.1:0/1823177522 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f90b40f0f30 con 0x7f90bc106f10 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.546+0000 7f90b1ffb640 1 -- 172.21.15.1:0/853227103 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac01d070 con 0x557a40b1ddc0 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.546+0000 7f90b1ffb640 1 -- 172.21.15.1:0/853227103 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90ac018b40 con 0x557a40b1ddc0 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.546+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90a80a32c0 0x7f90a80a5780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x557a40b1adb0 tx=0x7f90a400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:28.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.546+0000 7f90b1ffb640 1 -- 172.21.15.1:0/853227103 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac010cc0 con 0x557a40b1ddc0 2024-09-19T09:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.546+0000 7f90c3e06740 1 -- 172.21.15.1:0/853227103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 msgr2=0x557a40b28140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.546+0000 7f90c3e06740 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b28140 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00ad00 tx=0x7f90ac00f790 comp rx=0 tx=0).stop 2024-09-19T09:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 -- 172.21.15.1:0/853227103 shutdown_connections 2024-09-19T09:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b28680 0x557a40b2aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b28140 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 --2- 172.21.15.1:0/853227103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b1d4a0 0x557a40b1d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 -- 172.21.15.1:0/853227103 >> 172.21.15.1:0/853227103 conn(0x557a40b19a30 msgr2=0x557a40b19e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 -- 172.21.15.1:0/853227103 shutdown_connections 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 -- 172.21.15.1:0/853227103 wait complete. 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 -- start start 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.547+0000 7f90c3e06740 1 Processor -- start 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1d4a0 0x557a40b27f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1ddc0 0x557a40b25220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b25760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90c3e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557a40b2b250 con 0x557a40b1d4a0 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90c3e06740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a40a3e050 con 0x557a40b1ddc0 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90c3e06740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557a40b2b3d0 con 0x557a40b28680 2024-09-19T09:05:28.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90c3e06740 10 client.0 _ll_register_callbacks cb 0x557a40a7e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90baffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1d4a0 0x557a40b27f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90baffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1d4a0 0x557a40b27f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36666/0 (socket says 172.21.15.1:36666) 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90baffd640 1 -- 172.21.15.1:0/1720207064 learned_addr learned my addr 172.21.15.1:0/1720207064 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1ddc0 0x557a40b25220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b25760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90baffd640 1 -- 172.21.15.1:0/1720207064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 msgr2=0x557a40b25760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90baffd640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b25760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90baffd640 1 -- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1ddc0 msgr2=0x557a40b25220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:28.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90baffd640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1ddc0 0x557a40b25220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90baffd640 1 -- 172.21.15.1:0/1720207064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a407f43c0 con 0x557a40b1d4a0 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b25760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.548+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1ddc0 0x557a40b25220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f90baffd640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1d4a0 0x557a40b27f70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f90ac010860 tx=0x7f90ac019f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e9572b2510ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f909affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f909affd640 1 -- 172.21.15.1:0/1720207064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac01d040 con 0x557a40b1d4a0 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f909affd640 1 -- 172.21.15.1:0/1720207064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f90ac018640 con 0x557a40b1d4a0 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f90c3e06740 1 -- 172.21.15.1:0/1720207064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90ac018b40 con 0x557a40b1d4a0 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f909affd640 1 -- 172.21.15.1:0/1720207064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90ac018840 con 0x557a40b1d4a0 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f90c3e06740 10 client.15789 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f90c3e06740 1 -- 172.21.15.1:0/1720207064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557a40b36bc0 con 0x557a40b1d4a0 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f909affd640 1 -- 172.21.15.1:0/1720207064 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90ac018b40 con 0x557a40b1d4a0 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.549+0000 7f909affd640 1 -- 172.21.15.1:0/1720207064 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90ac020030 con 0x557a40b1d4a0 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f90c3e06740 10 client.15789 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f90c3e06740 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f90c3e06740 20 client.15789 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557a40b38020 0x557a40b3a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f90c3e06740 4 client.15789 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f90c3e06740 1 -- 172.21.15.1:0/1720207064 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a40a90850 con 0x557a40b38020 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557a40b38020 0x557a40b3a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557a40b38020 0x557a40b3a410 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9dca67642f9dfa8 server_cookie=b4f5f107a971497a in_seq=0 out_seq=0 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.550+0000 7f909affd640 10 client.15789 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f909affd640 1 -- 172.21.15.1:0/1720207064 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a40a90850 con 0x557a40b38020 2024-09-19T09:05:28.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f909affd640 10 client.15789 handle_command_reply: tid=0 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 client.15789 shutdown 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 -- 172.21.15.1:0/1720207064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1d4a0 msgr2=0x557a40b27f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1d4a0 0x557a40b27f70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f90ac010860 tx=0x7f90ac019f30 comp rx=0 tx=0).stop 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 -- 172.21.15.1:0/1720207064 shutdown_connections 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557a40b38020 0x557a40b3a410 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b25760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1ddc0 0x557a40b25220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1720207064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1d4a0 0x557a40b27f70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f90c3e06740 1 -- 172.21.15.1:0/1720207064 >> 172.21.15.1:0/1720207064 conn(0x557a40b19a30 msgr2=0x557a40b1f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.551+0000 7f909affd640 0 client.15789 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.552+0000 7f90c3e06740 1 -- 172.21.15.1:0/1720207064 shutdown_connections 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.552+0000 7f90c3e06740 1 -- 172.21.15.1:0/1720207064 wait complete. 2024-09-19T09:05:28.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.552+0000 7f90c3e06740 20 client.15789 trim_cache size 0 max 16384 2024-09-19T09:05:28.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.570+0000 7f90c3e06740 1 Processor -- start 2024-09-19T09:05:28.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.570+0000 7f90c3e06740 1 -- start start 2024-09-19T09:05:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.570+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b3fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.570+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b3ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.570+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b22480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.570+0000 7f90c3e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1b65b0 con 0x557a40b1ddc0 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.570+0000 7f90c3e06740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1b3e80 con 0x557a40b1d4a0 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.570+0000 7f90c3e06740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1b1cd0 con 0x557a40b28680 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b3ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b3ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36682/0 (socket says 172.21.15.1:36682) 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 -- 172.21.15.1:0/1222081794 learned_addr learned my addr 172.21.15.1:0/1222081794 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90baffd640 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b3fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b22480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 -- 172.21.15.1:0/1222081794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 msgr2=0x557a40b22480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b22480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 -- 172.21.15.1:0/1222081794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 msgr2=0x557a40b3fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b3fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 -- 172.21.15.1:0/1222081794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a40b194d0 con 0x557a40b1ddc0 2024-09-19T09:05:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b27fc640 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b3ffb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f90bc075cb0 tx=0x7f90a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d7f5652b01ff56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b17fa640 1 -- 172.21.15.1:0/1222081794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4017b40 con 0x557a40b1ddc0 2024-09-19T09:05:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b17fa640 1 -- 172.21.15.1:0/1222081794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90a4017ce0 con 0x557a40b1ddc0 2024-09-19T09:05:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.571+0000 7f90b17fa640 1 -- 172.21.15.1:0/1222081794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4024410 con 0x557a40b1ddc0 2024-09-19T09:05:28.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.572+0000 7f90c3e06740 1 -- 172.21.15.1:0/1222081794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 msgr2=0x557a40b3ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.572+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b3ffb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f90bc075cb0 tx=0x7f90a40046c0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.572+0000 7f90c3e06740 1 -- 172.21.15.1:0/1222081794 shutdown_connections 2024-09-19T09:05:28.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.572+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b22480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.572+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b1ddc0 0x557a40b3ffb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.572+0000 7f90c3e06740 1 --2- 172.21.15.1:0/1222081794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b3fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.572+0000 7f90c3e06740 1 -- 172.21.15.1:0/1222081794 >> 172.21.15.1:0/1222081794 conn(0x557a40b19a30 msgr2=0x557a40b18b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:28.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.572+0000 7f90c3e06740 1 -- 172.21.15.1:0/1222081794 shutdown_connections 2024-09-19T09:05:28.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.573+0000 7f90c3e06740 1 -- 172.21.15.1:0/1222081794 wait complete. 2024-09-19T09:05:28.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.573+0000 7f90c3e06740 1 -- start start 2024-09-19T09:05:28.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.573+0000 7f90c3e06740 1 Processor -- start 2024-09-19T09:05:28.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.573+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b2e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.573+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b2e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.573+0000 7f90c3e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b2ede0 0x557a40ba1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90c3e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1b2340 con 0x557a40b2ede0 2024-09-19T09:05:28.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90c3e06740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1b37b0 con 0x557a40b1d4a0 2024-09-19T09:05:28.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b2ede0 0x557a40ba1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b2ede0 0x557a40ba1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36686/0 (socket says 172.21.15.1:36686) 2024-09-19T09:05:28.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 -- 172.21.15.1:0/2990146956 learned_addr learned my addr 172.21.15.1:0/2990146956 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:28.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90c3e06740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1b2a10 con 0x557a40b28680 2024-09-19T09:05:28.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90b27fc640 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b2e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90c3e06740 10 client.0 _ll_register_callbacks cb 0x7f90ac01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90baffd640 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b2e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 -- 172.21.15.1:0/2990146956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 msgr2=0x557a40b2e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b2e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 -- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 msgr2=0x557a40b2e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b2e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 -- 172.21.15.1:0/2990146956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a40ba1f90 con 0x557a40b2ede0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90baffd640 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b2e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90bb7fe640 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b2ede0 0x557a40ba1a50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f90b40bd4c0 tx=0x7f90b40bce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f5a96b6eb8571f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f909affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f909affd640 1 -- 172.21.15.1:0/2990146956 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b40dd040 con 0x557a40b2ede0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f909affd640 1 -- 172.21.15.1:0/2990146956 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f90b40bb830 con 0x557a40b2ede0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.574+0000 7f90c3e06740 1 -- 172.21.15.1:0/2990146956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90a4017ce0 con 0x557a40b2ede0 2024-09-19T09:05:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f909affd640 1 -- 172.21.15.1:0/2990146956 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90b40c18e0 con 0x557a40b2ede0 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90c3e06740 10 client.15795 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90c3e06740 1 -- 172.21.15.1:0/2990146956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557a40ba3100 con 0x557a40b2ede0 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f909affd640 1 -- 172.21.15.1:0/2990146956 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90b4036040 con 0x557a40b2ede0 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f909affd640 1 -- 172.21.15.1:0/2990146956 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90b40bd790 con 0x557a40b2ede0 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90c3e06740 10 client.15795 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90c3e06740 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90c3e06740 20 client.15795 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90c3e06740 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557a40ba3780 0x557a40ba5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90c3e06740 4 client.15795 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90c3e06740 1 -- 172.21.15.1:0/2990146956 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f90a4017ce0 con 0x557a40ba3780 2024-09-19T09:05:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.575+0000 7f90baffd640 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557a40ba3780 0x557a40ba5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.576+0000 7f909affd640 10 client.15795 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.576+0000 7f90baffd640 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557a40ba3780 0x557a40ba5b70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beed597d2569e7d0 server_cookie=8a61ad807c074222 in_seq=0 out_seq=0 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.576+0000 7f909affd640 1 -- 172.21.15.1:0/2990146956 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f90a4017ce0 con 0x557a40ba3780 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.576+0000 7f909affd640 10 client.15795 handle_command_reply: tid=0 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.576+0000 7f90c3e06740 1 client.15795 shutdown 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.576+0000 7f90c3e06740 1 -- 172.21.15.1:0/2990146956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b2ede0 msgr2=0x557a40ba1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.576+0000 7f90c3e06740 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b2ede0 0x557a40ba1a50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f90b40bd4c0 tx=0x7f90b40bce90 comp rx=0 tx=0).stop 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 1 -- 172.21.15.1:0/2990146956 shutdown_connections 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x557a40ba3780 0x557a40ba5b70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f909affd640 0 client.15795 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:28.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a40b2ede0 0x557a40ba1a50 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557a40b28680 0x557a40b2e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 1 --2- 172.21.15.1:0/2990146956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a40b1d4a0 0x557a40b2e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 1 -- 172.21.15.1:0/2990146956 >> 172.21.15.1:0/2990146956 conn(0x557a40b19a30 msgr2=0x557a40b26a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 1 -- 172.21.15.1:0/2990146956 shutdown_connections 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 1 -- 172.21.15.1:0/2990146956 wait complete. 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.577+0000 7f90c3e06740 20 client.15795 trim_cache size 0 max 16384 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:05:28.583 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:28.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 -- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90a80a32c0 msgr2=0x7f90a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90a80a32c0 0x7f90a80a5780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x557a40b1adb0 tx=0x7f90a400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 -- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 msgr2=0x7f90bc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 0x7f90bc074f70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f90b4003f40 tx=0x7f90b4003f70 comp rx=0 tx=0).stop 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 -- 172.21.15.1:0/1823177522 shutdown_connections 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90bc106f10 0x7f90bc074f70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90bc102790 0x7f90bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f90a80a32c0 0x7f90a80a5780 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 --2- 172.21.15.1:0/1823177522 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90bc101de0 0x7f90bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.578+0000 7f90c1a2d640 1 -- 172.21.15.1:0/1823177522 >> 172.21.15.1:0/1823177522 conn(0x7f90bc0fd8e0 msgr2=0x7f90bc0fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:28.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.579+0000 7f90c1a2d640 1 -- 172.21.15.1:0/1823177522 shutdown_connections 2024-09-19T09:05:28.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:28.579+0000 7f90c1a2d640 1 -- 172.21.15.1:0/1823177522 wait complete. 2024-09-19T09:05:28.586 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:29.349 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:05:29.349 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:29.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.530+0000 7f27624e1640 1 -- 172.21.15.1:0/3742775140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c102790 msgr2=0x7f275c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.530+0000 7f27624e1640 1 --2- 172.21.15.1:0/3742775140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c102790 0x7f275c1067e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2744009900 tx=0x7f274402a410 comp rx=0 tx=0).stop 2024-09-19T09:05:29.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 -- 172.21.15.1:0/3742775140 shutdown_connections 2024-09-19T09:05:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 --2- 172.21.15.1:0/3742775140 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f275c106f10 0x7f275c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 --2- 172.21.15.1:0/3742775140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c102790 0x7f275c1067e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 --2- 172.21.15.1:0/3742775140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f275c101de0 0x7f275c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 -- 172.21.15.1:0/3742775140 >> 172.21.15.1:0/3742775140 conn(0x7f275c0fd8c0 msgr2=0x7f275c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 -- 172.21.15.1:0/3742775140 shutdown_connections 2024-09-19T09:05:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 -- 172.21.15.1:0/3742775140 wait complete. 2024-09-19T09:05:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 Processor -- start 2024-09-19T09:05:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.531+0000 7f27624e1640 1 -- start start 2024-09-19T09:05:29.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27624e1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f275c101de0 0x7f275c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27624e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f275c102790 0x7f275c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27624e1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c106f10 0x7f275c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27624e1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f275c112050 con 0x7f275c106f10 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27624e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f275c111ed0 con 0x7f275c102790 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27624e1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f275c1121d0 con 0x7f275c101de0 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f2760a7e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c106f10 0x7f275c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f275c102790 0x7f275c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f275c102790 0x7f275c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:36712/0 (socket says 172.21.15.1:36712) 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f27537fe640 1 -- 172.21.15.1:0/3308927221 learned_addr learned my addr 172.21.15.1:0/3308927221 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f275bfff640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f275c101de0 0x7f275c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f2760a7e640 1 -- 172.21.15.1:0/3308927221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f275c101de0 msgr2=0x7f275c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f2760a7e640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f275c101de0 0x7f275c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f2760a7e640 1 -- 172.21.15.1:0/3308927221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f275c102790 msgr2=0x7f275c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f2760a7e640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f275c102790 0x7f275c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f2760a7e640 1 -- 172.21.15.1:0/3308927221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c1a6950 con 0x7f275c106f10 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.532+0000 7f2760a7e640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c106f10 0x7f275c074f70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f275400ca30 tx=0x7f275400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.533+0000 7f2759ffb640 1 -- 172.21.15.1:0/3308927221 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754004d20 con 0x7f275c106f10 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.533+0000 7f2759ffb640 1 -- 172.21.15.1:0/3308927221 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2754005020 con 0x7f275c106f10 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.533+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275c1a6c40 con 0x7f275c106f10 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.533+0000 7f2759ffb640 1 -- 172.21.15.1:0/3308927221 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275400f690 con 0x7f275c106f10 2024-09-19T09:05:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.533+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f275c1a7130 con 0x7f275c106f10 2024-09-19T09:05:29.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.534+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275c1021c0 con 0x7f275c106f10 2024-09-19T09:05:29.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.535+0000 7f2759ffb640 1 -- 172.21.15.1:0/3308927221 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f27540051d0 con 0x7f275c106f10 2024-09-19T09:05:29.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.536+0000 7f2759ffb640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27480a3240 0x7f27480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:29.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.537+0000 7f275bfff640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27480a3240 0x7f27480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:29.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.537+0000 7f2759ffb640 1 -- 172.21.15.1:0/3308927221 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f27540cfae0 con 0x7f275c106f10 2024-09-19T09:05:29.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.537+0000 7f275bfff640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27480a3240 0x7f27480a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f274c00abe0 tx=0x7f274c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:29.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.543+0000 7f2759ffb640 1 -- 172.21.15.1:0/3308927221 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2754014070 con 0x7f275c106f10 2024-09-19T09:05:29.623 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:29.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.775+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f275c10a150 con 0x7f275c106f10 2024-09-19T09:05:29.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.776+0000 7f2759ffb640 1 -- 172.21.15.1:0/3308927221 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f275409c780 con 0x7f275c106f10 2024-09-19T09:05:29.777 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:05:29.777 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:05:29.777 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:05:29.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27480a3240 msgr2=0x7f27480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27480a3240 0x7f27480a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f274c00abe0 tx=0x7f274c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c106f10 msgr2=0x7f275c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c106f10 0x7f275c074f70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f275400ca30 tx=0x7f275400ce30 comp rx=0 tx=0).stop 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 shutdown_connections 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f275c106f10 0x7f275c074f70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f275c102790 0x7f275c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27480a3240 0x7f27480a5700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 --2- 172.21.15.1:0/3308927221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f275c101de0 0x7f275c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 >> 172.21.15.1:0/3308927221 conn(0x7f275c0fd8c0 msgr2=0x7f275c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 shutdown_connections 2024-09-19T09:05:29.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:29.778+0000 7f27624e1640 1 -- 172.21.15.1:0/3308927221 wait complete. 2024-09-19T09:05:30.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:29 smithi001 ceph-mon[30939]: pgmap v379: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T09:05:30.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:29 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3308927221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:29 smithi064 ceph-mon[35179]: pgmap v379: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T09:05:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:29 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3308927221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:30.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:29 smithi022 ceph-mon[35107]: pgmap v379: 97 pgs: 97 active+clean; 672 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T09:05:30.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:29 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3308927221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 -- 172.21.15.1:0/2602792737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354101420 msgr2=0x7f235410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 --2- 172.21.15.1:0/2602792737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354101420 0x7f235410d950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f234c009cd0 tx=0x7f234c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 -- 172.21.15.1:0/2602792737 shutdown_connections 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 --2- 172.21.15.1:0/2602792737 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354101420 0x7f235410d950 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 --2- 172.21.15.1:0/2602792737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2354100a80 0x7f2354100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 --2- 172.21.15.1:0/2602792737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2354106a80 0x7f2354106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 -- 172.21.15.1:0/2602792737 >> 172.21.15.1:0/2602792737 conn(0x7f23540fc7a0 msgr2=0x7f23540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 -- 172.21.15.1:0/2602792737 shutdown_connections 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 -- 172.21.15.1:0/2602792737 wait complete. 2024-09-19T09:05:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.294+0000 7f235be56640 1 Processor -- start 2024-09-19T09:05:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235be56640 1 -- start start 2024-09-19T09:05:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235be56640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2354100a80 0x7f2354102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235be56640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2354101420 0x7f2354102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235be56640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354106a80 0x7f23541030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235be56640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2354110fa0 con 0x7f2354106a80 2024-09-19T09:05:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235be56640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2354110e20 con 0x7f2354101420 2024-09-19T09:05:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235be56640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2354111120 con 0x7f2354100a80 2024-09-19T09:05:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235a3f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354106a80 0x7f23541030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235a3f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354106a80 0x7f23541030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36714/0 (socket says 172.21.15.1:36714) 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235a3f3640 1 -- 172.21.15.1:0/721809715 learned_addr learned my addr 172.21.15.1:0/721809715 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f2359bf2640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2354100a80 0x7f2354102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f23593f1640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2354101420 0x7f2354102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235a3f3640 1 -- 172.21.15.1:0/721809715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2354100a80 msgr2=0x7f2354102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235a3f3640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2354100a80 0x7f2354102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235a3f3640 1 -- 172.21.15.1:0/721809715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2354101420 msgr2=0x7f2354102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235a3f3640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2354101420 0x7f2354102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f235a3f3640 1 -- 172.21.15.1:0/721809715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23541a69c0 con 0x7f2354106a80 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.295+0000 7f23593f1640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2354101420 0x7f2354102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.296+0000 7f235a3f3640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354106a80 0x7f23541030d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f234c006010 tx=0x7f234c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.296+0000 7f234affd640 1 -- 172.21.15.1:0/721809715 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c004040 con 0x7f2354106a80 2024-09-19T09:05:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.296+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23541a6c50 con 0x7f2354106a80 2024-09-19T09:05:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.296+0000 7f234affd640 1 -- 172.21.15.1:0/721809715 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f234c0046e0 con 0x7f2354106a80 2024-09-19T09:05:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.296+0000 7f234affd640 1 -- 172.21.15.1:0/721809715 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c046480 con 0x7f2354106a80 2024-09-19T09:05:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.296+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23541a71e0 con 0x7f2354106a80 2024-09-19T09:05:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.297+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2354100ee0 con 0x7f2354106a80 2024-09-19T09:05:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.298+0000 7f234affd640 1 -- 172.21.15.1:0/721809715 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f234c030630 con 0x7f2354106a80 2024-09-19T09:05:30.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.299+0000 7f234affd640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23400a3240 0x7f23400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:30.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.299+0000 7f2359bf2640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23400a3240 0x7f23400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:30.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.299+0000 7f234affd640 1 -- 172.21.15.1:0/721809715 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f234c02e030 con 0x7f2354106a80 2024-09-19T09:05:30.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.299+0000 7f2359bf2640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23400a3240 0x7f23400a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2350005fd0 tx=0x7f235000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:30.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.303+0000 7f234affd640 1 -- 172.21.15.1:0/721809715 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f234c04b060 con 0x7f2354106a80 2024-09-19T09:05:30.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.517+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23541a7410 con 0x7f2354106a80 2024-09-19T09:05:30.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.518+0000 7f234affd640 1 -- 172.21.15.1:0/721809715 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f234c0bde80 con 0x7f2354106a80 2024-09-19T09:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:05:30.519 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:05:30.519 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:05:30.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23400a3240 msgr2=0x7f23400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:30.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23400a3240 0x7f23400a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2350005fd0 tx=0x7f235000b390 comp rx=0 tx=0).stop 2024-09-19T09:05:30.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354106a80 msgr2=0x7f23541030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:30.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354106a80 0x7f23541030d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f234c006010 tx=0x7f234c003f10 comp rx=0 tx=0).stop 2024-09-19T09:05:30.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 shutdown_connections 2024-09-19T09:05:30.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2354106a80 0x7f23541030d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2354101420 0x7f2354102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23400a3240 0x7f23400a5700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 --2- 172.21.15.1:0/721809715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2354100a80 0x7f2354102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:30.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 >> 172.21.15.1:0/721809715 conn(0x7f23540fc7a0 msgr2=0x7f2354104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:30.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 shutdown_connections 2024-09-19T09:05:30.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:30.520+0000 7f235be56640 1 -- 172.21.15.1:0/721809715 wait complete. 2024-09-19T09:05:30.925 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:05:30.926 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:05:31.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:30 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/721809715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:31.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:30 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/721809715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:31.292 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:30 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/721809715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:31.523 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:31.551 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:05:32.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 -- 172.21.15.1:0/3671102285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60101de0 msgr2=0x7fbb601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3671102285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60101de0 0x7fbb601021c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009900 tx=0x7fbb5c02a410 comp rx=0 tx=0).stop 2024-09-19T09:05:32.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 -- 172.21.15.1:0/3671102285 shutdown_connections 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3671102285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb60106f10 0x7fbb6010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3671102285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb60102790 0x7fbb601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3671102285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60101de0 0x7fbb601021c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 -- 172.21.15.1:0/3671102285 >> 172.21.15.1:0/3671102285 conn(0x7fbb600fd8c0 msgr2=0x7fbb600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 -- 172.21.15.1:0/3671102285 shutdown_connections 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.038+0000 7fbb677a1640 1 -- 172.21.15.1:0/3671102285 wait complete. 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb677a1640 1 Processor -- start 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb677a1640 1 -- start start 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb677a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb60101de0 0x7fbb60198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb677a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60102790 0x7fbb60198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb677a1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb60106f10 0x7fbb6019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb677a1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60112090 con 0x7fbb60102790 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb677a1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60111f10 con 0x7fbb60101de0 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb677a1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60112210 con 0x7fbb60106f10 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb64d3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60102790 0x7fbb60198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb64d3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60102790 0x7fbb60198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36732/0 (socket says 172.21.15.1:36732) 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb64d3c640 1 -- 172.21.15.1:0/3294815157 learned_addr learned my addr 172.21.15.1:0/3294815157 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb6553d640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb60101de0 0x7fbb60198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.039+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb60106f10 0x7fbb6019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb64d3c640 1 -- 172.21.15.1:0/3294815157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb60106f10 msgr2=0x7fbb6019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb60106f10 0x7fbb6019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb64d3c640 1 -- 172.21.15.1:0/3294815157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb60101de0 msgr2=0x7fbb60198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb60101de0 0x7fbb60198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb64d3c640 1 -- 172.21.15.1:0/3294815157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6019d4c0 con 0x7fbb60102790 2024-09-19T09:05:32.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60102790 0x7fbb60198a50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000d770 tx=0x7fbb5000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb567fc640 1 -- 172.21.15.1:0/3294815157 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50017070 con 0x7fbb60102790 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb677a1640 1 -- 172.21.15.1:0/3294815157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6019d7b0 con 0x7fbb60102790 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb567fc640 1 -- 172.21.15.1:0/3294815157 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb50005520 con 0x7fbb60102790 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb567fc640 1 -- 172.21.15.1:0/3294815157 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50010460 con 0x7fbb60102790 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.040+0000 7fbb677a1640 1 -- 172.21.15.1:0/3294815157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb601a5090 con 0x7fbb60102790 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.042+0000 7fbb567fc640 1 -- 172.21.15.1:0/3294815157 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fbb50004ea0 con 0x7fbb60102790 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb69b7a740 1 Processor -- start 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb69b7a740 1 -- start start 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c63850 0x5636e7c63c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c6e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c6ea30 0x5636e7c70e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5636e7bc8160 con 0x5636e7c64170 2024-09-19T09:05:32.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5636e7b6f720 con 0x5636e7c63850 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5636e7bc4120 con 0x5636e7c6ea30 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb567fc640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbb4c0a3240 0x7fbb4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb6553d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c6e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb6553d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c6e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36748/0 (socket says 172.21.15.1:36748) 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb6553d640 1 -- 172.21.15.1:0/2286034498 learned_addr learned my addr 172.21.15.1:0/2286034498 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbb4c0a3240 0x7fbb4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.043+0000 7fbb567fc640 1 -- 172.21.15.1:0/3294815157 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fbb500cf400 con 0x7fbb60102790 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c63850 0x5636e7c63c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c6ea30 0x5636e7c70e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb6553d640 1 -- 172.21.15.1:0/2286034498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c6ea30 msgr2=0x5636e7c70e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb6553d640 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c6ea30 0x5636e7c70e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb6553d640 1 -- 172.21.15.1:0/2286034498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c63850 msgr2=0x5636e7c63c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb6553d640 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c63850 0x5636e7c63c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb6553d640 1 -- 172.21.15.1:0/2286034498 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636e7939ba0 con 0x5636e7c64170 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c6ea30 0x5636e7c70e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c63850 0x5636e7c63c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbb4c0a3240 0x7fbb4c0a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbb58005cc0 tx=0x7fbb58005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb6553d640 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c6e4f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009900 tx=0x7fbb5c031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7e2f53e2b51efe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb4b7fe640 1 -- 172.21.15.1:0/2286034498 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c040070 con 0x5636e7c64170 2024-09-19T09:05:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb4b7fe640 1 -- 172.21.15.1:0/2286034498 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb5c005020 con 0x5636e7c64170 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.044+0000 7fbb4b7fe640 1 -- 172.21.15.1:0/2286034498 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c035040 con 0x5636e7c64170 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2286034498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 msgr2=0x5636e7c6e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c6e4f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009900 tx=0x7fbb5c031640 comp rx=0 tx=0).stop 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2286034498 shutdown_connections 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c6ea30 0x5636e7c70e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c6e4f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2286034498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c63850 0x5636e7c63c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2286034498 >> 172.21.15.1:0/2286034498 conn(0x5636e7c5fde0 msgr2=0x5636e7c601c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2286034498 shutdown_connections 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2286034498 wait complete. 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 -- start start 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.045+0000 7fbb69b7a740 1 Processor -- start 2024-09-19T09:05:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c63850 0x5636e7c6b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c64170 0x5636e7c6bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c6c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5636e7c71600 con 0x5636e7c63850 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5636e7b50900 con 0x5636e7c6ea30 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5636e7c71780 con 0x5636e7c64170 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb69b7a740 10 client.0 _ll_register_callbacks cb 0x5636e7b4e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb6553d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c63850 0x5636e7c6b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb6553d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c63850 0x5636e7c6b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36752/0 (socket says 172.21.15.1:36752) 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb6553d640 1 -- 172.21.15.1:0/2407358784 learned_addr learned my addr 172.21.15.1:0/2407358784 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c6c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c64170 0x5636e7c6bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb6553d640 1 -- 172.21.15.1:0/2407358784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c64170 msgr2=0x5636e7c6bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb6553d640 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c64170 0x5636e7c6bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb6553d640 1 -- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 msgr2=0x5636e7c6c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb6553d640 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c6c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb6553d640 1 -- 172.21.15.1:0/2407358784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636e7b90c50 con 0x5636e7c63850 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.046+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c6c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb6553d640 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c63850 0x5636e7c6b7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0315e0 tx=0x7fbb5c009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb44c13cd0e98bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb48ff9640 1 -- 172.21.15.1:0/2407358784 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c04c020 con 0x5636e7c63850 2024-09-19T09:05:32.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb48ff9640 1 -- 172.21.15.1:0/2407358784 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fbb5c0048a0 con 0x5636e7c63850 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2407358784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb5c005020 con 0x5636e7c63850 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb48ff9640 1 -- 172.21.15.1:0/2407358784 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbb5c057050 con 0x5636e7c63850 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 10 client.15819 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2407358784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5636e7c7d0c0 con 0x5636e7c63850 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb48ff9640 1 -- 172.21.15.1:0/2407358784 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb5c005020 con 0x5636e7c63850 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb48ff9640 1 -- 172.21.15.1:0/2407358784 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbb5c044400 con 0x5636e7c63850 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 10 client.15819 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 10 client.15819 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:05:32.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 20 client.15819 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5636e7c7e410 0x5636e7c80800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 4 client.15819 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.047+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2407358784 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636e7bd5890 con 0x5636e7c7e410 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.048+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5636e7c7e410 0x5636e7c80800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.048+0000 7fbb48ff9640 10 client.15819 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.048+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5636e7c7e410 0x5636e7c80800 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85f1f8a30a2f9d0e server_cookie=1f4c998abeb6e4f0 in_seq=0 out_seq=0 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb48ff9640 1 -- 172.21.15.1:0/2407358784 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636e7bd5890 con 0x5636e7c7e410 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb48ff9640 10 client.15819 handle_command_reply: tid=0 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 client.15819 shutdown 2024-09-19T09:05:32.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2407358784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c63850 msgr2=0x5636e7c6b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c63850 0x5636e7c6b7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0315e0 tx=0x7fbb5c009590 comp rx=0 tx=0).stop 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2407358784 shutdown_connections 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5636e7c7e410 0x5636e7c80800 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c6c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c64170 0x5636e7c6bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/2407358784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c63850 0x5636e7c6b7b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2407358784 >> 172.21.15.1:0/2407358784 conn(0x5636e7c5fde0 msgr2=0x5636e7c65b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb48ff9640 0 client.15819 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2407358784 shutdown_connections 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 1 -- 172.21.15.1:0/2407358784 wait complete. 2024-09-19T09:05:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.049+0000 7fbb69b7a740 20 client.15819 trim_cache size 0 max 16384 2024-09-19T09:05:32.075 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:31 smithi001 ceph-mon[30939]: pgmap v380: 97 pgs: 97 active+clean; 679 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.067+0000 7fbb69b7a740 1 Processor -- start 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.067+0000 7fbb69b7a740 1 -- start start 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.067+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c66d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.067+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c64170 0x5636e7c5edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c6ea30 0x5636e7c5f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601afed0 con 0x5636e7c6ea30 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601ad7a0 con 0x5636e7c64170 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601ab5f0 con 0x5636e7c63850 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb65d3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c6ea30 0x5636e7c5f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb65d3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c6ea30 0x5636e7c5f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36768/0 (socket says 172.21.15.1:36768) 2024-09-19T09:05:32.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb65d3e640 1 -- 172.21.15.1:0/1039224526 learned_addr learned my addr 172.21.15.1:0/1039224526 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:32.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb6553d640 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c66d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c64170 0x5636e7c5edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb65d3e640 1 -- 172.21.15.1:0/1039224526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 msgr2=0x5636e7c66d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c66d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb65d3e640 1 -- 172.21.15.1:0/1039224526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c64170 msgr2=0x5636e7c5edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c64170 0x5636e7c5edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.068+0000 7fbb65d3e640 1 -- 172.21.15.1:0/1039224526 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636e7c5f880 con 0x5636e7c6ea30 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.069+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c6ea30 0x5636e7c5f2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb58014f80 tx=0x7fbb5800a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2628500fa8cb975 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.069+0000 7fbb4affd640 1 -- 172.21.15.1:0/1039224526 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58004b20 con 0x5636e7c6ea30 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.069+0000 7fbb4affd640 1 -- 172.21.15.1:0/1039224526 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb58004cc0 con 0x5636e7c6ea30 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.069+0000 7fbb4affd640 1 -- 172.21.15.1:0/1039224526 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58029880 con 0x5636e7c6ea30 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 -- 172.21.15.1:0/1039224526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c6ea30 msgr2=0x5636e7c5f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c6ea30 0x5636e7c5f2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbb58014f80 tx=0x7fbb5800a4d0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 -- 172.21.15.1:0/1039224526 shutdown_connections 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c6ea30 0x5636e7c5f2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c64170 0x5636e7c5edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/1039224526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c66d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 -- 172.21.15.1:0/1039224526 >> 172.21.15.1:0/1039224526 conn(0x5636e7c5fde0 msgr2=0x5636e7c5e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 -- 172.21.15.1:0/1039224526 shutdown_connections 2024-09-19T09:05:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 -- 172.21.15.1:0/1039224526 wait complete. 2024-09-19T09:05:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 -- start start 2024-09-19T09:05:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.070+0000 7fbb69b7a740 1 Processor -- start 2024-09-19T09:05:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c76e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c68aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb69b7a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c68fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601abc60 con 0x5636e7c64170 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601ad0d0 con 0x5636e7c6ea30 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb69b7a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601ac330 con 0x5636e7c63850 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb69b7a740 10 client.0 _ll_register_callbacks cb 0x7fbb5c02ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb64d3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c68aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb64d3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c68aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36784/0 (socket says 172.21.15.1:36784) 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb64d3c640 1 -- 172.21.15.1:0/3246938231 learned_addr learned my addr 172.21.15.1:0/3246938231 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb6553d640 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c76e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb65d3e640 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c68fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb64d3c640 1 -- 172.21.15.1:0/3246938231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 msgr2=0x5636e7c76e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c76e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb64d3c640 1 -- 172.21.15.1:0/3246938231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 msgr2=0x5636e7c68fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c68fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb64d3c640 1 -- 172.21.15.1:0/3246938231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636e7c69520 con 0x5636e7c64170 2024-09-19T09:05:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.071+0000 7fbb6553d640 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c76e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb64d3c640 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c68aa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbb50097f10 tx=0x7fbb50086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7899f72c25fefc51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:32.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb48ff9640 1 -- 172.21.15.1:0/3246938231 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb500b8070 con 0x5636e7c64170 2024-09-19T09:05:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb48ff9640 1 -- 172.21.15.1:0/3246938231 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fbb50099db0 con 0x5636e7c64170 2024-09-19T09:05:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb69b7a740 1 -- 172.21.15.1:0/3246938231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb58004cc0 con 0x5636e7c64170 2024-09-19T09:05:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb48ff9640 1 -- 172.21.15.1:0/3246938231 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbb50081050 con 0x5636e7c64170 2024-09-19T09:05:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb69b7a740 10 client.15825 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb69b7a740 1 -- 172.21.15.1:0/3246938231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5636e7ced180 con 0x5636e7c64170 2024-09-19T09:05:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.072+0000 7fbb48ff9640 1 -- 172.21.15.1:0/3246938231 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb58004cc0 con 0x5636e7c64170 2024-09-19T09:05:32.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb48ff9640 1 -- 172.21.15.1:0/3246938231 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbb50098120 con 0x5636e7c64170 2024-09-19T09:05:32.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb69b7a740 10 client.15825 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:32.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb69b7a740 10 client.15825 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:05:32.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb69b7a740 20 client.15825 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:32.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5636e7ced730 0x5636e7cefb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:32.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb69b7a740 4 client.15825 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:05:32.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb69b7a740 1 -- 172.21.15.1:0/3246938231 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5636e7bcfbe0 con 0x5636e7ced730 2024-09-19T09:05:32.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb6553d640 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5636e7ced730 0x5636e7cefb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:32.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb48ff9640 10 client.15825 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:32.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.073+0000 7fbb6553d640 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5636e7ced730 0x5636e7cefb50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dae690a942affe86 server_cookie=e976be28bfa572d1 in_seq=0 out_seq=0 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb48ff9640 1 -- 172.21.15.1:0/3246938231 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5636e7bcfbe0 con 0x5636e7ced730 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb48ff9640 10 client.15825 handle_command_reply: tid=0 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 client.15825 shutdown 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 -- 172.21.15.1:0/3246938231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 msgr2=0x5636e7c68aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c68aa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbb50097f10 tx=0x7fbb50086040 comp rx=0 tx=0).stop 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 -- 172.21.15.1:0/3246938231 shutdown_connections 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5636e7ced730 0x5636e7cefb50 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5636e7c6ea30 0x5636e7c68fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5636e7c64170 0x5636e7c68aa0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 --2- 172.21.15.1:0/3246938231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5636e7c63850 0x5636e7c76e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 -- 172.21.15.1:0/3246938231 >> 172.21.15.1:0/3246938231 conn(0x5636e7c5fde0 msgr2=0x5636e7c5eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb48ff9640 0 client.15825 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 -- 172.21.15.1:0/3246938231 shutdown_connections 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 1 -- 172.21.15.1:0/3246938231 wait complete. 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.083+0000 7fbb69b7a740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 24, 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 10, 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stdout: "fd640c30": { 2024-09-19T09:05:32.091 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 10, 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:05:32.092 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:32.093 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:32.093 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:32.093 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:32.093 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:32.093 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:32.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 -- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbb4c0a3240 msgr2=0x7fbb4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbb4c0a3240 0x7fbb4c0a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbb58005cc0 tx=0x7fbb58005bd0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 -- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60102790 msgr2=0x7fbb60198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:32.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60102790 0x7fbb60198a50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000d770 tx=0x7fbb5000dc30 comp rx=0 tx=0).stop 2024-09-19T09:05:32.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 -- 172.21.15.1:0/3294815157 shutdown_connections 2024-09-19T09:05:32.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbb4c0a3240 0x7fbb4c0a5700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb60106f10 0x7fbb6019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60102790 0x7fbb60198a50 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 --2- 172.21.15.1:0/3294815157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb60101de0 0x7fbb60198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:32.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 -- 172.21.15.1:0/3294815157 >> 172.21.15.1:0/3294815157 conn(0x7fbb600fd8c0 msgr2=0x7fbb600febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:32.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 -- 172.21.15.1:0/3294815157 shutdown_connections 2024-09-19T09:05:32.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:32.084+0000 7fbb677a1640 1 -- 172.21.15.1:0/3294815157 wait complete. 2024-09-19T09:05:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:31 smithi064 ceph-mon[35179]: pgmap v380: 97 pgs: 97 active+clean; 679 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:05:32.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:31 smithi022 ceph-mon[35107]: pgmap v380: 97 pgs: 97 active+clean; 679 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:05:32.735 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fd640c30', quiesce took 4.7 seconds. Will release after: 15.650000000000002 2024-09-19T09:05:32.737 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 -- 172.21.15.1:0/1171581654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 msgr2=0x7eff50103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 --2- 172.21.15.1:0/1171581654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 0x7eff50103110 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009930 tx=0x7eff4c02a420 comp rx=0 tx=0).stop 2024-09-19T09:05:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 -- 172.21.15.1:0/1171581654 shutdown_connections 2024-09-19T09:05:33.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 --2- 172.21.15.1:0/1171581654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff501082a0 0x7eff5010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 --2- 172.21.15.1:0/1171581654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff501036e0 0x7eff50107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 --2- 172.21.15.1:0/1171581654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 0x7eff50103110 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 -- 172.21.15.1:0/1171581654 >> 172.21.15.1:0/1171581654 conn(0x7eff500fc7d0 msgr2=0x7eff500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 -- 172.21.15.1:0/1171581654 shutdown_connections 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 -- 172.21.15.1:0/1171581654 wait complete. 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 Processor -- start 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.162+0000 7eff5801c640 1 -- start start 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff5801c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 0x7eff50198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff5801c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff501036e0 0x7eff50198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff5801c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff501082a0 0x7eff5019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff5801c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7eff501121e0 con 0x7eff50102d30 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff5801c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7eff50112060 con 0x7eff501082a0 2024-09-19T09:05:33.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff5801c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7eff50112360 con 0x7eff501036e0 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 0x7eff50198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 0x7eff50198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56480/0 (socket says 172.21.15.1:56480) 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 -- 172.21.15.1:0/3448983691 learned_addr learned my addr 172.21.15.1:0/3448983691 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff565b9640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff501082a0 0x7eff5019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff555b7640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff501036e0 0x7eff50198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 -- 172.21.15.1:0/3448983691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff501036e0 msgr2=0x7eff50198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff501036e0 0x7eff50198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 -- 172.21.15.1:0/3448983691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff501082a0 msgr2=0x7eff5019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff501082a0 0x7eff5019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 -- 172.21.15.1:0/3448983691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5019d5d0 con 0x7eff50102d30 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff555b7640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff501036e0 0x7eff50198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:33.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.163+0000 7eff55db8640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 0x7eff50198620 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009230 tx=0x7eff4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.164+0000 7eff42ffd640 1 -- 172.21.15.1:0/3448983691 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c03f030 con 0x7eff50102d30 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.164+0000 7eff5801c640 1 -- 172.21.15.1:0/3448983691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5019d860 con 0x7eff50102d30 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.164+0000 7eff42ffd640 1 -- 172.21.15.1:0/3448983691 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff4c003af0 con 0x7eff50102d30 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.164+0000 7eff42ffd640 1 -- 172.21.15.1:0/3448983691 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c035070 con 0x7eff50102d30 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.164+0000 7eff5801c640 1 -- 172.21.15.1:0/3448983691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff501a51a0 con 0x7eff50102d30 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.166+0000 7eff42ffd640 1 -- 172.21.15.1:0/3448983691 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7eff4c042030 con 0x7eff50102d30 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.166+0000 7eff5a3f5740 1 Processor -- start 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff5a3f5740 1 -- start start 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441dbb40 0x559b441da090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441daa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441e5370 0x559b441e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b441402f0 con 0x559b441da5d0 2024-09-19T09:05:33.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559b440e7cf0 con 0x559b441e5370 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559b4413c2b0 con 0x559b441dbb40 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff55db8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441daa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff55db8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441daa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56494/0 (socket says 172.21.15.1:56494) 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff55db8640 1 -- 172.21.15.1:0/2186300177 learned_addr learned my addr 172.21.15.1:0/2186300177 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff555b7640 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441e5370 0x559b441e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff42ffd640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7eff3c0a3240 0x7eff3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff565b9640 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441dbb40 0x559b441da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.167+0000 7eff565b9640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7eff3c0a3240 0x7eff3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff555b7640 1 -- 172.21.15.1:0/2186300177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441dbb40 msgr2=0x559b441da090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff555b7640 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441dbb40 0x559b441da090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff555b7640 1 -- 172.21.15.1:0/2186300177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 msgr2=0x559b441daa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:33.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff555b7640 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441daa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff555b7640 1 -- 172.21.15.1:0/2186300177 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b440cc3a0 con 0x559b441e5370 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff42ffd640 1 -- 172.21.15.1:0/3448983691 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7eff4c0f0090 con 0x7eff50102d30 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff555b7640 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441e5370 0x559b441e7760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff5006a370 tx=0x7eff440117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d5e3ce6766956f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff565b9640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7eff3c0a3240 0x7eff3c0a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7eff480077f0 tx=0x7eff48007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff3bfff640 1 -- 172.21.15.1:0/2186300177 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff44005020 con 0x559b441e5370 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff3bfff640 1 -- 172.21.15.1:0/2186300177 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff440047a0 con 0x559b441e5370 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.168+0000 7eff3bfff640 1 -- 172.21.15.1:0/2186300177 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff440126f0 con 0x559b441e5370 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2186300177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441e5370 msgr2=0x559b441e7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441e5370 0x559b441e7760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff5006a370 tx=0x7eff440117b0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2186300177 shutdown_connections 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441e5370 0x559b441e7760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441daa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2186300177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441dbb40 0x559b441da090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2186300177 >> 172.21.15.1:0/2186300177 conn(0x559b441a3310 msgr2=0x559b441d6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2186300177 shutdown_connections 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2186300177 wait complete. 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 -- start start 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.169+0000 7eff5a3f5740 1 Processor -- start 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441da5d0 0x559b441e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441dbb40 0x559b441e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559b441e8070 con 0x559b441dbb40 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559b440fb060 con 0x559b441da5d0 2024-09-19T09:05:33.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559b441e81f0 con 0x559b441e5370 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff5a3f5740 10 client.0 _ll_register_callbacks cb 0x559b43e4e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441dbb40 0x559b441e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441dbb40 0x559b441e1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56496/0 (socket says 172.21.15.1:56496) 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 -- 172.21.15.1:0/271343616 learned_addr learned my addr 172.21.15.1:0/271343616 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff55db8640 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441da5d0 0x559b441e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff565b9640 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 -- 172.21.15.1:0/271343616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 msgr2=0x559b441e24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441e24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 -- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441da5d0 msgr2=0x559b441e4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441da5d0 0x559b441e4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 -- 172.21.15.1:0/271343616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b43eb13c0 con 0x559b441dbb40 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff55db8640 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441da5d0 0x559b441e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:33.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff555b7640 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441dbb40 0x559b441e1f90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7eff44004730 tx=0x7eff44009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7667540b19e1ade0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.170+0000 7eff397fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff397fa640 1 -- 172.21.15.1:0/271343616 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff44028020 con 0x559b441dbb40 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 1 -- 172.21.15.1:0/271343616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff440047a0 con 0x559b441dbb40 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff397fa640 1 -- 172.21.15.1:0/271343616 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7eff44005210 con 0x559b441dbb40 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff397fa640 1 -- 172.21.15.1:0/271343616 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7eff44033050 con 0x559b441dbb40 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 10 client.15837 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 1 -- 172.21.15.1:0/271343616 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b441f3a80 con 0x559b441dbb40 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff397fa640 1 -- 172.21.15.1:0/271343616 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff440047a0 con 0x559b441dbb40 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff397fa640 1 -- 172.21.15.1:0/271343616 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7eff44012450 con 0x559b441dbb40 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 10 client.15837 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 10 client.15837 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:05:33.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 20 client.15837 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x559b441f4e30 0x559b441f7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 4 client.15837 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.171+0000 7eff5a3f5740 1 -- 172.21.15.1:0/271343616 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b4414d860 con 0x559b441f4e30 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.172+0000 7eff55db8640 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x559b441f4e30 0x559b441f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.172+0000 7eff55db8640 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x559b441f4e30 0x559b441f7220 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d238952138aea84f server_cookie=6142cf73cd79bde5 in_seq=0 out_seq=0 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.172+0000 7eff397fa640 10 client.15837 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff397fa640 1 -- 172.21.15.1:0/271343616 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b4414d860 con 0x559b441f4e30 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff397fa640 10 client.15837 handle_command_reply: tid=0 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 client.15837 shutdown 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 -- 172.21.15.1:0/271343616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441dbb40 msgr2=0x559b441e1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441dbb40 0x559b441e1f90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7eff44004730 tx=0x7eff44009860 comp rx=0 tx=0).stop 2024-09-19T09:05:33.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 -- 172.21.15.1:0/271343616 shutdown_connections 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x559b441f4e30 0x559b441f7220 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441e24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441dbb40 0x559b441e1f90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/271343616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441da5d0 0x559b441e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff397fa640 0 client.15837 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 -- 172.21.15.1:0/271343616 >> 172.21.15.1:0/271343616 conn(0x559b441a3310 msgr2=0x559b441dc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 -- 172.21.15.1:0/271343616 shutdown_connections 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 1 -- 172.21.15.1:0/271343616 wait complete. 2024-09-19T09:05:33.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.173+0000 7eff5a3f5740 20 client.15837 trim_cache size 0 max 16384 2024-09-19T09:05:33.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.186+0000 7eff5a3f5740 1 Processor -- start 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.186+0000 7eff5a3f5740 1 -- start start 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441da5d0 0x559b441f1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441e5370 0x559b441fc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7eff501aff30 con 0x559b441e5370 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7eff501ad800 con 0x559b441dbb40 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7eff501ab650 con 0x559b441da5d0 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff565b9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441e5370 0x559b441fc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff565b9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441e5370 0x559b441fc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56500/0 (socket says 172.21.15.1:56500) 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff565b9640 1 -- 172.21.15.1:0/1050431010 learned_addr learned my addr 172.21.15.1:0/1050431010 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:33.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff555b7640 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff55db8640 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441da5d0 0x559b441f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff565b9640 1 -- 172.21.15.1:0/1050431010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441da5d0 msgr2=0x559b441f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff565b9640 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441da5d0 0x559b441f1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff565b9640 1 -- 172.21.15.1:0/1050431010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 msgr2=0x559b441e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff565b9640 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.187+0000 7eff565b9640 1 -- 172.21.15.1:0/1050431010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b441e4890 con 0x559b441e5370 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff565b9640 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441e5370 0x559b441fc910 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7eff48003c70 tx=0x7eff480078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc7e7f0277ae649 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff3b7fe640 1 -- 172.21.15.1:0/1050431010 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48026070 con 0x559b441e5370 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff3b7fe640 1 -- 172.21.15.1:0/1050431010 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff48003e20 con 0x559b441e5370 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff3b7fe640 1 -- 172.21.15.1:0/1050431010 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4801a070 con 0x559b441e5370 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff5a3f5740 1 -- 172.21.15.1:0/1050431010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441e5370 msgr2=0x559b441fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441e5370 0x559b441fc910 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7eff48003c70 tx=0x7eff480078c0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff5a3f5740 1 -- 172.21.15.1:0/1050431010 shutdown_connections 2024-09-19T09:05:33.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441e5370 0x559b441fc910 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/1050431010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441da5d0 0x559b441f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff5a3f5740 1 -- 172.21.15.1:0/1050431010 >> 172.21.15.1:0/1050431010 conn(0x559b441a3310 msgr2=0x559b441e37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.188+0000 7eff5a3f5740 1 -- 172.21.15.1:0/1050431010 shutdown_connections 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 -- 172.21.15.1:0/1050431010 wait complete. 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 -- start start 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 Processor -- start 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441ed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7eff501abcc0 con 0x559b441da5d0 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7eff501ad130 con 0x559b441dbb40 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7eff501ac390 con 0x559b441e5370 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff55db8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff55db8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56516/0 (socket says 172.21.15.1:56516) 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff55db8640 1 -- 172.21.15.1:0/2097399088 learned_addr learned my addr 172.21.15.1:0/2097399088 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.189+0000 7eff5a3f5740 10 client.0 _ll_register_callbacks cb 0x7eff4c0b8a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff555b7640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff565b9640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff55db8640 1 -- 172.21.15.1:0/2097399088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 msgr2=0x559b441de7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff55db8640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441de7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff55db8640 1 -- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 msgr2=0x559b441ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff55db8640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff55db8640 1 -- 172.21.15.1:0/2097399088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b441dedb0 con 0x559b441da5d0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff565b9640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441de7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff555b7640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff55db8640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441ed480 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0b9120 tx=0x7eff4c005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a953048a6d6c407 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff397fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff397fa640 1 -- 172.21.15.1:0/2097399088 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c049040 con 0x559b441da5d0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff397fa640 1 -- 172.21.15.1:0/2097399088 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7eff4c03b460 con 0x559b441da5d0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2097399088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff48003e20 con 0x559b441da5d0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff397fa640 1 -- 172.21.15.1:0/2097399088 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7eff4c0c53c0 con 0x559b441da5d0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff5a3f5740 10 client.15843 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.190+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2097399088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b4425f1a0 con 0x559b441da5d0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff397fa640 1 -- 172.21.15.1:0/2097399088 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff48003e20 con 0x559b441da5d0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff397fa640 1 -- 172.21.15.1:0/2097399088 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7eff4c003ca0 con 0x559b441da5d0 2024-09-19T09:05:33.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff5a3f5740 10 client.15843 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff5a3f5740 10 client.15843 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff5a3f5740 20 client.15843 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x559b4425f870 0x559b44261c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff5a3f5740 4 client.15843 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2097399088 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b44147d70 con 0x559b4425f870 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.191+0000 7eff555b7640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x559b4425f870 0x559b44261c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff555b7640 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x559b4425f870 0x559b44261c90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca8b1b21bb1b5c6e server_cookie=2bdccf792bff9444 in_seq=0 out_seq=0 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff397fa640 10 client.15843 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff397fa640 1 -- 172.21.15.1:0/2097399088 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b44147d70 con 0x559b4425f870 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff397fa640 10 client.15843 handle_command_reply: tid=0 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 client.15843 shutdown 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2097399088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 msgr2=0x559b441ed480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441ed480 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0b9120 tx=0x7eff4c005e40 comp rx=0 tx=0).stop 2024-09-19T09:05:33.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2097399088 shutdown_connections 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x559b4425f870 0x559b44261c90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559b441e5370 0x559b441de7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559b441dbb40 0x559b441ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff397fa640 0 client.15843 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 --2- 172.21.15.1:0/2097399088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559b441da5d0 0x559b441ed480 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2097399088 >> 172.21.15.1:0/2097399088 conn(0x559b441a3310 msgr2=0x559b441e4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2097399088 shutdown_connections 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 1 -- 172.21.15.1:0/2097399088 wait complete. 2024-09-19T09:05:33.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.192+0000 7eff5a3f5740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T09:05:33.201 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:05:33.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 -- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7eff3c0a3240 msgr2=0x7eff3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7eff3c0a3240 0x7eff3c0a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7eff480077f0 tx=0x7eff48007520 comp rx=0 tx=0).stop 2024-09-19T09:05:33.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 -- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 msgr2=0x7eff50198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 0x7eff50198620 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009230 tx=0x7eff4c004270 comp rx=0 tx=0).stop 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 -- 172.21.15.1:0/3448983691 shutdown_connections 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff501082a0 0x7eff5019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7eff3c0a3240 0x7eff3c0a5700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff501036e0 0x7eff50198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 --2- 172.21.15.1:0/3448983691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7eff50102d30 0x7eff50198620 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 -- 172.21.15.1:0/3448983691 >> 172.21.15.1:0/3448983691 conn(0x7eff500fc7d0 msgr2=0x7eff500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 -- 172.21.15.1:0/3448983691 shutdown_connections 2024-09-19T09:05:33.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:33.193+0000 7eff5801c640 1 -- 172.21.15.1:0/3448983691 wait complete. 2024-09-19T09:05:34.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:33 smithi022 ceph-mon[35107]: pgmap v381: 97 pgs: 97 active+clean; 679 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:05:34.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:33 smithi001 ceph-mon[30939]: pgmap v381: 97 pgs: 97 active+clean; 679 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:05:34.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:33 smithi064 ceph-mon[35179]: pgmap v381: 97 pgs: 97 active+clean; 679 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:05:34.394 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:05:34.705 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:35.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 -- 172.21.15.1:0/2261537215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc101de0 msgr2=0x7f2ddc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 --2- 172.21.15.1:0/2261537215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc101de0 0x7f2ddc1021c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009900 tx=0x7f2dcc02a410 comp rx=0 tx=0).stop 2024-09-19T09:05:35.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 -- 172.21.15.1:0/2261537215 shutdown_connections 2024-09-19T09:05:35.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 --2- 172.21.15.1:0/2261537215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ddc106f10 0x7f2ddc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 --2- 172.21.15.1:0/2261537215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ddc102790 0x7f2ddc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 --2- 172.21.15.1:0/2261537215 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc101de0 0x7f2ddc1021c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 -- 172.21.15.1:0/2261537215 >> 172.21.15.1:0/2261537215 conn(0x7f2ddc0fd8c0 msgr2=0x7f2ddc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:35.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 -- 172.21.15.1:0/2261537215 shutdown_connections 2024-09-19T09:05:35.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 -- 172.21.15.1:0/2261537215 wait complete. 2024-09-19T09:05:35.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 Processor -- start 2024-09-19T09:05:35.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.223+0000 7f2de2974640 1 -- start start 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de2974640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ddc101de0 0x7f2ddc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de2974640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ddc102790 0x7f2ddc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de2974640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc106f10 0x7f2ddc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de2974640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc112090 con 0x7f2ddc106f10 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de2974640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc111f10 con 0x7f2ddc101de0 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de2974640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc112210 con 0x7f2ddc102790 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc106f10 0x7f2ddc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc106f10 0x7f2ddc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56542/0 (socket says 172.21.15.1:56542) 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 -- 172.21.15.1:0/3713680339 learned_addr learned my addr 172.21.15.1:0/3713680339 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ddc102790 0x7f2ddc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ddc101de0 0x7f2ddc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 -- 172.21.15.1:0/3713680339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ddc102790 msgr2=0x7f2ddc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ddc102790 0x7f2ddc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 -- 172.21.15.1:0/3713680339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ddc101de0 msgr2=0x7f2ddc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ddc101de0 0x7f2ddc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 -- 172.21.15.1:0/3713680339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc1a6990 con 0x7f2ddc106f10 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2de0f11640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc106f10 0x7f2ddc074f70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400cce0 tx=0x7f2dd400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.224+0000 7f2dd9ffb640 1 -- 172.21.15.1:0/3713680339 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400f450 con 0x7f2ddc106f10 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.225+0000 7f2de2974640 1 -- 172.21.15.1:0/3713680339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc1a6c80 con 0x7f2ddc106f10 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.225+0000 7f2dd9ffb640 1 -- 172.21.15.1:0/3713680339 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2dd400faf0 con 0x7f2ddc106f10 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.225+0000 7f2dd9ffb640 1 -- 172.21.15.1:0/3713680339 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4018cc0 con 0x7f2ddc106f10 2024-09-19T09:05:35.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.225+0000 7f2de2974640 1 -- 172.21.15.1:0/3713680339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc1a71c0 con 0x7f2ddc106f10 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2dd9ffb640 1 -- 172.21.15.1:0/3713680339 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f2dd400f5f0 con 0x7f2ddc106f10 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2de4d4d740 1 Processor -- start 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2de4d4d740 1 -- start start 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2cb40 0x563cd8e2b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2b5d0 0x563cd8e2ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 0x563cd8e38760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563cd8d912f0 con 0x563cd8e2b5d0 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563cd8d38cf0 con 0x563cd8e36370 2024-09-19T09:05:35.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.227+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563cd8d8d2b0 con 0x563cd8e2cb40 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2b5d0 0x563cd8e2ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2b5d0 0x563cd8e2ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56556/0 (socket says 172.21.15.1:56556) 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 -- 172.21.15.1:0/1994039828 learned_addr learned my addr 172.21.15.1:0/1994039828 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 0x563cd8e38760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2cb40 0x563cd8e2b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2dd9ffb640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2dc80a32c0 0x7f2dc80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 -- 172.21.15.1:0/1994039828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2cb40 msgr2=0x563cd8e2b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2cb40 0x563cd8e2b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 -- 172.21.15.1:0/1994039828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 msgr2=0x563cd8e38760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 0x563cd8e38760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 -- 172.21.15.1:0/1994039828 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cd8d1d3a0 con 0x563cd8e2b5d0 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2de0f11640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2dc80a32c0 0x7f2dc80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2b5d0 0x563cd8e2ba10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009900 tx=0x7f2dcc031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0047dd82db4aa2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.228+0000 7f2dd9ffb640 1 -- 172.21.15.1:0/3713680339 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2dd40cfc50 con 0x7f2ddc106f10 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2dd27fc640 1 -- 172.21.15.1:0/1994039828 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc040070 con 0x563cd8e2b5d0 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2dd27fc640 1 -- 172.21.15.1:0/1994039828 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2dcc031a00 con 0x563cd8e2b5d0 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2dd27fc640 1 -- 172.21.15.1:0/1994039828 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc035040 con 0x563cd8e2b5d0 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1994039828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2b5d0 msgr2=0x563cd8e2ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2b5d0 0x563cd8e2ba10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009900 tx=0x7f2dcc031530 comp rx=0 tx=0).stop 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de0f11640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2dc80a32c0 0x7f2dc80a5780 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2dd409c1e0 tx=0x7f2dd406f0d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1994039828 shutdown_connections 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 0x563cd8e38760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2b5d0 0x563cd8e2ba10 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1994039828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2cb40 0x563cd8e2b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1994039828 >> 172.21.15.1:0/1994039828 conn(0x563cd8df4310 msgr2=0x563cd8e27c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:35.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1994039828 shutdown_connections 2024-09-19T09:05:35.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.229+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1994039828 wait complete. 2024-09-19T09:05:35.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 1 -- start start 2024-09-19T09:05:35.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 1 Processor -- start 2024-09-19T09:05:35.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 0x563cd8e35db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e33060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 0x563cd8e337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563cd8e39010 con 0x563cd8e2cb40 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563cd8d4c060 con 0x563cd8e36370 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563cd8e39190 con 0x563cd8e2b5d0 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2de4d4d740 10 client.0 _ll_register_callbacks cb 0x563cd8a9f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e33060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e33060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56564/0 (socket says 172.21.15.1:56564) 2024-09-19T09:05:35.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2ddbfff640 1 -- 172.21.15.1:0/2468780315 learned_addr learned my addr 172.21.15.1:0/2468780315 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.230+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 0x563cd8e35db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 0x563cd8e337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2ddbfff640 1 -- 172.21.15.1:0/2468780315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 msgr2=0x563cd8e35db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 0x563cd8e35db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2ddbfff640 1 -- 172.21.15.1:0/2468780315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 msgr2=0x563cd8e337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 0x563cd8e337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2ddbfff640 1 -- 172.21.15.1:0/2468780315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cd8b023c0 con 0x563cd8e2cb40 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e33060 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc02a930 tx=0x7f2dcc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22b96996ead2ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2dbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/2468780315 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc040070 con 0x563cd8e2cb40 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/2468780315 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2dcc004750 con 0x563cd8e2cb40 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2468780315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dcc031a00 con 0x563cd8e2cb40 2024-09-19T09:05:35.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/2468780315 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2dcc035040 con 0x563cd8e2cb40 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2de4d4d740 10 client.15855 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.231+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2468780315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563cd8e44b30 con 0x563cd8e2cb40 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/2468780315 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2dcc031a00 con 0x563cd8e2cb40 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/2468780315 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2dcc03cab0 con 0x563cd8e2cb40 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2de4d4d740 10 client.15855 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2de4d4d740 10 client.15855 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2de4d4d740 20 client.15855 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x563cd8e45e80 0x563cd8e48270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2de4d4d740 4 client.15855 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2468780315 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cd8d9e860 con 0x563cd8e45e80 2024-09-19T09:05:35.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x563cd8e45e80 0x563cd8e48270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x563cd8e45e80 0x563cd8e48270 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1bfe7992cfc5bbdc server_cookie=662d89c956ad6027 in_seq=0 out_seq=0 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.232+0000 7f2dbb7fe640 10 client.15855 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/2468780315 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563cd8d9e860 con 0x563cd8e45e80 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2dbb7fe640 10 client.15855 handle_command_reply: tid=0 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 client.15855 shutdown 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2468780315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 msgr2=0x563cd8e33060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e33060 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc02a930 tx=0x7f2dcc02a410 comp rx=0 tx=0).stop 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2468780315 shutdown_connections 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x563cd8e45e80 0x563cd8e48270 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e36370 0x563cd8e337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2dbb7fe640 0 client.15855 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:05:35.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e33060 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2468780315 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 0x563cd8e35db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.233+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2468780315 >> 172.21.15.1:0/2468780315 conn(0x563cd8df4310 msgr2=0x563cd8e2d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:35.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.234+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2468780315 shutdown_connections 2024-09-19T09:05:35.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.234+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2468780315 wait complete. 2024-09-19T09:05:35.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.234+0000 7f2de4d4d740 20 client.15855 trim_cache size 0 max 16384 2024-09-19T09:05:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2de4d4d740 1 Processor -- start 2024-09-19T09:05:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2de4d4d740 1 -- start start 2024-09-19T09:05:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2b5d0 0x563cd8e32920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e34fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e36370 0x563cd8e4b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1b20e0 con 0x563cd8e2cb40 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1af9b0 con 0x563cd8e2b5d0 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1ad800 con 0x563cd8e36370 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e34fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2ddbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e34fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56566/0 (socket says 172.21.15.1:56566) 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2ddbfff640 1 -- 172.21.15.1:0/2378855371 learned_addr learned my addr 172.21.15.1:0/2378855371 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2b5d0 0x563cd8e32920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e36370 0x563cd8e4b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2ddbfff640 1 -- 172.21.15.1:0/2378855371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e36370 msgr2=0x563cd8e4b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e36370 0x563cd8e4b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2ddbfff640 1 -- 172.21.15.1:0/2378855371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2b5d0 msgr2=0x563cd8e32920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2b5d0 0x563cd8e32920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2ddbfff640 1 -- 172.21.15.1:0/2378855371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cd8e28960 con 0x563cd8e2cb40 2024-09-19T09:05:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.247+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e36370 0x563cd8e4b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.248+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e34fd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009900 tx=0x7f2dcc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b1b914b918559f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.248+0000 7f2dd1ffb640 1 -- 172.21.15.1:0/2378855371 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc040040 con 0x563cd8e2cb40 2024-09-19T09:05:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.248+0000 7f2dd1ffb640 1 -- 172.21.15.1:0/2378855371 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2dcc04d070 con 0x563cd8e2cb40 2024-09-19T09:05:35.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.248+0000 7f2dd1ffb640 1 -- 172.21.15.1:0/2378855371 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc004d60 con 0x563cd8e2cb40 2024-09-19T09:05:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.248+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2378855371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 msgr2=0x563cd8e34fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.248+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e34fd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009900 tx=0x7f2dcc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2378855371 shutdown_connections 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e36370 0x563cd8e4b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e2cb40 0x563cd8e34fd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/2378855371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2b5d0 0x563cd8e32920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2378855371 >> 172.21.15.1:0/2378855371 conn(0x563cd8df4310 msgr2=0x563cd8e348c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2378855371 shutdown_connections 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 -- 172.21.15.1:0/2378855371 wait complete. 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 -- start start 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 Processor -- start 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 0x563cd8e4bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2cb40 0x563cd8e48ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e36370 0x563cd8e49650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1ade70 con 0x563cd8e36370 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1af2e0 con 0x563cd8e2cb40 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.249+0000 7f2de4d4d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc1ae540 con 0x563cd8e2b5d0 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2de4d4d740 10 client.0 _ll_register_callbacks cb 0x7f2dc40099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e36370 0x563cd8e49650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e36370 0x563cd8e49650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56580/0 (socket says 172.21.15.1:56580) 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 -- 172.21.15.1:0/1130023876 learned_addr learned my addr 172.21.15.1:0/1130023876 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 0x563cd8e4bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2cb40 0x563cd8e48ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 -- 172.21.15.1:0/1130023876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 msgr2=0x563cd8e4bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 0x563cd8e4bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 -- 172.21.15.1:0/1130023876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2cb40 msgr2=0x563cd8e48ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2cb40 0x563cd8e48ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 -- 172.21.15.1:0/1130023876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cd8e274f0 con 0x563cd8e36370 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dd3fff640 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e36370 0x563cd8e49650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40106b0 tx=0x7f2dc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f95259ed399d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/1130023876 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4004100 con 0x563cd8e36370 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/1130023876 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2dc40042a0 con 0x563cd8e36370 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.250+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1130023876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dcc04d070 con 0x563cd8e36370 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/1130023876 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2dc40044a0 con 0x563cd8e36370 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2de4d4d740 10 client.15861 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1130023876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563cd8eb0780 con 0x563cd8e36370 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/1130023876 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2dcc04d070 con 0x563cd8e36370 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/1130023876 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2dc402d6f0 con 0x563cd8e36370 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2de4d4d740 10 client.15861 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2de4d4d740 10 client.15861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:05:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2de4d4d740 20 client.15861 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x563cd8eb0ed0 0x563cd8eb32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2de4d4d740 4 client.15861 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1130023876 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563cd8d98d70 con 0x563cd8eb0ed0 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.251+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x563cd8eb0ed0 0x563cd8eb32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2dbb7fe640 10 client.15861 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2ddbfff640 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x563cd8eb0ed0 0x563cd8eb32f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94d2d64e689e8264 server_cookie=9503d2f2880f75fe in_seq=0 out_seq=0 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2dbb7fe640 1 -- 172.21.15.1:0/1130023876 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563cd8d98d70 con 0x563cd8eb0ed0 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2dbb7fe640 10 client.15861 handle_command_reply: tid=0 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 client.15861 shutdown 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1130023876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e36370 msgr2=0x563cd8e49650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e36370 0x563cd8e49650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40106b0 tx=0x7f2dc4004730 comp rx=0 tx=0).stop 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1130023876 shutdown_connections 2024-09-19T09:05:35.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x563cd8eb0ed0 0x563cd8eb32f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cd8e36370 0x563cd8e49650 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cd8e2cb40 0x563cd8e48ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2dbb7fe640 0 client.15861 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 --2- 172.21.15.1:0/1130023876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563cd8e2b5d0 0x563cd8e4bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1130023876 >> 172.21.15.1:0/1130023876 conn(0x563cd8df4310 msgr2=0x563cd8e348c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1130023876 shutdown_connections 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 1 -- 172.21.15.1:0/1130023876 wait complete. 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.252+0000 7f2de4d4d740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T09:05:35.258 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:05:35.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 -- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2dc80a32c0 msgr2=0x7f2dc80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2dc80a32c0 0x7f2dc80a5780 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2dd409c1e0 tx=0x7f2dd406f0d0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 -- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc106f10 msgr2=0x7f2ddc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc106f10 0x7f2ddc074f70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400cce0 tx=0x7f2dd400a620 comp rx=0 tx=0).stop 2024-09-19T09:05:35.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 -- 172.21.15.1:0/3713680339 shutdown_connections 2024-09-19T09:05:35.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ddc106f10 0x7f2ddc074f70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f2dc80a32c0 0x7f2dc80a5780 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ddc102790 0x7f2ddc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 --2- 172.21.15.1:0/3713680339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ddc101de0 0x7f2ddc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 -- 172.21.15.1:0/3713680339 >> 172.21.15.1:0/3713680339 conn(0x7f2ddc0fd8c0 msgr2=0x7f2ddc0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:35.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 -- 172.21.15.1:0/3713680339 shutdown_connections 2024-09-19T09:05:35.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:35.253+0000 7f2de2974640 1 -- 172.21.15.1:0/3713680339 wait complete. 2024-09-19T09:05:35.940 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:05:36.199 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:36.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:35 smithi022 ceph-mon[35107]: pgmap v382: 97 pgs: 97 active+clean; 2.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 116 KiB/s wr, 7 op/s 2024-09-19T09:05:36.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:35 smithi001 ceph-mon[30939]: pgmap v382: 97 pgs: 97 active+clean; 2.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 116 KiB/s wr, 7 op/s 2024-09-19T09:05:36.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:35 smithi064 ceph-mon[35179]: pgmap v382: 97 pgs: 97 active+clean; 2.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 116 KiB/s wr, 7 op/s 2024-09-19T09:05:36.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 -- 172.21.15.1:0/3563018575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0100a80 msgr2=0x7f8bf0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/3563018575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0100a80 0x7f8bf0100ee0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009930 tx=0x7f8be002a420 comp rx=0 tx=0).stop 2024-09-19T09:05:36.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 -- 172.21.15.1:0/3563018575 shutdown_connections 2024-09-19T09:05:36.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/3563018575 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bf0101420 0x7f8bf010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/3563018575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0100a80 0x7f8bf0100ee0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/3563018575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bf0106a80 0x7f8bf0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 -- 172.21.15.1:0/3563018575 >> 172.21.15.1:0/3563018575 conn(0x7f8bf00fc7a0 msgr2=0x7f8bf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 -- 172.21.15.1:0/3563018575 shutdown_connections 2024-09-19T09:05:36.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 -- 172.21.15.1:0/3563018575 wait complete. 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.625+0000 7f8bf7a43640 1 Processor -- start 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf7a43640 1 -- start start 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf7a43640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bf0100a80 0x7f8bf00fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf7a43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bf0101420 0x7f8bf00fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf7a43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0106a80 0x7f8bf00fd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf7a43640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0110fa0 con 0x7f8bf0106a80 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf7a43640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0110e20 con 0x7f8bf0101420 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf7a43640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0111120 con 0x7f8bf0100a80 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf5fe0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0106a80 0x7f8bf00fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf5fe0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0106a80 0x7f8bf00fd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56598/0 (socket says 172.21.15.1:56598) 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf5fe0640 1 -- 172.21.15.1:0/127743720 learned_addr learned my addr 172.21.15.1:0/127743720 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bf0101420 0x7f8bf00fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf57df640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bf0100a80 0x7f8bf00fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf5fe0640 1 -- 172.21.15.1:0/127743720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bf0100a80 msgr2=0x7f8bf00fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf5fe0640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bf0100a80 0x7f8bf00fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf5fe0640 1 -- 172.21.15.1:0/127743720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bf0101420 msgr2=0x7f8bf00fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf5fe0640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bf0101420 0x7f8bf00fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf5fe0640 1 -- 172.21.15.1:0/127743720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf01a6a50 con 0x7f8bf0106a80 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.626+0000 7f8bf57df640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bf0100a80 0x7f8bf00fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.627+0000 7f8bf5fe0640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0106a80 0x7f8bf00fd790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8be800eaa0 tx=0x7f8be800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.627+0000 7f8be67fc640 1 -- 172.21.15.1:0/127743720 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be800cdb0 con 0x7f8bf0106a80 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.627+0000 7f8bf7a43640 1 -- 172.21.15.1:0/127743720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf01a6d40 con 0x7f8bf0106a80 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.627+0000 7f8be67fc640 1 -- 172.21.15.1:0/127743720 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8be8004b20 con 0x7f8bf0106a80 2024-09-19T09:05:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.627+0000 7f8be67fc640 1 -- 172.21.15.1:0/127743720 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8011760 con 0x7f8bf0106a80 2024-09-19T09:05:36.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.627+0000 7f8bf7a43640 1 -- 172.21.15.1:0/127743720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01a7250 con 0x7f8bf0106a80 2024-09-19T09:05:36.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.630+0000 7f8be67fc640 1 -- 172.21.15.1:0/127743720 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f8be8011900 con 0x7f8bf0106a80 2024-09-19T09:05:36.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.630+0000 7f8bf9e1c740 1 Processor -- start 2024-09-19T09:05:36.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.630+0000 7f8bf9e1c740 1 -- start start 2024-09-19T09:05:36.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec823b40 0x55a8ec822090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec8225d0 0x55a8ec822a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec82f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a8ec7882f0 con 0x55a8ec82d370 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a8ec72fcf0 con 0x55a8ec8225d0 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a8ec7842b0 con 0x55a8ec823b40 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8be67fc640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bdc0a3240 0x7f8bdc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec82f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec82f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56608/0 (socket says 172.21.15.1:56608) 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 -- 172.21.15.1:0/1584543008 learned_addr learned my addr 172.21.15.1:0/1584543008 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf57df640 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec8225d0 0x55a8ec822a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec823b40 0x55a8ec822090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf5fe0640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bdc0a3240 0x7f8bdc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8be67fc640 1 -- 172.21.15.1:0/127743720 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8be80cfbe0 con 0x7f8bf0106a80 2024-09-19T09:05:36.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 -- 172.21.15.1:0/1584543008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec823b40 msgr2=0x55a8ec822090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:36.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec823b40 0x55a8ec822090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 -- 172.21.15.1:0/1584543008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec8225d0 msgr2=0x55a8ec822a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:36.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec8225d0 0x55a8ec822a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.631+0000 7f8bf4fde640 1 -- 172.21.15.1:0/1584543008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ec7143a0 con 0x55a8ec82d370 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.632+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec82f760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8be002a940 tx=0x7f8be002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10379b3f24c1363 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.632+0000 7f8bf5fe0640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bdc0a3240 0x7f8bdc0a5700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8be800efd0 tx=0x7f8be804b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.632+0000 7f8bdb7fe640 1 -- 172.21.15.1:0/1584543008 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0035070 con 0x55a8ec82d370 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.632+0000 7f8bdb7fe640 1 -- 172.21.15.1:0/1584543008 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8be0005020 con 0x55a8ec82d370 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.632+0000 7f8bdb7fe640 1 -- 172.21.15.1:0/1584543008 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0004a00 con 0x55a8ec82d370 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.632+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/1584543008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 msgr2=0x55a8ec82f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.632+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec82f760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8be002a940 tx=0x7f8be002a420 comp rx=0 tx=0).stop 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/1584543008 shutdown_connections 2024-09-19T09:05:36.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec82f760 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec8225d0 0x55a8ec822a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/1584543008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec823b40 0x55a8ec822090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/1584543008 >> 172.21.15.1:0/1584543008 conn(0x55a8ec7eb310 msgr2=0x55a8ec81ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/1584543008 shutdown_connections 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/1584543008 wait complete. 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 -- start start 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 Processor -- start 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec82cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec823b40 0x55a8ec829fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec82d370 0x55a8ec82a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a8ec830010 con 0x55a8ec823b40 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a8ec743060 con 0x55a8ec82d370 2024-09-19T09:05:36.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.633+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a8ec830190 con 0x55a8ec8225d0 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf9e1c740 10 client.0 _ll_register_callbacks cb 0x55a8ec4968c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec823b40 0x55a8ec829fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec823b40 0x55a8ec829fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56622/0 (socket says 172.21.15.1:56622) 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 -- 172.21.15.1:0/3774518796 learned_addr learned my addr 172.21.15.1:0/3774518796 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec82cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec82d370 0x55a8ec82a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 -- 172.21.15.1:0/3774518796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 msgr2=0x55a8ec82cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec82cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 -- 172.21.15.1:0/3774518796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec82d370 msgr2=0x55a8ec82a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec82d370 0x55a8ec82a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 -- 172.21.15.1:0/3774518796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ec4f93c0 con 0x55a8ec823b40 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf57df640 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec823b40 0x55a8ec829fe0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00bf30 tx=0x7f8bec0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772bf087eecae1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:36.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/3774518796 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0035f0 con 0x55a8ec823b40 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/3774518796 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8bec003790 con 0x55a8ec823b40 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.634+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3774518796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be0005020 con 0x55a8ec823b40 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/3774518796 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8bec003990 con 0x55a8ec823b40 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf9e1c740 10 client.15873 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3774518796 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a8ec83bb00 con 0x55a8ec823b40 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/3774518796 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8be0005020 con 0x55a8ec823b40 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/3774518796 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8bec019070 con 0x55a8ec823b40 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf9e1c740 10 client.15873 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf9e1c740 10 client.15873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf9e1c740 20 client.15873 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a8ec83d000 0x55a8ec83f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf9e1c740 4 client.15873 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:36.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3774518796 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8ec795860 con 0x55a8ec83d000 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.635+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a8ec83d000 0x55a8ec83f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.636+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a8ec83d000 0x55a8ec83f3f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb71c3f0462a3704 server_cookie=d0b82ea2951e090e in_seq=0 out_seq=0 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.636+0000 7f8bd8ff9640 10 client.15873 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.636+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/3774518796 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8ec795860 con 0x55a8ec83d000 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.636+0000 7f8bd8ff9640 10 client.15873 handle_command_reply: tid=0 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.636+0000 7f8bf9e1c740 1 client.15873 shutdown 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3774518796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec823b40 msgr2=0x55a8ec829fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec823b40 0x55a8ec829fe0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00bf30 tx=0x7f8bec0128e0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3774518796 shutdown_connections 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a8ec83d000 0x55a8ec83f3f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec82d370 0x55a8ec82a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec823b40 0x55a8ec829fe0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3774518796 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec82cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3774518796 >> 172.21.15.1:0/3774518796 conn(0x55a8ec7eb310 msgr2=0x55a8ec824960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bd8ff9640 0 client.15873 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:36.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3774518796 shutdown_connections 2024-09-19T09:05:36.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3774518796 wait complete. 2024-09-19T09:05:36.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.637+0000 7f8bf9e1c740 20 client.15873 trim_cache size 0 max 16384 2024-09-19T09:05:36.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf9e1c740 1 Processor -- start 2024-09-19T09:05:36.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf9e1c740 1 -- start start 2024-09-19T09:05:36.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec81ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec8392e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec8298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01b22f0 con 0x55a8ec82d370 2024-09-19T09:05:36.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01afbc0 con 0x55a8ec823b40 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01ada10 con 0x55a8ec8225d0 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf4fde640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec8298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf4fde640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec8298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56636/0 (socket says 172.21.15.1:56636) 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.650+0000 7f8bf4fde640 1 -- 172.21.15.1:0/3112040882 learned_addr learned my addr 172.21.15.1:0/3112040882 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec81ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf57df640 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec8392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf4fde640 1 -- 172.21.15.1:0/3112040882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 msgr2=0x55a8ec81ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec81ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf4fde640 1 -- 172.21.15.1:0/3112040882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 msgr2=0x55a8ec8392e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec8392e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf4fde640 1 -- 172.21.15.1:0/3112040882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ec81f960 con 0x55a8ec82d370 2024-09-19T09:05:36.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf57df640 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec8392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:36.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec8298a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8be00057c0 tx=0x7f8be0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770ea56968e28f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bdaffd640 1 -- 172.21.15.1:0/3112040882 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0035040 con 0x55a8ec82d370 2024-09-19T09:05:36.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bdaffd640 1 -- 172.21.15.1:0/3112040882 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8be0004770 con 0x55a8ec82d370 2024-09-19T09:05:36.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.651+0000 7f8bdaffd640 1 -- 172.21.15.1:0/3112040882 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be003d690 con 0x55a8ec82d370 2024-09-19T09:05:36.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3112040882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 msgr2=0x55a8ec8298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec8298a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8be00057c0 tx=0x7f8be0004610 comp rx=0 tx=0).stop 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3112040882 shutdown_connections 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec8298a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec8392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/3112040882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec81ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3112040882 >> 172.21.15.1:0/3112040882 conn(0x55a8ec7eb310 msgr2=0x55a8ec81e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3112040882 shutdown_connections 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/3112040882 wait complete. 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 -- start start 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 Processor -- start 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec835630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec835b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec826810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01ae080 con 0x55a8ec82d370 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.652+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01af4f0 con 0x55a8ec823b40 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf9e1c740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01ae750 con 0x55a8ec8225d0 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf9e1c740 10 client.0 _ll_register_callbacks cb 0x7f8bec00bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec826810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec826810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56652/0 (socket says 172.21.15.1:56652) 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 -- 172.21.15.1:0/2230136281 learned_addr learned my addr 172.21.15.1:0/2230136281 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf57df640 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec835b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec835630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 -- 172.21.15.1:0/2230136281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 msgr2=0x55a8ec835630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec835630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 -- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 msgr2=0x55a8ec835b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec835b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 -- 172.21.15.1:0/2230136281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ec827040 con 0x55a8ec82d370 2024-09-19T09:05:36.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf57df640 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec835b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf4fde640 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec826810 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8be0004b90 tx=0x7f8be00095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3daf7df8a26d160 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2230136281 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0035070 con 0x55a8ec82d370 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2230136281 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8be0004cb0 con 0x55a8ec82d370 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/2230136281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be0004770 con 0x55a8ec82d370 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.653+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2230136281 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8be0004eb0 con 0x55a8ec82d370 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf9e1c740 10 client.15879 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/2230136281 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a8ec8a76c0 con 0x55a8ec82d370 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2230136281 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8be0004770 con 0x55a8ec82d370 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2230136281 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8be004a040 con 0x55a8ec82d370 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf9e1c740 10 client.15879 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf9e1c740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:36.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf9e1c740 20 client.15879 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a8ec8a78f0 0x55a8ec8a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf9e1c740 4 client.15879 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/2230136281 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a8ec78fd70 con 0x55a8ec8a78f0 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.654+0000 7f8bf57df640 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a8ec8a78f0 0x55a8ec8a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf57df640 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a8ec8a78f0 0x55a8ec8a9ce0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2880db91a59b9967 server_cookie=32ea3a2513767538 in_seq=0 out_seq=0 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bd8ff9640 10 client.15879 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bd8ff9640 1 -- 172.21.15.1:0/2230136281 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a8ec78fd70 con 0x55a8ec8a78f0 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bd8ff9640 10 client.15879 handle_command_reply: tid=0 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 client.15879 shutdown 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/2230136281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 msgr2=0x55a8ec826810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec826810 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8be0004b90 tx=0x7f8be00095a0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/2230136281 shutdown_connections 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a8ec8a78f0 0x55a8ec8a9ce0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a8ec82d370 0x55a8ec826810 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a8ec823b40 0x55a8ec835b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 --2- 172.21.15.1:0/2230136281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a8ec8225d0 0x55a8ec835630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/2230136281 >> 172.21.15.1:0/2230136281 conn(0x55a8ec7eb310 msgr2=0x55a8ec8298a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bd8ff9640 0 client.15879 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:36.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/2230136281 shutdown_connections 2024-09-19T09:05:36.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 1 -- 172.21.15.1:0/2230136281 wait complete. 2024-09-19T09:05:36.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.655+0000 7f8bf9e1c740 20 client.15879 trim_cache size 0 max 16384 2024-09-19T09:05:36.661 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:05:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 -- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bdc0a3240 msgr2=0x7f8bdc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bdc0a3240 0x7f8bdc0a5700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8be800efd0 tx=0x7f8be804b040 comp rx=0 tx=0).stop 2024-09-19T09:05:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 -- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0106a80 msgr2=0x7f8bf00fd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0106a80 0x7f8bf00fd790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8be800eaa0 tx=0x7f8be800ef60 comp rx=0 tx=0).stop 2024-09-19T09:05:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 -- 172.21.15.1:0/127743720 shutdown_connections 2024-09-19T09:05:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf0106a80 0x7f8bf00fd790 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bf0101420 0x7f8bf00fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8bdc0a3240 0x7f8bdc0a5700 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 --2- 172.21.15.1:0/127743720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bf0100a80 0x7f8bf00fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:36.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 -- 172.21.15.1:0/127743720 >> 172.21.15.1:0/127743720 conn(0x7f8bf00fc7a0 msgr2=0x7f8bf006aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:36.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 -- 172.21.15.1:0/127743720 shutdown_connections 2024-09-19T09:05:36.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:36.656+0000 7f8bf7a43640 1 -- 172.21.15.1:0/127743720 wait complete. 2024-09-19T09:05:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 -- 172.21.15.1:0/3557211472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d01078b0 msgr2=0x7f85d0109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/3557211472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d01078b0 0x7f85d0109cc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009ca0 tx=0x7f85c802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 -- 172.21.15.1:0/3557211472 shutdown_connections 2024-09-19T09:05:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/3557211472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d01078b0 0x7f85d0109cc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/3557211472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85d0104f80 0x7f85d0107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/3557211472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85d0102650 0x7f85d0104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 -- 172.21.15.1:0/3557211472 >> 172.21.15.1:0/3557211472 conn(0x7f85d00fc1f0 msgr2=0x7f85d00fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 -- 172.21.15.1:0/3557211472 shutdown_connections 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.436+0000 7f85d5bb7640 1 -- 172.21.15.1:0/3557211472 wait complete. 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.437+0000 7f85d5bb7640 1 Processor -- start 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.437+0000 7f85d5bb7640 1 -- start start 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.437+0000 7f85d5bb7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85d0102650 0x7f85d0197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.437+0000 7f85d5bb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d0104f80 0x7f85d01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.437+0000 7f85d5bb7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85d01078b0 0x7f85d019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.437+0000 7f85d5bb7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010d960 con 0x7f85d0104f80 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.437+0000 7f85d5bb7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010d7e0 con 0x7f85d0102650 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.437+0000 7f85d5bb7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010dae0 con 0x7f85d01078b0 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d0104f80 0x7f85d01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d0104f80 0x7f85d01984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56678/0 (socket says 172.21.15.1:56678) 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 -- 172.21.15.1:0/2849159466 learned_addr learned my addr 172.21.15.1:0/2849159466 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85d0102650 0x7f85d0197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85cffff640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85d01078b0 0x7f85d019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 -- 172.21.15.1:0/2849159466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85d01078b0 msgr2=0x7f85d019f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85d01078b0 0x7f85d019f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 -- 172.21.15.1:0/2849159466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85d0102650 msgr2=0x7f85d0197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85d0102650 0x7f85d0197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 -- 172.21.15.1:0/2849159466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d019fbd0 con 0x7f85d0104f80 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85d0102650 0x7f85d0197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ceffd640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d0104f80 0x7f85d01984f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c970 tx=0x7f85c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ccff9640 1 -- 172.21.15.1:0/2849159466 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4007bb0 con 0x7f85d0104f80 2024-09-19T09:05:37.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85d5bb7640 1 -- 172.21.15.1:0/2849159466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d019fec0 con 0x7f85d0104f80 2024-09-19T09:05:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ccff9640 1 -- 172.21.15.1:0/2849159466 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85c4007d50 con 0x7f85d0104f80 2024-09-19T09:05:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85ccff9640 1 -- 172.21.15.1:0/2849159466 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4018860 con 0x7f85d0104f80 2024-09-19T09:05:37.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.438+0000 7f85d5bb7640 1 -- 172.21.15.1:0/2849159466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d01a0330 con 0x7f85d0104f80 2024-09-19T09:05:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85ccff9640 1 -- 172.21.15.1:0/2849159466 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f85c4018a60 con 0x7f85d0104f80 2024-09-19T09:05:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85d8a2a740 1 Processor -- start 2024-09-19T09:05:37.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85d8a2a740 1 -- start start 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91a9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ace91052f0 con 0x55ace91a22e0 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ace90ad270 con 0x55ace91a19a0 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ace91012b0 con 0x55ace91a7370 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85ceffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56684/0 (socket says 172.21.15.1:56684) 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85cf7fe640 1 -- 172.21.15.1:0/1467977994 learned_addr learned my addr 172.21.15.1:0/1467977994 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85ccff9640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f85b80a3240 0x7f85b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85cffff640 1 --2- 172.21.15.1:0/1467977994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.441+0000 7f85cffff640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f85b80a3240 0x7f85b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85cf7fe640 1 -- 172.21.15.1:0/1467977994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 msgr2=0x55ace91a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/1467977994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85cf7fe640 1 -- 172.21.15.1:0/1467977994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 msgr2=0x55ace91a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/1467977994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85ccff9640 1 -- 172.21.15.1:0/2849159466 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f85c40cfa50 con 0x7f85d0104f80 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85cf7fe640 1 -- 172.21.15.1:0/1467977994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ace90ac340 con 0x55ace91a22e0 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/1467977994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91a6da0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f85c000bd40 tx=0x7f85c000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e7035e0982cd9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85cffff640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f85b80a3240 0x7f85b80a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f85c802ade0 tx=0x7f85c80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85b5ffb640 1 -- 172.21.15.1:0/1467977994 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0015070 con 0x55ace91a22e0 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85b5ffb640 1 -- 172.21.15.1:0/1467977994 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85c000be30 con 0x55ace91a22e0 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.442+0000 7f85b5ffb640 1 -- 172.21.15.1:0/1467977994 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0011b40 con 0x55ace91a22e0 2024-09-19T09:05:37.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1467977994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 msgr2=0x55ace91a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/1467977994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91a6da0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f85c000bd40 tx=0x7f85c000f730 comp rx=0 tx=0).stop 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1467977994 shutdown_connections 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/1467977994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/1467977994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91a6da0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/1467977994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1467977994 >> 172.21.15.1:0/1467977994 conn(0x55ace919d010 msgr2=0x55ace919d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1467977994 shutdown_connections 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1467977994 wait complete. 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 -- start start 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.443+0000 7f85d8a2a740 1 Processor -- start 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ace91aa340 con 0x55ace91a22e0 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ace908e290 con 0x55ace91a19a0 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ace91aa4c0 con 0x55ace91a7370 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 10 client.0 _ll_register_callbacks cb 0x55ace90bf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56686/0 (socket says 172.21.15.1:56686) 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 -- 172.21.15.1:0/807417855 learned_addr learned my addr 172.21.15.1:0/807417855 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85cffff640 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 -- 172.21.15.1:0/807417855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 msgr2=0x55ace91b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 -- 172.21.15.1:0/807417855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 msgr2=0x55ace91abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 -- 172.21.15.1:0/807417855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ace8e18210 con 0x55ace91a22e0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85ceffd640 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91ac0d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f85c40984b0 tx=0x7f85c409bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db237fbc82b898d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85aeffd640 1 -- 172.21.15.1:0/807417855 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c40a0400 con 0x55ace91a22e0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85aeffd640 1 -- 172.21.15.1:0/807417855 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f85c400fae0 con 0x55ace91a22e0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 1 -- 172.21.15.1:0/807417855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85c000be30 con 0x55ace91a22e0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85aeffd640 1 -- 172.21.15.1:0/807417855 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f85c40a4cc0 con 0x55ace91a22e0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 10 client.15891 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.444+0000 7f85d8a2a740 1 -- 172.21.15.1:0/807417855 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ace8ee4620 con 0x55ace91a22e0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85aeffd640 1 -- 172.21.15.1:0/807417855 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85c000be30 con 0x55ace91a22e0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85aeffd640 1 -- 172.21.15.1:0/807417855 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f85c4020030 con 0x55ace91a22e0 2024-09-19T09:05:37.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85d8a2a740 10 client.15891 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85d8a2a740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85d8a2a740 20 client.15891 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55ace91b7890 0x55ace91b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85d8a2a740 4 client.15891 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85d8a2a740 1 -- 172.21.15.1:0/807417855 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ace9112a20 con 0x55ace91b7890 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55ace91b7890 0x55ace91b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85aeffd640 10 client.15891 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.445+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55ace91b7890 0x55ace91b9ca0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc556f3ac8c18d3 server_cookie=3f3f8d714dc0bb7c in_seq=0 out_seq=0 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85aeffd640 1 -- 172.21.15.1:0/807417855 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ace9112a20 con 0x55ace91b7890 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85aeffd640 10 client.15891 handle_command_reply: tid=0 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 client.15891 shutdown 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 -- 172.21.15.1:0/807417855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 msgr2=0x55ace91ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.454 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91ac0d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f85c40984b0 tx=0x7f85c409bc50 comp rx=0 tx=0).stop 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 -- 172.21.15.1:0/807417855 shutdown_connections 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55ace91b7890 0x55ace91b9ca0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91ac0d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/807417855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85aeffd640 0 client.15891 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 -- 172.21.15.1:0/807417855 >> 172.21.15.1:0/807417855 conn(0x55ace919d010 msgr2=0x55ace919e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 -- 172.21.15.1:0/807417855 shutdown_connections 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.446+0000 7f85d8a2a740 1 -- 172.21.15.1:0/807417855 wait complete. 2024-09-19T09:05:37.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.447+0000 7f85d8a2a740 20 client.15891 trim_cache size 0 max 16384 2024-09-19T09:05:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85d8a2a740 1 Processor -- start 2024-09-19T09:05:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85d8a2a740 1 -- start start 2024-09-19T09:05:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a22e0 0x55ace91b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a7370 0x55ace919b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f85d01abad0 con 0x55ace91a7370 2024-09-19T09:05:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f85d01a93a0 con 0x55ace91a19a0 2024-09-19T09:05:37.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85d01a71f0 con 0x55ace91a22e0 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a7370 0x55ace919b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a7370 0x55ace919b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56692/0 (socket says 172.21.15.1:56692) 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cffff640 1 -- 172.21.15.1:0/1921617996 learned_addr learned my addr 172.21.15.1:0/1921617996 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cffff640 1 -- 172.21.15.1:0/1921617996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a22e0 msgr2=0x55ace91b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cffff640 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a22e0 0x55ace91b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cffff640 1 -- 172.21.15.1:0/1921617996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 msgr2=0x55ace91a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cffff640 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cffff640 1 -- 172.21.15.1:0/1921617996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ace91a27c0 con 0x55ace91a7370 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.461+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85cffff640 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a7370 0x55ace919b9a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f85c8031f80 tx=0x7f85c803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833b91cd6ad61cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85b57fa640 1 -- 172.21.15.1:0/1921617996 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8042040 con 0x55ace91a7370 2024-09-19T09:05:37.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85b57fa640 1 -- 172.21.15.1:0/1921617996 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85c8036040 con 0x55ace91a7370 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85b57fa640 1 -- 172.21.15.1:0/1921617996 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c802fad0 con 0x55ace91a7370 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1921617996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a7370 msgr2=0x55ace919b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a7370 0x55ace919b9a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f85c8031f80 tx=0x7f85c803a000 comp rx=0 tx=0).stop 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1921617996 shutdown_connections 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a7370 0x55ace919b9a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a22e0 0x55ace91b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/1921617996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1921617996 >> 172.21.15.1:0/1921617996 conn(0x55ace919d010 msgr2=0x55ace91a3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1921617996 shutdown_connections 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.462+0000 7f85d8a2a740 1 -- 172.21.15.1:0/1921617996 wait complete. 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 1 -- start start 2024-09-19T09:05:37.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 1 Processor -- start 2024-09-19T09:05:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f85d01a7860 con 0x55ace91a22e0 2024-09-19T09:05:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f85d01a8cd0 con 0x55ace91a19a0 2024-09-19T09:05:37.468 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85d01a7f30 con 0x55ace91a7370 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85d8a2a740 10 client.0 _ll_register_callbacks cb 0x7f85c400c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85ceffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85ceffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56708/0 (socket says 172.21.15.1:56708) 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85ceffd640 1 -- 172.21.15.1:0/3204353619 learned_addr learned my addr 172.21.15.1:0/3204353619 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.463+0000 7f85cffff640 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85ceffd640 1 -- 172.21.15.1:0/3204353619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 msgr2=0x55ace91b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85ceffd640 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85ceffd640 1 -- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 msgr2=0x55ace91b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85ceffd640 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85ceffd640 1 -- 172.21.15.1:0/3204353619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ace91b2280 con 0x55ace91a22e0 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85ceffd640 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91b0c60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f85c40bc010 tx=0x7f85c409b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3620b2b6610f035 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:37.469 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85aeffd640 1 -- 172.21.15.1:0/3204353619 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c40a0400 con 0x55ace91a22e0 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85aeffd640 1 -- 172.21.15.1:0/3204353619 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f85c409c2b0 con 0x55ace91a22e0 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 1 -- 172.21.15.1:0/3204353619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85c8036040 con 0x55ace91a22e0 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85aeffd640 1 -- 172.21.15.1:0/3204353619 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f85c4080070 con 0x55ace91a22e0 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 10 client.15897 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 1 -- 172.21.15.1:0/3204353619 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ace9222580 con 0x55ace91a22e0 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85aeffd640 1 -- 172.21.15.1:0/3204353619 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85c8036040 con 0x55ace91a22e0 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85aeffd640 1 -- 172.21.15.1:0/3204353619 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f85c4020070 con 0x55ace91a22e0 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 10 client.15897 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 20 client.15897 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55ace9222d70 0x55ace9225190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:37.470 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 4 client.15897 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.464+0000 7f85d8a2a740 1 -- 172.21.15.1:0/3204353619 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ace910cd70 con 0x55ace9222d70 2024-09-19T09:05:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.465+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55ace9222d70 0x55ace9225190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.465+0000 7f85cf7fe640 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55ace9222d70 0x55ace9225190 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea3accc1cc00d7a server_cookie=8c8bc06523dba7e7 in_seq=0 out_seq=0 2024-09-19T09:05:37.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.465+0000 7f85aeffd640 10 client.15897 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:37.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.474+0000 7f85aeffd640 1 -- 172.21.15.1:0/3204353619 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ace910cd70 con 0x55ace9222d70 2024-09-19T09:05:37.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.474+0000 7f85aeffd640 10 client.15897 handle_command_reply: tid=0 2024-09-19T09:05:37.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.474+0000 7f85d8a2a740 1 client.15897 shutdown 2024-09-19T09:05:37.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 -- 172.21.15.1:0/3204353619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 msgr2=0x55ace91b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91b0c60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f85c40bc010 tx=0x7f85c409b4f0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 -- 172.21.15.1:0/3204353619 shutdown_connections 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55ace9222d70 0x55ace9225190 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ace91a7370 0x55ace91b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85aeffd640 0 client.15897 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ace91a22e0 0x55ace91b0c60 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 --2- 172.21.15.1:0/3204353619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ace91a19a0 0x55ace91b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 -- 172.21.15.1:0/3204353619 >> 172.21.15.1:0/3204353619 conn(0x55ace919d010 msgr2=0x55ace91abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 -- 172.21.15.1:0/3204353619 shutdown_connections 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 1 -- 172.21.15.1:0/3204353619 wait complete. 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d8a2a740 20 client.15897 trim_cache size 0 max 16384 2024-09-19T09:05:37.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:05:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:05:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:05:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:05:37.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 -- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f85b80a3240 msgr2=0x7f85b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f85b80a3240 0x7f85b80a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f85c802ade0 tx=0x7f85c80095c0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 -- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d0104f80 msgr2=0x7f85d01984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d0104f80 0x7f85d01984f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c970 tx=0x7f85c400ce30 comp rx=0 tx=0).stop 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 -- 172.21.15.1:0/2849159466 shutdown_connections 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f85b80a3240 0x7f85b80a5700 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85d01078b0 0x7f85d019f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f85d0104f80 0x7f85d01984f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 --2- 172.21.15.1:0/2849159466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85d0102650 0x7f85d0197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.475+0000 7f85d5bb7640 1 -- 172.21.15.1:0/2849159466 >> 172.21.15.1:0/2849159466 conn(0x7f85d00fc1f0 msgr2=0x7f85d0102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.476+0000 7f85d5bb7640 1 -- 172.21.15.1:0/2849159466 shutdown_connections 2024-09-19T09:05:37.478 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:37.476+0000 7f85d5bb7640 1 -- 172.21.15.1:0/2849159466 wait complete. 2024-09-19T09:05:38.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:37 smithi022 ceph-mon[35107]: pgmap v383: 97 pgs: 97 active+clean; 6.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 459 KiB/s wr, 9 op/s 2024-09-19T09:05:38.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:37 smithi001 ceph-mon[30939]: pgmap v383: 97 pgs: 97 active+clean; 6.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 459 KiB/s wr, 9 op/s 2024-09-19T09:05:38.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:37 smithi064 ceph-mon[35179]: pgmap v383: 97 pgs: 97 active+clean; 6.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 459 KiB/s wr, 9 op/s 2024-09-19T09:05:38.358 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:05:38.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:05:38.628 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:39.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.134+0000 7f80fe627640 1 -- 172.21.15.1:0/4270993024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 msgr2=0x7f80f80fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.134+0000 7f80fe627640 1 --2- 172.21.15.1:0/4270993024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 0x7f80f80fffc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009900 tx=0x7f80ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:05:39.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.134+0000 7f80fe627640 1 -- 172.21.15.1:0/4270993024 shutdown_connections 2024-09-19T09:05:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.134+0000 7f80fe627640 1 --2- 172.21.15.1:0/4270993024 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80f8100500 0x7f80f810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.134+0000 7f80fe627640 1 --2- 172.21.15.1:0/4270993024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 0x7f80f80fffc0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.134+0000 7f80fe627640 1 --2- 172.21.15.1:0/4270993024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80f8106b80 0x7f80f8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.134+0000 7f80fe627640 1 -- 172.21.15.1:0/4270993024 >> 172.21.15.1:0/4270993024 conn(0x7f80f80fba90 msgr2=0x7f80f80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 -- 172.21.15.1:0/4270993024 shutdown_connections 2024-09-19T09:05:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 -- 172.21.15.1:0/4270993024 wait complete. 2024-09-19T09:05:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 Processor -- start 2024-09-19T09:05:39.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 -- start start 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 0x7f80f81015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80f8100500 0x7f80f8101b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80f8106b80 0x7f80f8102050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81120c0 con 0x7f80f80ffb60 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.135+0000 7f80fe627640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f80f8111f40 con 0x7f80f8100500 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80fe627640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80f8112240 con 0x7f80f8106b80 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 0x7f80f81015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 0x7f80f81015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56724/0 (socket says 172.21.15.1:56724) 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 -- 172.21.15.1:0/1413429606 learned_addr learned my addr 172.21.15.1:0/1413429606 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:39.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f77fe640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80f8100500 0x7f80f8101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80f8106b80 0x7f80f8102050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 -- 172.21.15.1:0/1413429606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80f8106b80 msgr2=0x7f80f8102050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80f8106b80 0x7f80f8102050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 -- 172.21.15.1:0/1413429606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80f8100500 msgr2=0x7f80f8101b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80f8100500 0x7f80f8101b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 -- 172.21.15.1:0/1413429606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f81a69c0 con 0x7f80f80ffb60 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f7fff640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 0x7f80f81015d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f80e800e9f0 tx=0x7f80e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f57fa640 1 -- 172.21.15.1:0/1413429606 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e800cd80 con 0x7f80f80ffb60 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f57fa640 1 -- 172.21.15.1:0/1413429606 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80e8010930 con 0x7f80f80ffb60 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80f57fa640 1 -- 172.21.15.1:0/1413429606 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8018b00 con 0x7f80f80ffb60 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.136+0000 7f80fe627640 1 -- 172.21.15.1:0/1413429606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f81a6cb0 con 0x7f80f80ffb60 2024-09-19T09:05:39.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.137+0000 7f80fe627640 1 -- 172.21.15.1:0/1413429606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f81a71c0 con 0x7f80f80ffb60 2024-09-19T09:05:39.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.139+0000 7f80f57fa640 1 -- 172.21.15.1:0/1413429606 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f80e8018ca0 con 0x7f80f80ffb60 2024-09-19T09:05:39.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.139+0000 7f8100a00740 1 Processor -- start 2024-09-19T09:05:39.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.139+0000 7f8100a00740 1 -- start start 2024-09-19T09:05:39.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.139+0000 7f8100a00740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d67df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.139+0000 7f8100a00740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d688800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f8100a00740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d68b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f8100a00740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c7d5e3280 con 0x555c7d688d40 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f8100a00740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555c7d58ab10 con 0x555c7d67db60 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f8100a00740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555c7d5df240 con 0x555c7d67e480 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d68b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d688800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f57fa640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80e00a32c0 0x7f80e00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d68b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56740/0 (socket says 172.21.15.1:56740) 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f77fe640 1 -- 172.21.15.1:0/916315116 learned_addr learned my addr 172.21.15.1:0/916315116 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d67df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80e00a32c0 0x7f80e00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f7fff640 1 -- 172.21.15.1:0/916315116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 msgr2=0x555c7d67df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f7fff640 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d67df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f7fff640 1 -- 172.21.15.1:0/916315116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 msgr2=0x555c7d68b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f7fff640 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d68b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f7fff640 1 -- 172.21.15.1:0/916315116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c7d5971f0 con 0x555c7d67e480 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f77fe640 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d68b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f57fa640 1 -- 172.21.15.1:0/1413429606 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f80e80cfc80 con 0x7f80f80ffb60 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.140+0000 7f80f7fff640 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d688800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80e80cd7b0 tx=0x7f80e8018520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=188fd48db35875e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80e00a32c0 0x7f80e00a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009fd0 tx=0x7f80f0005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f80de7fc640 1 -- 172.21.15.1:0/916315116 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e809c980 con 0x555c7d67e480 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f80de7fc640 1 -- 172.21.15.1:0/916315116 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80e809c280 con 0x555c7d67e480 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f80de7fc640 1 -- 172.21.15.1:0/916315116 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e80bc0a0 con 0x555c7d67e480 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 -- 172.21.15.1:0/916315116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 msgr2=0x555c7d688800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d688800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80e80cd7b0 tx=0x7f80e8018520 comp rx=0 tx=0).stop 2024-09-19T09:05:39.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 -- 172.21.15.1:0/916315116 shutdown_connections 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d68b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d688800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 --2- 172.21.15.1:0/916315116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d67df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 -- 172.21.15.1:0/916315116 >> 172.21.15.1:0/916315116 conn(0x555c7d67a0f0 msgr2=0x555c7d67a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 -- 172.21.15.1:0/916315116 shutdown_connections 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.141+0000 7f8100a00740 1 -- 172.21.15.1:0/916315116 wait complete. 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 1 -- start start 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 1 Processor -- start 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 0x555c7d685c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67e480 0x555c7d686150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d686690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c7d68b910 con 0x555c7d688d40 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555c7d59df10 con 0x555c7d67e480 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555c7d68ba90 con 0x555c7d67db60 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f8100a00740 10 client.0 _ll_register_callbacks cb 0x555c7d566a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f80fcbc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d686690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f80fcbc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d686690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56756/0 (socket says 172.21.15.1:56756) 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f80f7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 0x555c7d685c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.142+0000 7f80fcbc4640 1 -- 172.21.15.1:0/1507005087 learned_addr learned my addr 172.21.15.1:0/1507005087 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80f77fe640 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67e480 0x555c7d686150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80fcbc4640 1 -- 172.21.15.1:0/1507005087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 msgr2=0x555c7d685c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 0x555c7d685c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80fcbc4640 1 -- 172.21.15.1:0/1507005087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67e480 msgr2=0x555c7d686150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67e480 0x555c7d686150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80fcbc4640 1 -- 172.21.15.1:0/1507005087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c7d3546a0 con 0x555c7d688d40 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d686690 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f80f00109a0 tx=0x7f80f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d318ed44c6c73b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80d77fe640 1 -- 172.21.15.1:0/1507005087 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0023070 con 0x555c7d688d40 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f8100a00740 1 -- 172.21.15.1:0/1507005087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80e809c280 con 0x555c7d688d40 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80d77fe640 1 -- 172.21.15.1:0/1507005087 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f80f000fb50 con 0x555c7d688d40 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f80d77fe640 1 -- 172.21.15.1:0/1507005087 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80f0010e60 con 0x555c7d688d40 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f8100a00740 10 client.15909 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.143+0000 7f8100a00740 1 -- 172.21.15.1:0/1507005087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555c7d69fe00 con 0x555c7d688d40 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f80d77fe640 1 -- 172.21.15.1:0/1507005087 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80e809c280 con 0x555c7d688d40 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f80d77fe640 1 -- 172.21.15.1:0/1507005087 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f80f001c040 con 0x555c7d688d40 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f8100a00740 10 client.15909 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f8100a00740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:39.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f8100a00740 20 client.15909 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:39.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f8100a00740 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555c7d6a12c0 0x555c7d6a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f8100a00740 4 client.15909 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:39.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f8100a00740 1 -- 172.21.15.1:0/1507005087 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c7d5f07f0 con 0x555c7d6a12c0 2024-09-19T09:05:39.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.144+0000 7f80f7fff640 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555c7d6a12c0 0x555c7d6a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.145+0000 7f80d77fe640 10 client.15909 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:39.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.145+0000 7f80f7fff640 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555c7d6a12c0 0x555c7d6a36b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82172f87f808a64c server_cookie=eca24c73740cf8c0 in_seq=0 out_seq=0 2024-09-19T09:05:39.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.145+0000 7f80d77fe640 1 -- 172.21.15.1:0/1507005087 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c7d5f07f0 con 0x555c7d6a12c0 2024-09-19T09:05:39.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.145+0000 7f80d77fe640 10 client.15909 handle_command_reply: tid=0 2024-09-19T09:05:39.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.145+0000 7f8100a00740 1 client.15909 shutdown 2024-09-19T09:05:39.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.145+0000 7f8100a00740 1 -- 172.21.15.1:0/1507005087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 msgr2=0x555c7d686690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.145+0000 7f8100a00740 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d686690 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f80f00109a0 tx=0x7f80f0004a40 comp rx=0 tx=0).stop 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 1 -- 172.21.15.1:0/1507005087 shutdown_connections 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555c7d6a12c0 0x555c7d6a36b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d686690 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67e480 0x555c7d686150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f80d77fe640 0 client.15909 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 1 --2- 172.21.15.1:0/1507005087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 0x555c7d685c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 1 -- 172.21.15.1:0/1507005087 >> 172.21.15.1:0/1507005087 conn(0x555c7d67a0f0 msgr2=0x555c7d67fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 1 -- 172.21.15.1:0/1507005087 shutdown_connections 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 1 -- 172.21.15.1:0/1507005087 wait complete. 2024-09-19T09:05:39.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.146+0000 7f8100a00740 20 client.15909 trim_cache size 0 max 16384 2024-09-19T09:05:39.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.163+0000 7f8100a00740 1 Processor -- start 2024-09-19T09:05:39.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.163+0000 7f8100a00740 1 -- start start 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.163+0000 7f8100a00740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 0x555c7d687a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.163+0000 7f8100a00740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d67e480 0x555c7d6a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.163+0000 7f8100a00740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d688d40 0x555c7d6a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.163+0000 7f8100a00740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81adfc0 con 0x555c7d67e480 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.163+0000 7f8100a00740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81ab890 con 0x555c7d688d40 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.163+0000 7f8100a00740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81a9720 con 0x555c7d67db60 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d67e480 0x555c7d6a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d67e480 0x555c7d6a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56770/0 (socket says 172.21.15.1:56770) 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 -- 172.21.15.1:0/1139325 learned_addr learned my addr 172.21.15.1:0/1139325 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f7fff640 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 0x555c7d687a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d688d40 0x555c7d6a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 -- 172.21.15.1:0/1139325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 msgr2=0x555c7d687a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 0x555c7d687a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 -- 172.21.15.1:0/1139325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d688d40 msgr2=0x555c7d6a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d688d40 0x555c7d6a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 -- 172.21.15.1:0/1139325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c7d684160 con 0x555c7d67e480 2024-09-19T09:05:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80f77fe640 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d67e480 0x555c7d6a8f60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009900 tx=0x7f80ec0318b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6505ba1921e44618 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80ddffb640 1 -- 172.21.15.1:0/1139325 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec035040 con 0x555c7d67e480 2024-09-19T09:05:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80ddffb640 1 -- 172.21.15.1:0/1139325 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80ec0319a0 con 0x555c7d67e480 2024-09-19T09:05:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.164+0000 7f80ddffb640 1 -- 172.21.15.1:0/1139325 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec004a40 con 0x555c7d67e480 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 -- 172.21.15.1:0/1139325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d67e480 msgr2=0x555c7d6a8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d67e480 0x555c7d6a8f60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009900 tx=0x7f80ec0318b0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 -- 172.21.15.1:0/1139325 shutdown_connections 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d688d40 0x555c7d6a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d67e480 0x555c7d6a8f60 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 --2- 172.21.15.1:0/1139325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67db60 0x555c7d687a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 -- 172.21.15.1:0/1139325 >> 172.21.15.1:0/1139325 conn(0x555c7d67a0f0 msgr2=0x555c7d687360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 -- 172.21.15.1:0/1139325 shutdown_connections 2024-09-19T09:05:39.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 -- 172.21.15.1:0/1139325 wait complete. 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.165+0000 7f8100a00740 1 -- start start 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f8100a00740 1 Processor -- start 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f8100a00740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d695630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f8100a00740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d695b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f8100a00740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d70af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f8100a00740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81a9d70 con 0x555c7d688d40 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f8100a00740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81ab1c0 con 0x555c7d67db60 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f8100a00740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81aa420 con 0x555c7d67e480 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f8100a00740 10 client.0 _ll_register_callbacks cb 0x7f80f0012f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d695630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80fcbc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d70af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80f7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d695630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:48490/0 (socket says 172.21.15.1:48490) 2024-09-19T09:05:39.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80f7fff640 1 -- 172.21.15.1:0/510799357 learned_addr learned my addr 172.21.15.1:0/510799357 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80f77fe640 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d695b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80fcbc4640 1 -- 172.21.15.1:0/510799357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 msgr2=0x555c7d695b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d695b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80fcbc4640 1 -- 172.21.15.1:0/510799357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 msgr2=0x555c7d695630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d695630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80fcbc4640 1 -- 172.21.15.1:0/510799357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c7d696400 con 0x555c7d688d40 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.166+0000 7f80f7fff640 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d695630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f80fcbc4640 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d70af30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f80f00325d0 tx=0x7f80f0032a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d15c8d80e133792 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f80d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f80d77fe640 1 -- 172.21.15.1:0/510799357 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0023030 con 0x555c7d688d40 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f80d77fe640 1 -- 172.21.15.1:0/510799357 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f80f000fb50 con 0x555c7d688d40 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 1 -- 172.21.15.1:0/510799357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80ec0319a0 con 0x555c7d688d40 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f80d77fe640 1 -- 172.21.15.1:0/510799357 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80f0010520 con 0x555c7d688d40 2024-09-19T09:05:39.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 10 client.15915 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 1 -- 172.21.15.1:0/510799357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555c7d70c580 con 0x555c7d688d40 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f80d77fe640 1 -- 172.21.15.1:0/510799357 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80ec0319a0 con 0x555c7d688d40 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f80d77fe640 1 -- 172.21.15.1:0/510799357 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f80f001fc50 con 0x555c7d688d40 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 10 client.15915 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 20 client.15915 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555c7d70cc40 0x555c7d70f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 4 client.15915 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.167+0000 7f8100a00740 1 -- 172.21.15.1:0/510799357 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555c7d5ead00 con 0x555c7d70cc40 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.168+0000 7f80f7fff640 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555c7d70cc40 0x555c7d70f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.168+0000 7f80f7fff640 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555c7d70cc40 0x555c7d70f060 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a49549fc78064e80 server_cookie=9e40677cb3954f01 in_seq=0 out_seq=0 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.168+0000 7f80d77fe640 10 client.15915 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:39.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f80d77fe640 1 -- 172.21.15.1:0/510799357 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555c7d5ead00 con 0x555c7d70cc40 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f80d77fe640 10 client.15915 handle_command_reply: tid=0 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 client.15915 shutdown 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 -- 172.21.15.1:0/510799357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 msgr2=0x555c7d70af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d70af30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f80f00325d0 tx=0x7f80f0032a50 comp rx=0 tx=0).stop 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 -- 172.21.15.1:0/510799357 shutdown_connections 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555c7d70cc40 0x555c7d70f060 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c7d688d40 0x555c7d70af30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555c7d67e480 0x555c7d695b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 --2- 172.21.15.1:0/510799357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c7d67db60 0x555c7d695630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 -- 172.21.15.1:0/510799357 >> 172.21.15.1:0/510799357 conn(0x555c7d67a0f0 msgr2=0x555c7d69cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f80d77fe640 0 client.15915 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.169+0000 7f8100a00740 1 -- 172.21.15.1:0/510799357 shutdown_connections 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f8100a00740 1 -- 172.21.15.1:0/510799357 wait complete. 2024-09-19T09:05:39.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f8100a00740 20 client.15915 trim_cache size 0 max 16384 2024-09-19T09:05:39.176 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:39.176 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:05:39.176 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "923035e4-4b45-4b6b-a999-f2aa41f46121", 2024-09-19T09:05:39.176 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:05:39.176 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 -- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80e00a32c0 msgr2=0x7f80e00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80e00a32c0 0x7f80e00a5780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009fd0 tx=0x7f80f0005bd0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 -- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 msgr2=0x7f80f81015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 0x7f80f81015d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f80e800e9f0 tx=0x7f80e800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 -- 172.21.15.1:0/1413429606 shutdown_connections 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f80e00a32c0 0x7f80e00a5780 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f80f8106b80 0x7f80f8102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80f8100500 0x7f80f8101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 --2- 172.21.15.1:0/1413429606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80f80ffb60 0x7f80f81015d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:39.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 -- 172.21.15.1:0/1413429606 >> 172.21.15.1:0/1413429606 conn(0x7f80f80fba90 msgr2=0x7f80f80fc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:39.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 -- 172.21.15.1:0/1413429606 shutdown_connections 2024-09-19T09:05:39.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:39.170+0000 7f80fe627640 1 -- 172.21.15.1:0/1413429606 wait complete. 2024-09-19T09:05:40.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:39 smithi022 ceph-mon[35107]: pgmap v384: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 459 KiB/s wr, 7 op/s 2024-09-19T09:05:40.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:39 smithi022 ceph-mon[35107]: scrub queued for path: / 2024-09-19T09:05:40.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:39 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:40.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:39 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:05:40.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:39 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:40.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:39 smithi001 ceph-mon[30939]: pgmap v384: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 459 KiB/s wr, 7 op/s 2024-09-19T09:05:40.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:39 smithi001 ceph-mon[30939]: scrub queued for path: / 2024-09-19T09:05:40.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:39 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:40.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:39 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:05:40.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:39 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:40.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:39 smithi064 ceph-mon[35179]: pgmap v384: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 459 KiB/s wr, 7 op/s 2024-09-19T09:05:40.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:39 smithi064 ceph-mon[35179]: scrub queued for path: / 2024-09-19T09:05:40.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:39 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:40.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:39 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:05:40.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:39 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:05:41.665 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:05:41.930 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:41 smithi001 ceph-mon[30939]: pgmap v385: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 461 KiB/s wr, 12 op/s 2024-09-19T09:05:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:41 smithi022 ceph-mon[35107]: pgmap v385: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 461 KiB/s wr, 12 op/s 2024-09-19T09:05:42.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:41 smithi064 ceph-mon[35179]: pgmap v385: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 461 KiB/s wr, 12 op/s 2024-09-19T09:05:42.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 -- 172.21.15.1:0/1078174801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528102d40 msgr2=0x7f9528103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 --2- 172.21.15.1:0/1078174801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528102d40 0x7f9528103120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9518009900 tx=0x7f951802a480 comp rx=0 tx=0).stop 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 -- 172.21.15.1:0/1078174801 shutdown_connections 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 --2- 172.21.15.1:0/1078174801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f952810c170 0x7f952810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 --2- 172.21.15.1:0/1078174801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9528103660 0x7f952810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 --2- 172.21.15.1:0/1078174801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528102d40 0x7f9528103120 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 -- 172.21.15.1:0/1078174801 >> 172.21.15.1:0/1078174801 conn(0x7f95280fc7a0 msgr2=0x7f95280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 -- 172.21.15.1:0/1078174801 shutdown_connections 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.409+0000 7f952cd95640 1 -- 172.21.15.1:0/1078174801 wait complete. 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.410+0000 7f952cd95640 1 Processor -- start 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.410+0000 7f952cd95640 1 -- start start 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952cd95640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9528102d40 0x7f952819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952cd95640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528103660 0x7f952819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952cd95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952810c170 0x7f952819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952cd95640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9528112090 con 0x7f9528103660 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952cd95640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9528111f10 con 0x7f952810c170 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952cd95640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9528112210 con 0x7f9528102d40 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528103660 0x7f952819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528103660 0x7f952819ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56800/0 (socket says 172.21.15.1:56800) 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 -- 172.21.15.1:0/293272203 learned_addr learned my addr 172.21.15.1:0/293272203 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952659c640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9528102d40 0x7f952819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9526d9d640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952810c170 0x7f952819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 -- 172.21.15.1:0/293272203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9528102d40 msgr2=0x7f952819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9528102d40 0x7f952819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 -- 172.21.15.1:0/293272203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952810c170 msgr2=0x7f952819f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952810c170 0x7f952819f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 -- 172.21.15.1:0/293272203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952819f700 con 0x7f9528103660 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9526d9d640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952810c170 0x7f952819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f9525d9b640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528103660 0x7f952819ac90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f951c00d740 tx=0x7f951c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f95177fe640 1 -- 172.21.15.1:0/293272203 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c017070 con 0x7f9528103660 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f95177fe640 1 -- 172.21.15.1:0/293272203 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f951c00de50 con 0x7f9528103660 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952cd95640 1 -- 172.21.15.1:0/293272203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952819f9f0 con 0x7f9528103660 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f95177fe640 1 -- 172.21.15.1:0/293272203 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c00f620 con 0x7f9528103660 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.411+0000 7f952cd95640 1 -- 172.21.15.1:0/293272203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95281a72d0 con 0x7f9528103660 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f95177fe640 1 -- 172.21.15.1:0/293272203 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f951c009c30 con 0x7f9528103660 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f952f16e740 1 Processor -- start 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f952f16e740 1 -- start start 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f952f16e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a15880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f952f16e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a20140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f952f16e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a22a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f952f16e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e4b397b2e0 con 0x55e4b3a20680 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f952f16e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e4b3922ce0 con 0x55e4b3a15dc0 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.414+0000 7f952f16e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e4b39772a0 con 0x55e4b3a154a0 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f9525d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a22a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a20140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a20140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:48520/0 (socket says 172.21.15.1:48520) 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 -- 172.21.15.1:0/20536428 learned_addr learned my addr 172.21.15.1:0/20536428 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f9526d9d640 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a15880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f95177fe640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95100a32c0 0x7f95100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 -- 172.21.15.1:0/20536428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 msgr2=0x55e4b3a15880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a15880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 -- 172.21.15.1:0/20536428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 msgr2=0x55e4b3a22a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:42.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a22a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 -- 172.21.15.1:0/20536428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b3907440 con 0x55e4b3a15dc0 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f9525d9b640 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a22a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f9526d9d640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95100a32c0 0x7f95100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f95177fe640 1 -- 172.21.15.1:0/293272203 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f951c0cf600 con 0x7f9528103660 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.415+0000 7f952659c640 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a20140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9518033000 tx=0x7f9518032d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6732c7be50e5a905 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f9526d9d640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95100a32c0 0x7f95100a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9520005fd0 tx=0x7f9520004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f9514ff9640 1 -- 172.21.15.1:0/20536428 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951803f070 con 0x55e4b3a15dc0 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f9514ff9640 1 -- 172.21.15.1:0/20536428 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9518032e50 con 0x55e4b3a15dc0 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f9514ff9640 1 -- 172.21.15.1:0/20536428 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518035070 con 0x55e4b3a15dc0 2024-09-19T09:05:42.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f952f16e740 1 -- 172.21.15.1:0/20536428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 msgr2=0x55e4b3a20140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f952f16e740 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a20140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9518033000 tx=0x7f9518032d30 comp rx=0 tx=0).stop 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f952f16e740 1 -- 172.21.15.1:0/20536428 shutdown_connections 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f952f16e740 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a22a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f952f16e740 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a20140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f952f16e740 1 --2- 172.21.15.1:0/20536428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a15880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.416+0000 7f952f16e740 1 -- 172.21.15.1:0/20536428 >> 172.21.15.1:0/20536428 conn(0x55e4b3a11a30 msgr2=0x55e4b3a11e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 -- 172.21.15.1:0/20536428 shutdown_connections 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 -- 172.21.15.1:0/20536428 wait complete. 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 -- start start 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 Processor -- start 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a1ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a1d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e4b3a23250 con 0x55e4b3a20680 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e4b3936050 con 0x55e4b3a15dc0 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e4b3a233d0 con 0x55e4b3a154a0 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f952f16e740 10 client.0 _ll_register_callbacks cb 0x55e4b3976160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f9526d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a1d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f9526d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a1d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56826/0 (socket says 172.21.15.1:56826) 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f9526d9d640 1 -- 172.21.15.1:0/3162826630 learned_addr learned my addr 172.21.15.1:0/3162826630 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.417+0000 7f9525d9b640 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f952659c640 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a1ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f9526d9d640 1 -- 172.21.15.1:0/3162826630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 msgr2=0x55e4b3a1ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f9526d9d640 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a1ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f9526d9d640 1 -- 172.21.15.1:0/3162826630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 msgr2=0x55e4b3a1d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:42.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f9526d9d640 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f9526d9d640 1 -- 172.21.15.1:0/3162826630 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4b36ec3c0 con 0x55e4b3a20680 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f952659c640 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a1ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f9526d9d640 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a1d7e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f952001ce40 tx=0x7f9520004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4942fadb73bc27b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f950dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f950dffb640 1 -- 172.21.15.1:0/3162826630 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520029060 con 0x55e4b3a20680 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f952f16e740 1 -- 172.21.15.1:0/3162826630 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9518032e50 con 0x55e4b3a20680 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f950dffb640 1 -- 172.21.15.1:0/3162826630 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9520019620 con 0x55e4b3a20680 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f950dffb640 1 -- 172.21.15.1:0/3162826630 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9520012e60 con 0x55e4b3a20680 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f952f16e740 10 client.15927 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.418+0000 7f952f16e740 1 -- 172.21.15.1:0/3162826630 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e4b3a2ecd0 con 0x55e4b3a20680 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f950dffb640 1 -- 172.21.15.1:0/3162826630 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9518032e50 con 0x55e4b3a20680 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f950dffb640 1 -- 172.21.15.1:0/3162826630 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9520024930 con 0x55e4b3a20680 2024-09-19T09:05:42.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f952f16e740 10 client.15927 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f952f16e740 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f952f16e740 20 client.15927 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f952f16e740 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e4b3a30190 0x55e4b3a325e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f952f16e740 4 client.15927 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f952f16e740 1 -- 172.21.15.1:0/3162826630 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4b3988850 con 0x55e4b3a30190 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f952659c640 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e4b3a30190 0x55e4b3a325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f950dffb640 10 client.15927 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.419+0000 7f952659c640 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e4b3a30190 0x55e4b3a325e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49679ac13c24d0ae server_cookie=6c999942fdd54e02 in_seq=0 out_seq=0 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f950dffb640 1 -- 172.21.15.1:0/3162826630 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4b3988850 con 0x55e4b3a30190 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f950dffb640 10 client.15927 handle_command_reply: tid=0 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 client.15927 shutdown 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 -- 172.21.15.1:0/3162826630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 msgr2=0x55e4b3a1d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a1d7e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f952001ce40 tx=0x7f9520004ab0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 -- 172.21.15.1:0/3162826630 shutdown_connections 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e4b3a30190 0x55e4b3a325e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a20680 0x55e4b3a1d7e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f950dffb640 0 client.15927 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 --2- 172.21.15.1:0/3162826630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a1ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 -- 172.21.15.1:0/3162826630 >> 172.21.15.1:0/3162826630 conn(0x55e4b3a11a30 msgr2=0x55e4b3a17710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 -- 172.21.15.1:0/3162826630 shutdown_connections 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.420+0000 7f952f16e740 1 -- 172.21.15.1:0/3162826630 wait complete. 2024-09-19T09:05:42.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.421+0000 7f952f16e740 20 client.15927 trim_cache size 0 max 16384 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952f16e740 1 Processor -- start 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952f16e740 1 -- start start 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952f16e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a2c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952f16e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952f16e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952f16e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95281b2180 con 0x55e4b3a15dc0 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952f16e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f95281afa50 con 0x55e4b3a20680 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952f16e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f95281ad8a0 con 0x55e4b3a154a0 2024-09-19T09:05:42.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9525d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9525d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41822/0 (socket says 172.21.15.1:41822) 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9525d9b640 1 -- 172.21.15.1:0/3690442038 learned_addr learned my addr 172.21.15.1:0/3690442038 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9525d9b640 1 -- 172.21.15.1:0/3690442038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 msgr2=0x55e4b3a2c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952659c640 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a2c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9526d9d640 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9525d9b640 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a2c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9525d9b640 1 -- 172.21.15.1:0/3690442038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 msgr2=0x55e4b3a1f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9525d9b640 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9525d9b640 1 -- 172.21.15.1:0/3690442038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b3a20340 con 0x55e4b3a15dc0 2024-09-19T09:05:42.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f952659c640 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a2c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:42.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.438+0000 7f9526d9d640 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:42.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f9525d9b640 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d240 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f951c000c00 tx=0x7f951c0d5550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6942cb3d9c85ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:42.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f950ffff640 1 -- 172.21.15.1:0/3690442038 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c020040 con 0x55e4b3a15dc0 2024-09-19T09:05:42.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f950ffff640 1 -- 172.21.15.1:0/3690442038 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f951c0a4870 con 0x55e4b3a15dc0 2024-09-19T09:05:42.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f950ffff640 1 -- 172.21.15.1:0/3690442038 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c097950 con 0x55e4b3a15dc0 2024-09-19T09:05:42.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f952f16e740 1 -- 172.21.15.1:0/3690442038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 msgr2=0x55e4b3a1d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f952f16e740 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d240 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f951c000c00 tx=0x7f951c0d5550 comp rx=0 tx=0).stop 2024-09-19T09:05:42.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f952f16e740 1 -- 172.21.15.1:0/3690442038 shutdown_connections 2024-09-19T09:05:42.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f952f16e740 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f952f16e740 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1d240 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f952f16e740 1 --2- 172.21.15.1:0/3690442038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a2c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.439+0000 7f952f16e740 1 -- 172.21.15.1:0/3690442038 >> 172.21.15.1:0/3690442038 conn(0x55e4b3a11a30 msgr2=0x55e4b3a1eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 -- 172.21.15.1:0/3690442038 shutdown_connections 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 -- 172.21.15.1:0/3690442038 wait complete. 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 -- start start 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 Processor -- start 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a28df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95281adf10 con 0x55e4b3a15dc0 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f95281af380 con 0x55e4b3a20680 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f95281ae5e0 con 0x55e4b3a154a0 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f952f16e740 10 client.0 _ll_register_callbacks cb 0x7f9520008ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:42.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f9525d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f9525d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41832/0 (socket says 172.21.15.1:41832) 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.440+0000 7f9525d9b640 1 -- 172.21.15.1:0/4076501840 learned_addr learned my addr 172.21.15.1:0/4076501840 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f9526d9d640 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f952659c640 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a28df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f9525d9b640 1 -- 172.21.15.1:0/4076501840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 msgr2=0x55e4b3a28df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f9525d9b640 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a28df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f9525d9b640 1 -- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 msgr2=0x55e4b3a1a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f9525d9b640 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f9525d9b640 1 -- 172.21.15.1:0/4076501840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4b3a1ae10 con 0x55e4b3a15dc0 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f9526d9d640 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f9525d9b640 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1a040 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f951c009610 tx=0x7f951c0d53a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b7b9a1cb1aed5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f950dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:42.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f950dffb640 1 -- 172.21.15.1:0/4076501840 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c099fc0 con 0x55e4b3a15dc0 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f950dffb640 1 -- 172.21.15.1:0/4076501840 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f951c09b050 con 0x55e4b3a15dc0 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f952f16e740 1 -- 172.21.15.1:0/4076501840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f951c0a4870 con 0x55e4b3a15dc0 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f950dffb640 1 -- 172.21.15.1:0/4076501840 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f951c09b250 con 0x55e4b3a15dc0 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f952f16e740 10 client.15933 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f952f16e740 1 -- 172.21.15.1:0/4076501840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e4b3a9aed0 con 0x55e4b3a15dc0 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.441+0000 7f950dffb640 1 -- 172.21.15.1:0/4076501840 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f951c0a4870 con 0x55e4b3a15dc0 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f950dffb640 1 -- 172.21.15.1:0/4076501840 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f951c0cf0c0 con 0x55e4b3a15dc0 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952f16e740 10 client.15933 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952f16e740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952f16e740 20 client.15933 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952f16e740 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e4b3a9b540 0x55e4b3a9d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952f16e740 4 client.15933 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:05:42.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952f16e740 1 -- 172.21.15.1:0/4076501840 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e4b3982d60 con 0x55e4b3a9b540 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952659c640 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e4b3a9b540 0x55e4b3a9d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952659c640 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e4b3a9b540 0x55e4b3a9d960 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cda93c960cefa8ce server_cookie=73eb271a56fd9c4f in_seq=0 out_seq=0 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f950dffb640 10 client.15933 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f950dffb640 1 -- 172.21.15.1:0/4076501840 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e4b3982d60 con 0x55e4b3a9b540 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f950dffb640 10 client.15933 handle_command_reply: tid=0 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.442+0000 7f952f16e740 1 client.15933 shutdown 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 -- 172.21.15.1:0/4076501840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 msgr2=0x55e4b3a1a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1a040 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f951c009610 tx=0x7f951c0d53a0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 -- 172.21.15.1:0/4076501840 shutdown_connections 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55e4b3a9b540 0x55e4b3a9d960 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e4b3a20680 0x55e4b3a1a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e4b3a15dc0 0x55e4b3a1a040 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f950dffb640 0 client.15933 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:42.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 --2- 172.21.15.1:0/4076501840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e4b3a154a0 0x55e4b3a28df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 -- 172.21.15.1:0/4076501840 >> 172.21.15.1:0/4076501840 conn(0x55e4b3a11a30 msgr2=0x55e4b3a10b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:42.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 -- 172.21.15.1:0/4076501840 shutdown_connections 2024-09-19T09:05:42.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 1 -- 172.21.15.1:0/4076501840 wait complete. 2024-09-19T09:05:42.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952f16e740 20 client.15933 trim_cache size 0 max 16384 2024-09-19T09:05:42.450 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:42.450 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:05:42.450 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:05:42.451 INFO:teuthology.orchestra.run.smithi001.stdout: "923035e4-4b45-4b6b-a999-f2aa41f46121": { 2024-09-19T09:05:42.451 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:05:42.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "923035e4-4b45-4b6b-a999-f2aa41f46121", 2024-09-19T09:05:42.451 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:05:42.451 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:42.451 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:42.451 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:42.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952cd95640 1 -- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95100a32c0 msgr2=0x7f95100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952cd95640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95100a32c0 0x7f95100a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9520005fd0 tx=0x7f9520004a40 comp rx=0 tx=0).stop 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952cd95640 1 -- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528103660 msgr2=0x7f952819ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.443+0000 7f952cd95640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528103660 0x7f952819ac90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f951c00d740 tx=0x7f951c00dc00 comp rx=0 tx=0).stop 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.444+0000 7f952cd95640 1 -- 172.21.15.1:0/293272203 shutdown_connections 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.444+0000 7f952cd95640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f952810c170 0x7f952819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.444+0000 7f952cd95640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9528103660 0x7f952819ac90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.444+0000 7f952cd95640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95100a32c0 0x7f95100a5780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.444+0000 7f952cd95640 1 --2- 172.21.15.1:0/293272203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9528102d40 0x7f952819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.444+0000 7f952cd95640 1 -- 172.21.15.1:0/293272203 >> 172.21.15.1:0/293272203 conn(0x7f95280fc7a0 msgr2=0x7f952810d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.444+0000 7f952cd95640 1 -- 172.21.15.1:0/293272203 shutdown_connections 2024-09-19T09:05:42.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:42.444+0000 7f952cd95640 1 -- 172.21.15.1:0/293272203 wait complete. 2024-09-19T09:05:43.129 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:42 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:05:43.157 INFO:tasks.cephfs.filesystem:scrub status for tag:923035e4-4b45-4b6b-a999-f2aa41f46121 - {'path': '/', 'tag': '923035e4-4b45-4b6b-a999-f2aa41f46121', 'options': 'recursive,force'} 2024-09-19T09:05:43.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:42 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:05:43.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:42 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:05:44.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:43 smithi022 ceph-mon[35107]: pgmap v386: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 460 KiB/s wr, 9 op/s 2024-09-19T09:05:44.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:43 smithi001 ceph-mon[30939]: pgmap v386: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 460 KiB/s wr, 9 op/s 2024-09-19T09:05:44.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:43 smithi064 ceph-mon[35179]: pgmap v386: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 460 KiB/s wr, 9 op/s 2024-09-19T09:05:46.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:45 smithi022 ceph-mon[35107]: pgmap v387: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 460 KiB/s wr, 9 op/s 2024-09-19T09:05:46.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:45 smithi001 ceph-mon[30939]: pgmap v387: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 460 KiB/s wr, 9 op/s 2024-09-19T09:05:46.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:45 smithi064 ceph-mon[35179]: pgmap v387: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 460 KiB/s wr, 9 op/s 2024-09-19T09:05:48.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:47 smithi022 ceph-mon[35107]: pgmap v388: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 344 KiB/s wr, 11 op/s 2024-09-19T09:05:48.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:47 smithi001 ceph-mon[30939]: pgmap v388: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 344 KiB/s wr, 11 op/s 2024-09-19T09:05:48.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:47 smithi064 ceph-mon[35179]: pgmap v388: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 344 KiB/s wr, 11 op/s 2024-09-19T09:05:48.386 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:48.659 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:49.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.140+0000 7f916a8eb640 1 -- 172.21.15.1:0/3198090443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 msgr2=0x7f916410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.140+0000 7f916a8eb640 1 --2- 172.21.15.1:0/3198090443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 0x7f916410da40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f915c009ca0 tx=0x7f915c02a950 comp rx=0 tx=0).stop 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 -- 172.21.15.1:0/3198090443 shutdown_connections 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 --2- 172.21.15.1:0/3198090443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 0x7f916410da40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 --2- 172.21.15.1:0/3198090443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9164102570 0x7f91641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 --2- 172.21.15.1:0/3198090443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9164100e20 0x7f9164101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 -- 172.21.15.1:0/3198090443 >> 172.21.15.1:0/3198090443 conn(0x7f91640fc7d0 msgr2=0x7f91640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 -- 172.21.15.1:0/3198090443 shutdown_connections 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 -- 172.21.15.1:0/3198090443 wait complete. 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 Processor -- start 2024-09-19T09:05:49.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.141+0000 7f916a8eb640 1 -- start start 2024-09-19T09:05:49.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f916a8eb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9164100e20 0x7f9164198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f916a8eb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9164102570 0x7f9164198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f916a8eb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 0x7f916419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f916a8eb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9164111160 con 0x7f9164102ef0 2024-09-19T09:05:49.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f916a8eb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9164110fe0 con 0x7f9164100e20 2024-09-19T09:05:49.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f916a8eb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f91641112e0 con 0x7f9164102570 2024-09-19T09:05:49.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9168e88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 0x7f916419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9168e88640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 0x7f916419cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41860/0 (socket says 172.21.15.1:41860) 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9168e88640 1 -- 172.21.15.1:0/649902199 learned_addr learned my addr 172.21.15.1:0/649902199 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9163fff640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9164100e20 0x7f9164198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f91637fe640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9164102570 0x7f9164198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9168e88640 1 -- 172.21.15.1:0/649902199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9164102570 msgr2=0x7f9164198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9168e88640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9164102570 0x7f9164198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9168e88640 1 -- 172.21.15.1:0/649902199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9164100e20 msgr2=0x7f9164198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9168e88640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9164100e20 0x7f9164198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9168e88640 1 -- 172.21.15.1:0/649902199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916419d5f0 con 0x7f9164102ef0 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f91637fe640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9164102570 0x7f9164198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.142+0000 7f9163fff640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9164100e20 0x7f9164198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.143+0000 7f9168e88640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 0x7f916419cf10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f915c005cc0 tx=0x7f915c030e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.143+0000 7f91617fa640 1 -- 172.21.15.1:0/649902199 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c034040 con 0x7f9164102ef0 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.143+0000 7f91617fa640 1 -- 172.21.15.1:0/649902199 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f915c030940 con 0x7f9164102ef0 2024-09-19T09:05:49.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.143+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916419d880 con 0x7f9164102ef0 2024-09-19T09:05:49.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.143+0000 7f91617fa640 1 -- 172.21.15.1:0/649902199 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c045480 con 0x7f9164102ef0 2024-09-19T09:05:49.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.143+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91641a51c0 con 0x7f9164102ef0 2024-09-19T09:05:49.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.144+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9164101200 con 0x7f9164102ef0 2024-09-19T09:05:49.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.145+0000 7f91617fa640 1 -- 172.21.15.1:0/649902199 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f915c037020 con 0x7f9164102ef0 2024-09-19T09:05:49.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.146+0000 7f91617fa640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f914c0a3240 0x7f914c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:49.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.146+0000 7f91617fa640 1 -- 172.21.15.1:0/649902199 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f915c0f0d00 con 0x7f9164102ef0 2024-09-19T09:05:49.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.146+0000 7f9163fff640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f914c0a3240 0x7f914c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:49.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.146+0000 7f9163fff640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f914c0a3240 0x7f914c0a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9154009d60 tx=0x7f9154009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:49.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.149+0000 7f91617fa640 1 -- 172.21.15.1:0/649902199 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f915c081210 con 0x7f9164102ef0 2024-09-19T09:05:49.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.359+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f916410a0a0 con 0x7f9164102ef0 2024-09-19T09:05:49.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.359+0000 7f91617fa640 1 -- 172.21.15.1:0/649902199 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f915c0bd9a0 con 0x7f9164102ef0 2024-09-19T09:05:49.360 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:05:49.360 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:05:49.360 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.361+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f914c0a3240 msgr2=0x7f914c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.361+0000 7f916a8eb640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f914c0a3240 0x7f914c0a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9154009d60 tx=0x7f9154009110 comp rx=0 tx=0).stop 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 msgr2=0x7f916419cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 0x7f916419cf10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f915c005cc0 tx=0x7f915c030e30 comp rx=0 tx=0).stop 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 shutdown_connections 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9164102ef0 0x7f916419cf10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f914c0a3240 0x7f914c0a5700 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9164102570 0x7f9164198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 --2- 172.21.15.1:0/649902199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9164100e20 0x7f9164198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:49.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 >> 172.21.15.1:0/649902199 conn(0x7f91640fc7d0 msgr2=0x7f916406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:49.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 shutdown_connections 2024-09-19T09:05:49.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:49.362+0000 7f916a8eb640 1 -- 172.21.15.1:0/649902199 wait complete. 2024-09-19T09:05:50.020 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db --set-id fd640c30 --release --await' 2024-09-19T09:05:50.020 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db --set-id fd640c30 --release --await 2024-09-19T09:05:50.045 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:49 smithi001 ceph-mon[30939]: pgmap v389: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-19T09:05:50.045 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:49 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/649902199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:50.158 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:49 smithi064 ceph-mon[35179]: pgmap v389: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-19T09:05:50.158 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:49 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/649902199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:50.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:49 smithi022 ceph-mon[35107]: pgmap v389: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-19T09:05:50.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:49 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/649902199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:50.280 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 -- 172.21.15.1:0/1757045842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 msgr2=0x7fef34107360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/1757045842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 0x7fef34107360 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fef24009900 tx=0x7fef2402a410 comp rx=0 tx=0).stop 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 -- 172.21.15.1:0/1757045842 shutdown_connections 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/1757045842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef341078a0 0x7fef34109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/1757045842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 0x7fef34107360 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/1757045842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef34102640 0x7fef34104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 -- 172.21.15.1:0/1757045842 >> 172.21.15.1:0/1757045842 conn(0x7fef340fc1c0 msgr2=0x7fef340fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 -- 172.21.15.1:0/1757045842 shutdown_connections 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.567+0000 7fef3c1e4640 1 -- 172.21.15.1:0/1757045842 wait complete. 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3c1e4640 1 Processor -- start 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3c1e4640 1 -- start start 2024-09-19T09:05:50.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3c1e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef34102640 0x7fef34197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3c1e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 0x7fef34198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3c1e4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef341078a0 0x7fef3419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3c1e4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fef3410d910 con 0x7fef34104f70 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3c1e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef3410d790 con 0x7fef34102640 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3c1e4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fef3410da90 con 0x7fef341078a0 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 0x7fef34198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 0x7fef34198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41876/0 (socket says 172.21.15.1:41876) 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 -- 172.21.15.1:0/3866003408 learned_addr learned my addr 172.21.15.1:0/3866003408 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef39f80640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef34102640 0x7fef34197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3a781640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef341078a0 0x7fef3419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 -- 172.21.15.1:0/3866003408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef341078a0 msgr2=0x7fef3419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef341078a0 0x7fef3419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 -- 172.21.15.1:0/3866003408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef34102640 msgr2=0x7fef34197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef34102640 0x7fef34197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 -- 172.21.15.1:0/3866003408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3419fb40 con 0x7fef34104f70 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3a781640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef341078a0 0x7fef3419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.568+0000 7fef3977f640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 0x7fef34198460 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fef24005ab0 tx=0x7fef240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.569+0000 7fef2affd640 1 -- 172.21.15.1:0/3866003408 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2403f030 con 0x7fef34104f70 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.569+0000 7fef2affd640 1 -- 172.21.15.1:0/3866003408 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef24003d00 con 0x7fef34104f70 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.569+0000 7fef3c1e4640 1 -- 172.21.15.1:0/3866003408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3419fdd0 con 0x7fef34104f70 2024-09-19T09:05:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.569+0000 7fef2affd640 1 -- 172.21.15.1:0/3866003408 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24035070 con 0x7fef34104f70 2024-09-19T09:05:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.569+0000 7fef3c1e4640 1 -- 172.21.15.1:0/3866003408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef341a0280 con 0x7fef34104f70 2024-09-19T09:05:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.571+0000 7fef2affd640 1 -- 172.21.15.1:0/3866003408 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fef24042030 con 0x7fef34104f70 2024-09-19T09:05:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.571+0000 7fef3f05b740 1 Processor -- start 2024-09-19T09:05:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3f05b740 1 -- start start 2024-09-19T09:05:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a32733bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327340da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a327343830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3f05b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a32729f2f0 con 0x55a327341370 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3f05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a327247270 con 0x55a32733c2e0 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3f05b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a32729b2b0 con 0x55a32733b9a0 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3977f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a327343830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3977f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a327343830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41884/0 (socket says 172.21.15.1:41884) 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3977f640 1 -- 172.21.15.1:0/3700286998 learned_addr learned my addr 172.21.15.1:0/3700286998 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3a781640 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a32733bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef39f80640 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327340da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3977f640 1 -- 172.21.15.1:0/3700286998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 msgr2=0x55a32733bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3977f640 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a32733bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3977f640 1 -- 172.21.15.1:0/3700286998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 msgr2=0x55a327340da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3977f640 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327340da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.572+0000 7fef3977f640 1 -- 172.21.15.1:0/3700286998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a327246340 con 0x55a327341370 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.573+0000 7fef2affd640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fef200a32c0 0x7fef200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.573+0000 7fef3977f640 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a327343830 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fef240f8160 tx=0x7fef240f8250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b631c48a234282 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.573+0000 7fef3a781640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fef200a32c0 0x7fef200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.573+0000 7fef2affd640 1 -- 172.21.15.1:0/3866003408 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fef240eff20 con 0x7fef34104f70 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.573+0000 7fef1ffff640 1 -- 172.21.15.1:0/3700286998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240b87c0 con 0x55a327341370 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.573+0000 7fef1ffff640 1 -- 172.21.15.1:0/3700286998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef240fd070 con 0x55a327341370 2024-09-19T09:05:50.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.573+0000 7fef1ffff640 1 -- 172.21.15.1:0/3700286998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240bbe80 con 0x55a327341370 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 -- 172.21.15.1:0/3700286998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 msgr2=0x55a327343830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3a781640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fef200a32c0 0x7fef200a5780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fef3406aaf0 tx=0x7fef2c009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a327343830 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fef240f8160 tx=0x7fef240f8250 comp rx=0 tx=0).stop 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 -- 172.21.15.1:0/3700286998 shutdown_connections 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a327343830 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327340da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 --2- 172.21.15.1:0/3700286998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a32733bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 -- 172.21.15.1:0/3700286998 >> 172.21.15.1:0/3700286998 conn(0x55a327337010 msgr2=0x55a327337410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 -- 172.21.15.1:0/3700286998 shutdown_connections 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 -- 172.21.15.1:0/3700286998 wait complete. 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 -- start start 2024-09-19T09:05:50.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.574+0000 7fef3f05b740 1 Processor -- start 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a327345910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327345e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a32734ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3f05b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a327344100 con 0x55a327341370 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3f05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a327228290 con 0x55a32733c2e0 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3f05b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a327344280 con 0x55a32733b9a0 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3f05b740 10 client.0 _ll_register_callbacks cb 0x55a327259140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a32734ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a32734ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41888/0 (socket says 172.21.15.1:41888) 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 -- 172.21.15.1:0/1775263806 learned_addr learned my addr 172.21.15.1:0/1775263806 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef39f80640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a327345910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3977f640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327345e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 -- 172.21.15.1:0/1775263806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 msgr2=0x55a327345910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a327345910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 -- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 msgr2=0x55a327345e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327345e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 -- 172.21.15.1:0/1775263806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a326fb2210 con 0x55a327341370 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef39f80640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a327345910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3977f640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327345e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:50.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef3a781640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a32734ce90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0128d0 tx=0x7fef2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73331dc8753fe87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.575+0000 7fef1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef1d7fa640 1 -- 172.21.15.1:0/1775263806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00fd60 con 0x55a327341370 2024-09-19T09:05:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef1d7fa640 1 -- 172.21.15.1:0/1775263806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fef2c01f420 con 0x55a327341370 2024-09-19T09:05:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 1 -- 172.21.15.1:0/1775263806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef240fd070 con 0x55a327341370 2024-09-19T09:05:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef1d7fa640 1 -- 172.21.15.1:0/1775263806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef2c02d070 con 0x55a327341370 2024-09-19T09:05:50.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 10 client.15951 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 1 -- 172.21.15.1:0/1775263806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a32707e620 con 0x55a327341370 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef1d7fa640 1 -- 172.21.15.1:0/1775263806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef240fd070 con 0x55a327341370 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef1d7fa640 1 -- 172.21.15.1:0/1775263806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fef2c027700 con 0x55a327341370 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 10 client.15951 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 10 client.15951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 20 client.15951 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a327351650 0x55a327353a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 4 client.15951 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef3f05b740 1 -- 172.21.15.1:0/1775263806 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3272aca20 con 0x55a327351650 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.576+0000 7fef39f80640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a327351650 0x55a327353a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.577+0000 7fef39f80640 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a327351650 0x55a327353a80 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ba326a3d9f06b97 server_cookie=6ffec914c08d9a32 in_seq=0 out_seq=0 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.577+0000 7fef1d7fa640 10 client.15951 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef1d7fa640 1 -- 172.21.15.1:0/1775263806 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3272aca20 con 0x55a327351650 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef1d7fa640 10 client.15951 handle_command_reply: tid=0 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 client.15951 shutdown 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 -- 172.21.15.1:0/1775263806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 msgr2=0x55a32734ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a32734ce90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0128d0 tx=0x7fef2c004a40 comp rx=0 tx=0).stop 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 -- 172.21.15.1:0/1775263806 shutdown_connections 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a327351650 0x55a327353a80 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a327341370 0x55a32734ce90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733c2e0 0x55a327345e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1775263806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733b9a0 0x55a327345910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef1d7fa640 0 client.15951 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:50.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 -- 172.21.15.1:0/1775263806 >> 172.21.15.1:0/1775263806 conn(0x55a327337010 msgr2=0x55a327338820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 -- 172.21.15.1:0/1775263806 shutdown_connections 2024-09-19T09:05:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 1 -- 172.21.15.1:0/1775263806 wait complete. 2024-09-19T09:05:50.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.578+0000 7fef3f05b740 20 client.15951 trim_cache size 0 max 16384 2024-09-19T09:05:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.592+0000 7fef3f05b740 1 Processor -- start 2024-09-19T09:05:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.592+0000 7fef3f05b740 1 -- start start 2024-09-19T09:05:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.592+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733b9a0 0x55a3273360b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.592+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733c2e0 0x55a32734ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.592+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a327341370 0x55a327358380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.592+0000 7fef3f05b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fef341aba60 con 0x55a32733b9a0 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.592+0000 7fef3f05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef341a9330 con 0x55a327341370 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.592+0000 7fef3f05b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fef341a7180 con 0x55a32733c2e0 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733b9a0 0x55a3273360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733b9a0 0x55a3273360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41894/0 (socket says 172.21.15.1:41894) 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 -- 172.21.15.1:0/1770758551 learned_addr learned my addr 172.21.15.1:0/1770758551 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef3a781640 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a327341370 0x55a327358380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 -- 172.21.15.1:0/1770758551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733c2e0 msgr2=0x55a32734ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733c2e0 0x55a32734ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 -- 172.21.15.1:0/1770758551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a327341370 msgr2=0x55a327358380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a327341370 0x55a327358380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 -- 172.21.15.1:0/1770758551 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a327354100 con 0x55a32733b9a0 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef3a781640 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a327341370 0x55a327358380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef39f80640 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733b9a0 0x55a3273360b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x55a327354330 tx=0x7fef30010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d34b0b587e1115 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef1f7fe640 1 -- 172.21.15.1:0/1770758551 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30005220 con 0x55a32733b9a0 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef1f7fe640 1 -- 172.21.15.1:0/1770758551 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef30004ca0 con 0x55a32733b9a0 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.593+0000 7fef1f7fe640 1 -- 172.21.15.1:0/1770758551 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3001ea70 con 0x55a32733b9a0 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- 172.21.15.1:0/1770758551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733b9a0 msgr2=0x55a3273360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733b9a0 0x55a3273360b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x55a327354330 tx=0x7fef30010800 comp rx=0 tx=0).stop 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- 172.21.15.1:0/1770758551 shutdown_connections 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a327341370 0x55a327358380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a32733c2e0 0x55a32734ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 --2- 172.21.15.1:0/1770758551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733b9a0 0x55a3273360b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- 172.21.15.1:0/1770758551 >> 172.21.15.1:0/1770758551 conn(0x55a327337010 msgr2=0x55a3273359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- 172.21.15.1:0/1770758551 shutdown_connections 2024-09-19T09:05:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- 172.21.15.1:0/1770758551 wait complete. 2024-09-19T09:05:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- start start 2024-09-19T09:05:50.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 Processor -- start 2024-09-19T09:05:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733b9a0 0x55a32734ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.600 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733c2e0 0x55a32734b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a327341370 0x55a32734c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fef341a77f0 con 0x55a32733c2e0 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef341a8c60 con 0x55a32733b9a0 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.594+0000 7fef3f05b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fef341a7ec0 con 0x55a327341370 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3f05b740 10 client.0 _ll_register_callbacks cb 0x7fef2c0096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733c2e0 0x55a32734b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733c2e0 0x55a32734b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41908/0 (socket says 172.21.15.1:41908) 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 -- 172.21.15.1:0/4180623535 learned_addr learned my addr 172.21.15.1:0/4180623535 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3a781640 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a327341370 0x55a32734c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef39f80640 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733b9a0 0x55a32734ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 -- 172.21.15.1:0/4180623535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a327341370 msgr2=0x55a32734c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a327341370 0x55a32734c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 -- 172.21.15.1:0/4180623535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733b9a0 msgr2=0x55a32734ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733b9a0 0x55a32734ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 -- 172.21.15.1:0/4180623535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a32734c950 con 0x55a32733c2e0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3977f640 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733c2e0 0x55a32734b3a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fef240eda50 tx=0x7fef240f3ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2202c957420279e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef1d7fa640 1 -- 172.21.15.1:0/4180623535 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24049040 con 0x55a32733c2e0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef1d7fa640 1 -- 172.21.15.1:0/4180623535 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fef240ba820 con 0x55a32733c2e0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3f05b740 1 -- 172.21.15.1:0/4180623535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef30004ca0 con 0x55a32733c2e0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef1d7fa640 1 -- 172.21.15.1:0/4180623535 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef240bc060 con 0x55a32733c2e0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3f05b740 10 client.15957 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.595+0000 7fef3f05b740 1 -- 172.21.15.1:0/4180623535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a3273bcbb0 con 0x55a32733c2e0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef1d7fa640 1 -- 172.21.15.1:0/4180623535 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef30004ca0 con 0x55a32733c2e0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef1d7fa640 1 -- 172.21.15.1:0/4180623535 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fef240f3110 con 0x55a32733c2e0 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef3f05b740 10 client.15957 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:50.602 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef3f05b740 10 client.15957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:05:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef3f05b740 20 client.15957 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef3f05b740 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a3273bd310 0x55a3273bf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef3f05b740 4 client.15957 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:05:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef3f05b740 1 -- 172.21.15.1:0/4180623535 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3272a6d70 con 0x55a3273bd310 2024-09-19T09:05:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef39f80640 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a3273bd310 0x55a3273bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef39f80640 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a3273bd310 0x55a3273bf730 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66bee90fe473fe9d server_cookie=2808b3d0068bada in_seq=0 out_seq=0 2024-09-19T09:05:50.603 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.596+0000 7fef1d7fa640 10 client.15957 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef1d7fa640 1 -- 172.21.15.1:0/4180623535 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3272a6d70 con 0x55a3273bd310 2024-09-19T09:05:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef1d7fa640 10 client.15957 handle_command_reply: tid=0 2024-09-19T09:05:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 client.15957 shutdown 2024-09-19T09:05:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 -- 172.21.15.1:0/4180623535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733c2e0 msgr2=0x55a32734b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733c2e0 0x55a32734b3a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fef240eda50 tx=0x7fef240f3ab0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 -- 172.21.15.1:0/4180623535 shutdown_connections 2024-09-19T09:05:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55a3273bd310 0x55a3273bf730 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a327341370 0x55a32734c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a32733c2e0 0x55a32734b3a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 --2- 172.21.15.1:0/4180623535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a32733b9a0 0x55a32734ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef1d7fa640 0 client.15957 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 -- 172.21.15.1:0/4180623535 >> 172.21.15.1:0/4180623535 conn(0x55a327337010 msgr2=0x55a3273359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 -- 172.21.15.1:0/4180623535 shutdown_connections 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 1 -- 172.21.15.1:0/4180623535 wait complete. 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.611+0000 7fef3f05b740 20 client.15957 trim_cache size 0 max 16384 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:05:50.613 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:05:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 -- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fef200a32c0 msgr2=0x7fef200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fef200a32c0 0x7fef200a5780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fef3406aaf0 tx=0x7fef2c009590 comp rx=0 tx=0).stop 2024-09-19T09:05:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 -- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 msgr2=0x7fef34198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 0x7fef34198460 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fef24005ab0 tx=0x7fef240042f0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 -- 172.21.15.1:0/3866003408 shutdown_connections 2024-09-19T09:05:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fef200a32c0 0x7fef200a5780 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fef341078a0 0x7fef3419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef34104f70 0x7fef34198460 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 --2- 172.21.15.1:0/3866003408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef34102640 0x7fef34197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 -- 172.21.15.1:0/3866003408 >> 172.21.15.1:0/3866003408 conn(0x7fef340fc1c0 msgr2=0x7fef34102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 -- 172.21.15.1:0/3866003408 shutdown_connections 2024-09-19T09:05:50.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:05:50.612+0000 7fef3c1e4640 1 -- 172.21.15.1:0/3866003408 wait complete. 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 -- 172.21.15.1:0/1560893226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 msgr2=0x7f91d010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 --2- 172.21.15.1:0/1560893226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 0x7f91d010e600 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009ca0 tx=0x7f91c802a950 comp rx=0 tx=0).stop 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 -- 172.21.15.1:0/1560893226 shutdown_connections 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 --2- 172.21.15.1:0/1560893226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 0x7f91d010e600 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 --2- 172.21.15.1:0/1560893226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91d01036c0 0x7f91d010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 --2- 172.21.15.1:0/1560893226 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91d0102da0 0x7f91d0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 -- 172.21.15.1:0/1560893226 >> 172.21.15.1:0/1560893226 conn(0x7f91d00fc7a0 msgr2=0x7f91d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 -- 172.21.15.1:0/1560893226 shutdown_connections 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.780+0000 7f91d548f640 1 -- 172.21.15.1:0/1560893226 wait complete. 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91d548f640 1 Processor -- start 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91d548f640 1 -- start start 2024-09-19T09:05:50.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91d548f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91d0102da0 0x7f91d0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91d548f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91d01036c0 0x7f91d0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91d548f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 0x7f91d019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91d548f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01120e0 con 0x7f91d010c180 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91d548f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0111f60 con 0x7f91d0102da0 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91d548f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0112260 con 0x7f91d01036c0 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 0x7f91d019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 0x7f91d019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41918/0 (socket says 172.21.15.1:41918) 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91cf7fe640 1 -- 172.21.15.1:0/3028258785 learned_addr learned my addr 172.21.15.1:0/3028258785 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91c7fff640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91d01036c0 0x7f91d0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91ceffd640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91d0102da0 0x7f91d0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91cf7fe640 1 -- 172.21.15.1:0/3028258785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91d01036c0 msgr2=0x7f91d0198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91cf7fe640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91d01036c0 0x7f91d0198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91cf7fe640 1 -- 172.21.15.1:0/3028258785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91d0102da0 msgr2=0x7f91d0198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91cf7fe640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91d0102da0 0x7f91d0198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91cf7fe640 1 -- 172.21.15.1:0/3028258785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d019d4b0 con 0x7f91d010c180 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.781+0000 7f91ceffd640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91d0102da0 0x7f91d0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.782+0000 7f91cf7fe640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 0x7f91d019cdd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f91c8005cc0 tx=0x7f91c802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.782+0000 7f91ccff9640 1 -- 172.21.15.1:0/3028258785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8034040 con 0x7f91d010c180 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.782+0000 7f91d548f640 1 -- 172.21.15.1:0/3028258785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d019d740 con 0x7f91d010c180 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.782+0000 7f91ccff9640 1 -- 172.21.15.1:0/3028258785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f91c8030940 con 0x7f91d010c180 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.782+0000 7f91ccff9640 1 -- 172.21.15.1:0/3028258785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c80456e0 con 0x7f91d010c180 2024-09-19T09:05:50.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.782+0000 7f91d548f640 1 -- 172.21.15.1:0/3028258785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d01a5080 con 0x7f91d010c180 2024-09-19T09:05:50.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.784+0000 7f91ccff9640 1 -- 172.21.15.1:0/3028258785 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f91c8037020 con 0x7f91d010c180 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.784+0000 7f91d7868740 1 Processor -- start 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.784+0000 7f91d7868740 1 -- start start 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91d7868740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 0x555961ba0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91d7868740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0980 0x555961baad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91d7868740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 0x555961bad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91d7868740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555961b05620 con 0x555961ba0980 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91d7868740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555961aace50 con 0x555961bab240 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91d7868740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555961b015e0 con 0x555961ba0060 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0980 0x555961baad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0980 0x555961baad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41934/0 (socket says 172.21.15.1:41934) 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ceffd640 1 -- 172.21.15.1:0/2512514344 learned_addr learned my addr 172.21.15.1:0/2512514344 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ccff9640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f91bc0a3240 0x7f91bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91c7fff640 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 0x555961ba0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91c7fff640 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 0x555961bad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91cf7fe640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f91bc0a3240 0x7f91bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ceffd640 1 -- 172.21.15.1:0/2512514344 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 msgr2=0x555961ba0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ceffd640 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 0x555961ba0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ceffd640 1 -- 172.21.15.1:0/2512514344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 msgr2=0x555961bad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ccff9640 1 -- 172.21.15.1:0/3028258785 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f91c80f0950 con 0x7f91d010c180 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.785+0000 7f91ceffd640 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 0x555961bad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.786+0000 7f91ceffd640 1 -- 172.21.15.1:0/2512514344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555961a9dd40 con 0x555961ba0980 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.786+0000 7f91ceffd640 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0980 0x555961baad00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f91c000aa10 tx=0x7f91c000aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc44b64c1528a5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.786+0000 7f91c57fa640 1 -- 172.21.15.1:0/2512514344 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0015070 con 0x555961ba0980 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.786+0000 7f91cf7fe640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f91bc0a3240 0x7f91bc0a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f91c80b9920 tx=0x7f91c8039f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.786+0000 7f91c57fa640 1 -- 172.21.15.1:0/2512514344 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f91c000cc60 con 0x555961ba0980 2024-09-19T09:05:50.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.786+0000 7f91c57fa640 1 -- 172.21.15.1:0/2512514344 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0018720 con 0x555961ba0980 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 -- 172.21.15.1:0/2512514344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0980 msgr2=0x555961baad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0980 0x555961baad00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f91c000aa10 tx=0x7f91c000aed0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 -- 172.21.15.1:0/2512514344 shutdown_connections 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 0x555961bad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0980 0x555961baad00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 --2- 172.21.15.1:0/2512514344 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 0x555961ba0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 -- 172.21.15.1:0/2512514344 >> 172.21.15.1:0/2512514344 conn(0x555961b9c5f0 msgr2=0x555961b9c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 -- 172.21.15.1:0/2512514344 shutdown_connections 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 -- 172.21.15.1:0/2512514344 wait complete. 2024-09-19T09:05:50.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 -- start start 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.787+0000 7f91d7868740 1 Processor -- start 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91d7868740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 0x555961ba8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91d7868740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 0x555961ba8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91d7868740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961bab240 0x555961ba8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91d7868740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555961bade10 con 0x555961bab240 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91d7868740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555961a8df10 con 0x555961ba0980 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91d7868740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555961badf90 con 0x555961ba0060 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91d7868740 10 client.0 _ll_register_callbacks cb 0x555961ab1db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961bab240 0x555961ba8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961bab240 0x555961ba8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41936/0 (socket says 172.21.15.1:41936) 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 -- 172.21.15.1:0/2423489623 learned_addr learned my addr 172.21.15.1:0/2423489623 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91ceffd640 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 0x555961ba8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 0x555961ba8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 -- 172.21.15.1:0/2423489623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 msgr2=0x555961ba8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 0x555961ba8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 -- 172.21.15.1:0/2423489623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 msgr2=0x555961ba8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 0x555961ba8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 -- 172.21.15.1:0/2423489623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555961814580 con 0x555961bab240 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91c7fff640 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961bab240 0x555961ba8ba0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f91b801de60 tx=0x7f91b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3899c6218cd7278a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.788+0000 7f91b67fc640 1 -- 172.21.15.1:0/2423489623 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b801d250 con 0x555961bab240 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 1 -- 172.21.15.1:0/2423489623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c000cc60 con 0x555961bab240 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91b67fc640 1 -- 172.21.15.1:0/2423489623 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f91b801d3f0 con 0x555961bab240 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91b67fc640 1 -- 172.21.15.1:0/2423489623 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f91b800b480 con 0x555961bab240 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 10 client.15969 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 1 -- 172.21.15.1:0/2423489623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5559618de960 con 0x555961bab240 2024-09-19T09:05:50.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91b67fc640 1 -- 172.21.15.1:0/2423489623 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f91c000cc60 con 0x555961bab240 2024-09-19T09:05:50.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91b67fc640 1 -- 172.21.15.1:0/2423489623 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f91b8003c70 con 0x555961bab240 2024-09-19T09:05:50.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 10 client.15969 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:50.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 10 client.15969 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:05:50.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 20 client.15969 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:50.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555961bbae10 0x555961bbd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 4 client.15969 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:05:50.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.789+0000 7f91d7868740 1 -- 172.21.15.1:0/2423489623 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555961b12b90 con 0x555961bbae10 2024-09-19T09:05:50.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.790+0000 7f91ceffd640 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555961bbae10 0x555961bbd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.790+0000 7f91ceffd640 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555961bbae10 0x555961bbd240 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=960b18c50ce45d65 server_cookie=66ea6e7c364f15a7 in_seq=0 out_seq=0 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.790+0000 7f91b67fc640 10 client.15969 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91b67fc640 1 -- 172.21.15.1:0/2423489623 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555961b12b90 con 0x555961bbae10 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91b67fc640 10 client.15969 handle_command_reply: tid=0 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 client.15969 shutdown 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 -- 172.21.15.1:0/2423489623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961bab240 msgr2=0x555961ba8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961bab240 0x555961ba8ba0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f91b801de60 tx=0x7f91b80046c0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 -- 172.21.15.1:0/2423489623 shutdown_connections 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555961bbae10 0x555961bbd240 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961bab240 0x555961ba8ba0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 0x555961ba8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 --2- 172.21.15.1:0/2423489623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0060 0x555961ba8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 -- 172.21.15.1:0/2423489623 >> 172.21.15.1:0/2423489623 conn(0x555961b9c5f0 msgr2=0x555961ba22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91b67fc640 0 client.15969 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:50.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 -- 172.21.15.1:0/2423489623 shutdown_connections 2024-09-19T09:05:50.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 1 -- 172.21.15.1:0/2423489623 wait complete. 2024-09-19T09:05:50.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.791+0000 7f91d7868740 20 client.15969 trim_cache size 0 max 16384 2024-09-19T09:05:50.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.808+0000 7f91d7868740 1 Processor -- start 2024-09-19T09:05:50.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.808+0000 7f91d7868740 1 -- start start 2024-09-19T09:05:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91d7868740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961ba3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91d7868740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 0x555961ba2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91d7868740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961bab240 0x555961b9b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91d7868740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01add30 con 0x555961ba0060 2024-09-19T09:05:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91d7868740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01ab600 con 0x555961ba0980 2024-09-19T09:05:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91d7868740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01a9470 con 0x555961bab240 2024-09-19T09:05:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961ba3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961ba3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41948/0 (socket says 172.21.15.1:41948) 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 -- 172.21.15.1:0/32420790 learned_addr learned my addr 172.21.15.1:0/32420790 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91ceffd640 1 --2- 172.21.15.1:0/32420790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 0x555961ba2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 -- 172.21.15.1:0/32420790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961bab240 msgr2=0x555961b9b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 --2- 172.21.15.1:0/32420790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961bab240 0x555961b9b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 -- 172.21.15.1:0/32420790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 msgr2=0x555961ba2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 --2- 172.21.15.1:0/32420790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 0x555961ba2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 -- 172.21.15.1:0/32420790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555961baaa90 con 0x555961ba0060 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c7fff640 1 --2- 172.21.15.1:0/32420790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961ba3650 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000c00 tx=0x7f91b8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20fd73a73b99830 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.809+0000 7f91c4ff9640 1 -- 172.21.15.1:0/32420790 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8005300 con 0x555961ba0060 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91c4ff9640 1 -- 172.21.15.1:0/32420790 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f91b80054a0 con 0x555961ba0060 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91c4ff9640 1 -- 172.21.15.1:0/32420790 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8012a40 con 0x555961ba0060 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 -- 172.21.15.1:0/32420790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 msgr2=0x555961ba3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 --2- 172.21.15.1:0/32420790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961ba3650 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000c00 tx=0x7f91b8005c50 comp rx=0 tx=0).stop 2024-09-19T09:05:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 -- 172.21.15.1:0/32420790 shutdown_connections 2024-09-19T09:05:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 --2- 172.21.15.1:0/32420790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961bab240 0x555961b9b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 --2- 172.21.15.1:0/32420790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961ba0980 0x555961ba2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 --2- 172.21.15.1:0/32420790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961ba3650 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 -- 172.21.15.1:0/32420790 >> 172.21.15.1:0/32420790 conn(0x555961b9c5f0 msgr2=0x555961b9af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 -- 172.21.15.1:0/32420790 shutdown_connections 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.810+0000 7f91d7868740 1 -- 172.21.15.1:0/32420790 wait complete. 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 1 -- start start 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 1 Processor -- start 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961baf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0980 0x555961baf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 0x555961c24ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01a9ac0 con 0x555961ba0060 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01aaf30 con 0x555961bab240 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01aa190 con 0x555961ba0980 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91d7868740 10 client.0 _ll_register_callbacks cb 0x7f91b801da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961baf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961baf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41954/0 (socket says 172.21.15.1:41954) 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91c7fff640 1 -- 172.21.15.1:0/4214558785 learned_addr learned my addr 172.21.15.1:0/4214558785 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91ceffd640 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0980 0x555961baf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91c7fff640 1 -- 172.21.15.1:0/4214558785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0980 msgr2=0x555961baf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91c7fff640 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0980 0x555961baf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91c7fff640 1 -- 172.21.15.1:0/4214558785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 msgr2=0x555961c24ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91c7fff640 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 0x555961c24ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.811+0000 7f91c7fff640 1 -- 172.21.15.1:0/4214558785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555961c25020 con 0x555961ba0060 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91c7fff640 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961baf2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f91b8012010 tx=0x7f91b800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909b193faac32aba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91b67fc640 1 -- 172.21.15.1:0/4214558785 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8005650 con 0x555961ba0060 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91b67fc640 1 -- 172.21.15.1:0/4214558785 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f91b80127c0 con 0x555961ba0060 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 1 -- 172.21.15.1:0/4214558785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91b80054a0 con 0x555961ba0060 2024-09-19T09:05:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91b67fc640 1 -- 172.21.15.1:0/4214558785 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f91b800ba20 con 0x555961ba0060 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 10 client.15975 fetch_fsmap learned FSMap version 24 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 1 -- 172.21.15.1:0/4214558785 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555961c261b0 con 0x555961ba0060 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91b67fc640 1 -- 172.21.15.1:0/4214558785 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f91b80054a0 con 0x555961ba0060 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91b67fc640 1 -- 172.21.15.1:0/4214558785 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f91b803b440 con 0x555961ba0060 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 10 client.15975 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 10 client.15975 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 20 client.15975 populate_metadata read hostname 'smithi001' 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555961c26810 0x555961c28c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 4 client.15975 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fd640c30", "release": true, "await": true}] 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.812+0000 7f91d7868740 1 -- 172.21.15.1:0/4214558785 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fd640c30", "release": true, "await": true}) -- 0x555961b0d0a0 con 0x555961c26810 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.813+0000 7f91ceffd640 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555961c26810 0x555961c28c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.813+0000 7f91ceffd640 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555961c26810 0x555961c28c00 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf53900430dd124f server_cookie=7925a839c9fa1347 in_seq=0 out_seq=0 2024-09-19T09:05:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.813+0000 7f91b67fc640 10 client.15975 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91b67fc640 1 -- 172.21.15.1:0/4214558785 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555961b0d0a0 con 0x555961c26810 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91b67fc640 10 client.15975 handle_command_reply: tid=0 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 client.15975 shutdown 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 -- 172.21.15.1:0/4214558785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 msgr2=0x555961baf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961baf2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f91b8012010 tx=0x7f91b800b870 comp rx=0 tx=0).stop 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 -- 172.21.15.1:0/4214558785 shutdown_connections 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x555961c26810 0x555961c28c00 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555961bab240 0x555961c24ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555961ba0980 0x555961baf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 --2- 172.21.15.1:0/4214558785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555961ba0060 0x555961baf2f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 -- 172.21.15.1:0/4214558785 >> 172.21.15.1:0/4214558785 conn(0x555961b9c5f0 msgr2=0x555961ba8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91b67fc640 0 client.15975 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 -- 172.21.15.1:0/4214558785 shutdown_connections 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 1 -- 172.21.15.1:0/4214558785 wait complete. 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.815+0000 7f91d7868740 20 client.15975 trim_cache size 0 max 16384 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 24, 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 12, 2024-09-19T09:05:50.820 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "fd640c30": { 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 12, 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:05:50.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:05:50.822 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:05:50.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:50.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:50.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:50.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:50.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:05:50.822 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:05:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 -- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f91bc0a3240 msgr2=0x7f91bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f91bc0a3240 0x7f91bc0a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f91c80b9920 tx=0x7f91c8039f90 comp rx=0 tx=0).stop 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 -- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 msgr2=0x7f91d019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 0x7f91d019cdd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f91c8005cc0 tx=0x7f91c802f790 comp rx=0 tx=0).stop 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 -- 172.21.15.1:0/3028258785 shutdown_connections 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f91d010c180 0x7f91d019cdd0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f91bc0a3240 0x7f91bc0a5700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f91d01036c0 0x7f91d0198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 --2- 172.21.15.1:0/3028258785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91d0102da0 0x7f91d0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 -- 172.21.15.1:0/3028258785 >> 172.21.15.1:0/3028258785 conn(0x7f91d00fc7a0 msgr2=0x7f91d00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 -- 172.21.15.1:0/3028258785 shutdown_connections 2024-09-19T09:05:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:05:50.816+0000 7f91d548f640 1 -- 172.21.15.1:0/3028258785 wait complete. 2024-09-19T09:05:51.424 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fd640c30', total seconds elapsed: 23.4 2024-09-19T09:05:52.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:51 smithi022 ceph-mon[35107]: pgmap v390: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:05:52.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:51 smithi001 ceph-mon[30939]: pgmap v390: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:05:52.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:51 smithi064 ceph-mon[35179]: pgmap v390: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:05:54.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:53 smithi022 ceph-mon[35107]: pgmap v391: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:05:54.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:53 smithi001 ceph-mon[30939]: pgmap v391: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:05:54.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:53 smithi064 ceph-mon[35179]: pgmap v391: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:05:56.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:55 smithi022 ceph-mon[35107]: pgmap v392: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:05:56.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:55 smithi001 ceph-mon[30939]: pgmap v392: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:05:56.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:55 smithi064 ceph-mon[35179]: pgmap v392: 97 pgs: 97 active+clean; 6.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:05:58.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:57 smithi022 ceph-mon[35107]: pgmap v393: 97 pgs: 97 active+clean; 6.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T09:05:58.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:57 smithi001 ceph-mon[30939]: pgmap v393: 97 pgs: 97 active+clean; 6.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T09:05:58.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:57 smithi064 ceph-mon[35179]: pgmap v393: 97 pgs: 97 active+clean; 6.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T09:06:00.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:05:59 smithi022 ceph-mon[35107]: pgmap v394: 97 pgs: 97 active+clean; 8.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 228 KiB/s wr, 7 op/s 2024-09-19T09:06:00.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:05:59 smithi001 ceph-mon[30939]: pgmap v394: 97 pgs: 97 active+clean; 8.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 228 KiB/s wr, 7 op/s 2024-09-19T09:06:00.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:05:59 smithi064 ceph-mon[35179]: pgmap v394: 97 pgs: 97 active+clean; 8.7 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 228 KiB/s wr, 7 op/s 2024-09-19T09:06:02.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:01 smithi022 ceph-mon[35107]: pgmap v395: 97 pgs: 97 active+clean; 20 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-19T09:06:02.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:01 smithi001 ceph-mon[30939]: pgmap v395: 97 pgs: 97 active+clean; 20 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-19T09:06:02.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:01 smithi064 ceph-mon[35179]: pgmap v395: 97 pgs: 97 active+clean; 20 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 MiB/s wr, 9 op/s 2024-09-19T09:06:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 -- 172.21.15.1:0/1160707206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 msgr2=0x7fba48109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 --2- 172.21.15.1:0/1160707206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 0x7fba48109fb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fba40009ca0 tx=0x7fba4002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 -- 172.21.15.1:0/1160707206 shutdown_connections 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 --2- 172.21.15.1:0/1160707206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 0x7fba48109fb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 --2- 172.21.15.1:0/1160707206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba48102d60 0x7fba481031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 --2- 172.21.15.1:0/1160707206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba48101b70 0x7fba48101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 -- 172.21.15.1:0/1160707206 >> 172.21.15.1:0/1160707206 conn(0x7fba480fd2f0 msgr2=0x7fba480ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 -- 172.21.15.1:0/1160707206 shutdown_connections 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 -- 172.21.15.1:0/1160707206 wait complete. 2024-09-19T09:06:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.713+0000 7fba4d731640 1 Processor -- start 2024-09-19T09:06:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba4d731640 1 -- start start 2024-09-19T09:06:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba4d731640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba48101b70 0x7fba48075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba4d731640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba48102d60 0x7fba480745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba4d731640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 0x7fba48074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba4d731640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba4810d960 con 0x7fba48103720 2024-09-19T09:06:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba4d731640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba4810d7e0 con 0x7fba48101b70 2024-09-19T09:06:03.716 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba4d731640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fba4810dae0 con 0x7fba48102d60 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 0x7fba48074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba477fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 0x7fba48074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46374/0 (socket says 172.21.15.1:46374) 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba477fe640 1 -- 172.21.15.1:0/1782615174 learned_addr learned my addr 172.21.15.1:0/1782615174 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba46ffd640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba48101b70 0x7fba48075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.714+0000 7fba467fc640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba48102d60 0x7fba480745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba477fe640 1 -- 172.21.15.1:0/1782615174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba48102d60 msgr2=0x7fba480745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba477fe640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba48102d60 0x7fba480745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba477fe640 1 -- 172.21.15.1:0/1782615174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba48101b70 msgr2=0x7fba48075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba477fe640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba48101b70 0x7fba48075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba477fe640 1 -- 172.21.15.1:0/1782615174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba480753b0 con 0x7fba48103720 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba46ffd640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba48101b70 0x7fba48075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba467fc640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba48102d60 0x7fba480745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba477fe640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 0x7fba48074b20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fba40009430 tx=0x7fba400319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba3ffff640 1 -- 172.21.15.1:0/1782615174 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40003b70 con 0x7fba48103720 2024-09-19T09:06:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba3ffff640 1 -- 172.21.15.1:0/1782615174 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba40003d10 con 0x7fba48103720 2024-09-19T09:06:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba4d731640 1 -- 172.21.15.1:0/1782615174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481a1fb0 con 0x7fba48103720 2024-09-19T09:06:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba3ffff640 1 -- 172.21.15.1:0/1782615174 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4002fd50 con 0x7fba48103720 2024-09-19T09:06:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.715+0000 7fba4d731640 1 -- 172.21.15.1:0/1782615174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba481a2470 con 0x7fba48103720 2024-09-19T09:06:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.718+0000 7fba3ffff640 1 -- 172.21.15.1:0/1782615174 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fba40004040 con 0x7fba48103720 2024-09-19T09:06:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.718+0000 7fba504ce740 1 Processor -- start 2024-09-19T09:06:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.718+0000 7fba504ce740 1 -- start start 2024-09-19T09:06:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba504ce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c26da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba504ce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c2bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba504ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c2e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba504ce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c669b8a2f0 con 0x55c669c272e0 2024-09-19T09:06:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba504ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c669b32270 con 0x55c669c2c370 2024-09-19T09:06:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba504ce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c669b862b0 con 0x55c669c269a0 2024-09-19T09:06:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c2bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c2bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46386/0 (socket says 172.21.15.1:46386) 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 -- 172.21.15.1:0/4161888525 learned_addr learned my addr 172.21.15.1:0/4161888525 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba467fc640 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c26da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba467fc640 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c2e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 -- 172.21.15.1:0/4161888525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 msgr2=0x55c669c26da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c26da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 -- 172.21.15.1:0/4161888525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 msgr2=0x55c669c2e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c2e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 -- 172.21.15.1:0/4161888525 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c669b31340 con 0x55c669c272e0 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba3ffff640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fba340a3240 0x7fba340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.719+0000 7fba46ffd640 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c2bda0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fba38009cd0 tx=0x7fba380117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0103d151431554 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.720+0000 7fba467fc640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fba340a3240 0x7fba340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.722 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.720+0000 7fba3ffff640 1 -- 172.21.15.1:0/1782615174 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fba400f0f00 con 0x7fba48103720 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.720+0000 7fba3d7fa640 1 -- 172.21.15.1:0/4161888525 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38012450 con 0x55c669c272e0 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.720+0000 7fba3d7fa640 1 -- 172.21.15.1:0/4161888525 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba38012af0 con 0x55c669c272e0 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.720+0000 7fba3d7fa640 1 -- 172.21.15.1:0/4161888525 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3800fc90 con 0x55c669c272e0 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.720+0000 7fba504ce740 1 -- 172.21.15.1:0/4161888525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 msgr2=0x55c669c2bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.720+0000 7fba467fc640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fba340a3240 0x7fba340a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fba3000bfd0 tx=0x7fba30015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.720+0000 7fba504ce740 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c2bda0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fba38009cd0 tx=0x7fba380117b0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 -- 172.21.15.1:0/4161888525 shutdown_connections 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c2e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c2bda0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 --2- 172.21.15.1:0/4161888525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c26da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 -- 172.21.15.1:0/4161888525 >> 172.21.15.1:0/4161888525 conn(0x55c669c22010 msgr2=0x55c669c22410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 -- 172.21.15.1:0/4161888525 shutdown_connections 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 -- 172.21.15.1:0/4161888525 wait complete. 2024-09-19T09:06:03.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 -- start start 2024-09-19T09:06:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 Processor -- start 2024-09-19T09:06:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c30b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c272e0 0x55c669c310d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c38110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c669c2f340 con 0x55c669c269a0 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c669b13290 con 0x55c669c2c370 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c669c2f4c0 con 0x55c669c272e0 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.721+0000 7fba504ce740 10 client.0 _ll_register_callbacks cb 0x55c669b44140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c30b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c30b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46402/0 (socket says 172.21.15.1:46402) 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 -- 172.21.15.1:0/3876578940 learned_addr learned my addr 172.21.15.1:0/3876578940 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba467fc640 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c272e0 0x55c669c310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba477fe640 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c38110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 -- 172.21.15.1:0/3876578940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c272e0 msgr2=0x55c669c310d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c272e0 0x55c669c310d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 -- 172.21.15.1:0/3876578940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 msgr2=0x55c669c38110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c38110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 -- 172.21.15.1:0/3876578940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c66989d210 con 0x55c669c269a0 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba46ffd640 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c30b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fba38000c00 tx=0x7fba38005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd370da21de78be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba2e7fc640 1 -- 172.21.15.1:0/3876578940 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38029020 con 0x55c669c269a0 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba2e7fc640 1 -- 172.21.15.1:0/3876578940 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fba3800fa10 con 0x55c669c269a0 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba504ce740 1 -- 172.21.15.1:0/3876578940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba38012af0 con 0x55c669c269a0 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.722+0000 7fba2e7fc640 1 -- 172.21.15.1:0/3876578940 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fba38034050 con 0x55c669c269a0 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba504ce740 10 client.15987 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba504ce740 1 -- 172.21.15.1:0/3876578940 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c669969620 con 0x55c669c269a0 2024-09-19T09:06:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba2e7fc640 1 -- 172.21.15.1:0/3876578940 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba38012af0 con 0x55c669c269a0 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba2e7fc640 1 -- 172.21.15.1:0/3876578940 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fba380035f0 con 0x55c669c269a0 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba504ce740 10 client.15987 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba504ce740 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba504ce740 20 client.15987 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba504ce740 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c669c3c580 0x55c669c3e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba504ce740 4 client.15987 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba504ce740 1 -- 172.21.15.1:0/3876578940 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c669b97a20 con 0x55c669c3c580 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.723+0000 7fba467fc640 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c669c3c580 0x55c669c3e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.724+0000 7fba467fc640 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c669c3c580 0x55c669c3e970 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31507a256fc53539 server_cookie=4cbdd6e253d75a4a in_seq=0 out_seq=0 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.724+0000 7fba2e7fc640 10 client.15987 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.724+0000 7fba2e7fc640 1 -- 172.21.15.1:0/3876578940 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c669b97a20 con 0x55c669c3c580 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.724+0000 7fba2e7fc640 10 client.15987 handle_command_reply: tid=0 2024-09-19T09:06:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.724+0000 7fba504ce740 1 client.15987 shutdown 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 -- 172.21.15.1:0/3876578940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 msgr2=0x55c669c30b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c30b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fba38000c00 tx=0x7fba38005780 comp rx=0 tx=0).stop 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 -- 172.21.15.1:0/3876578940 shutdown_connections 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c669c3c580 0x55c669c3e970 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c38110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c272e0 0x55c669c310d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba2e7fc640 0 client.15987 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 --2- 172.21.15.1:0/3876578940 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c30b90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 -- 172.21.15.1:0/3876578940 >> 172.21.15.1:0/3876578940 conn(0x55c669c22010 msgr2=0x55c669c23820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 -- 172.21.15.1:0/3876578940 shutdown_connections 2024-09-19T09:06:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 1 -- 172.21.15.1:0/3876578940 wait complete. 2024-09-19T09:06:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.725+0000 7fba504ce740 20 client.15987 trim_cache size 0 max 16384 2024-09-19T09:06:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba504ce740 1 Processor -- start 2024-09-19T09:06:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba504ce740 1 -- start start 2024-09-19T09:06:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba504ce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c31050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba504ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c272e0 0x55c669c38030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba504ce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c2c370 0x55c669c22e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba504ce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba481adce0 con 0x55c669c269a0 2024-09-19T09:06:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba504ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba481ab5b0 con 0x55c669c272e0 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba504ce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fba481a9400 con 0x55c669c2c370 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c31050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c31050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46416/0 (socket says 172.21.15.1:46416) 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba46ffd640 1 -- 172.21.15.1:0/2995108055 learned_addr learned my addr 172.21.15.1:0/2995108055 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba477fe640 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c2c370 0x55c669c22e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba467fc640 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c272e0 0x55c669c38030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.740+0000 7fba46ffd640 1 -- 172.21.15.1:0/2995108055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c2c370 msgr2=0x55c669c22e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba46ffd640 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c2c370 0x55c669c22e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba46ffd640 1 -- 172.21.15.1:0/2995108055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c272e0 msgr2=0x55c669c38030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba46ffd640 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c272e0 0x55c669c38030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba46ffd640 1 -- 172.21.15.1:0/2995108055 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c669c22ca0 con 0x55c669c269a0 2024-09-19T09:06:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba467fc640 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c272e0 0x55c669c38030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba46ffd640 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c31050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fba380117f0 tx=0x7fba38011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1cc29a2be926f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba3cff9640 1 -- 172.21.15.1:0/2995108055 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3803d070 con 0x55c669c269a0 2024-09-19T09:06:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba3cff9640 1 -- 172.21.15.1:0/2995108055 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba380037f0 con 0x55c669c269a0 2024-09-19T09:06:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.741+0000 7fba3cff9640 1 -- 172.21.15.1:0/2995108055 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38029070 con 0x55c669c269a0 2024-09-19T09:06:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- 172.21.15.1:0/2995108055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 msgr2=0x55c669c31050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c31050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fba380117f0 tx=0x7fba38011f60 comp rx=0 tx=0).stop 2024-09-19T09:06:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- 172.21.15.1:0/2995108055 shutdown_connections 2024-09-19T09:06:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c2c370 0x55c669c22e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.746 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c272e0 0x55c669c38030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 --2- 172.21.15.1:0/2995108055 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c269a0 0x55c669c31050 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- 172.21.15.1:0/2995108055 >> 172.21.15.1:0/2995108055 conn(0x55c669c22010 msgr2=0x55c669c30940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- 172.21.15.1:0/2995108055 shutdown_connections 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- 172.21.15.1:0/2995108055 wait complete. 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- start start 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 Processor -- start 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c35700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c35c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c36c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba481a9a70 con 0x55c669c272e0 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba481aaee0 con 0x55c669c2c370 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fba481aa140 con 0x55c669c269a0 2024-09-19T09:06:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba504ce740 10 client.0 _ll_register_callbacks cb 0x7fba3000bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.742+0000 7fba467fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c35c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba467fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c35c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46428/0 (socket says 172.21.15.1:46428) 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba467fc640 1 -- 172.21.15.1:0/802262037 learned_addr learned my addr 172.21.15.1:0/802262037 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba46ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c35700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba477fe640 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c36c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba467fc640 1 -- 172.21.15.1:0/802262037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 msgr2=0x55c669c35700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba467fc640 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c35700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba467fc640 1 -- 172.21.15.1:0/802262037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 msgr2=0x55c669c36c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba467fc640 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c36c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba467fc640 1 -- 172.21.15.1:0/802262037 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c669c37260 con 0x55c669c272e0 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba46ffd640 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c35700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba467fc640 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c35c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fba30005d90 tx=0x7fba30005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9775dae517d358 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba2e7fc640 1 -- 172.21.15.1:0/802262037 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30004020 con 0x55c669c272e0 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba2e7fc640 1 -- 172.21.15.1:0/802262037 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fba30013e00 con 0x55c669c272e0 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba504ce740 1 -- 172.21.15.1:0/802262037 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba380037f0 con 0x55c669c272e0 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba2e7fc640 1 -- 172.21.15.1:0/802262037 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fba300041c0 con 0x55c669c272e0 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba504ce740 10 client.15993 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.743+0000 7fba504ce740 1 -- 172.21.15.1:0/802262037 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c669ca7250 con 0x55c669c272e0 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba2e7fc640 1 -- 172.21.15.1:0/802262037 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba380037f0 con 0x55c669c272e0 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba2e7fc640 1 -- 172.21.15.1:0/802262037 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fba3001c040 con 0x55c669c272e0 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba504ce740 10 client.15993 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba504ce740 10 client.15993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba504ce740 20 client.15993 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba504ce740 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c669ca7b90 0x55c669ca9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba504ce740 4 client.15993 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba504ce740 1 -- 172.21.15.1:0/802262037 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c669b91d70 con 0x55c669ca7b90 2024-09-19T09:06:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba46ffd640 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c669ca7b90 0x55c669ca9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba2e7fc640 10 client.15993 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.744+0000 7fba46ffd640 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c669ca7b90 0x55c669ca9fb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b98333e3c39e4a7 server_cookie=69a3a061445fb3a4 in_seq=0 out_seq=0 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba2e7fc640 1 -- 172.21.15.1:0/802262037 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c669b91d70 con 0x55c669ca7b90 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba2e7fc640 10 client.15993 handle_command_reply: tid=0 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 client.15993 shutdown 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 -- 172.21.15.1:0/802262037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 msgr2=0x55c669c35c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c35c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fba30005d90 tx=0x7fba30005d20 comp rx=0 tx=0).stop 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 -- 172.21.15.1:0/802262037 shutdown_connections 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55c669ca7b90 0x55c669ca9fb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c669c2c370 0x55c669c36c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c669c272e0 0x55c669c35c40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba2e7fc640 0 client.15993 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 --2- 172.21.15.1:0/802262037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c669c269a0 0x55c669c35700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 -- 172.21.15.1:0/802262037 >> 172.21.15.1:0/802262037 conn(0x55c669c22010 msgr2=0x55c669c209a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 -- 172.21.15.1:0/802262037 shutdown_connections 2024-09-19T09:06:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 1 -- 172.21.15.1:0/802262037 wait complete. 2024-09-19T09:06:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.753+0000 7fba504ce740 20 client.15993 trim_cache size 0 max 16384 2024-09-19T09:06:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:06:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:06:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:06:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:06:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 -- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fba340a3240 msgr2=0x7fba340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fba340a3240 0x7fba340a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fba3000bfd0 tx=0x7fba30015040 comp rx=0 tx=0).stop 2024-09-19T09:06:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 -- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 msgr2=0x7fba48074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 0x7fba48074b20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fba40009430 tx=0x7fba400319f0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 -- 172.21.15.1:0/1782615174 shutdown_connections 2024-09-19T09:06:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba48103720 0x7fba48074b20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fba340a3240 0x7fba340a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba48102d60 0x7fba480745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 --2- 172.21.15.1:0/1782615174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba48101b70 0x7fba48075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 -- 172.21.15.1:0/1782615174 >> 172.21.15.1:0/1782615174 conn(0x7fba480fd2f0 msgr2=0x7fba48106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 -- 172.21.15.1:0/1782615174 shutdown_connections 2024-09-19T09:06:03.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:03.754+0000 7fba4d731640 1 -- 172.21.15.1:0/1782615174 wait complete. 2024-09-19T09:06:04.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:03 smithi022 ceph-mon[35107]: pgmap v396: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-09-19T09:06:04.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:03 smithi001 ceph-mon[30939]: pgmap v396: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-09-19T09:06:04.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:03 smithi064 ceph-mon[35179]: pgmap v396: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-09-19T09:06:06.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:05 smithi022 ceph-mon[35107]: pgmap v397: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-09-19T09:06:06.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:05 smithi001 ceph-mon[30939]: pgmap v397: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-09-19T09:06:06.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:05 smithi064 ceph-mon[35179]: pgmap v397: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 MiB/s wr, 8 op/s 2024-09-19T09:06:08.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:07 smithi022 ceph-mon[35107]: pgmap v398: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 MiB/s wr, 10 op/s 2024-09-19T09:06:08.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:07 smithi001 ceph-mon[30939]: pgmap v398: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 MiB/s wr, 10 op/s 2024-09-19T09:06:08.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:07 smithi064 ceph-mon[35179]: pgmap v398: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 MiB/s wr, 10 op/s 2024-09-19T09:06:09.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:08 smithi001 ceph-mon[30939]: pgmap v399: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-09-19T09:06:09.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:08 smithi064 ceph-mon[35179]: pgmap v399: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-09-19T09:06:09.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:08 smithi022 ceph-mon[35107]: pgmap v399: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 MiB/s wr, 7 op/s 2024-09-19T09:06:11.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:11 smithi064 ceph-mon[35179]: pgmap v400: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-19T09:06:11.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:11 smithi022 ceph-mon[35107]: pgmap v400: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-19T09:06:11.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:11 smithi001 ceph-mon[30939]: pgmap v400: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-19T09:06:12.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:12.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:12.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:12.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:12.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:12.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:12.460 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:06:12.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:06:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:06:12.549 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:06:13.158 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:06:13.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:13 smithi064 ceph-mon[35179]: pgmap v401: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 343 KiB/s wr, 8 op/s 2024-09-19T09:06:13.429 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:13.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:13 smithi022 ceph-mon[35107]: pgmap v401: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 343 KiB/s wr, 8 op/s 2024-09-19T09:06:13.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:13 smithi001 ceph-mon[30939]: pgmap v401: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 343 KiB/s wr, 8 op/s 2024-09-19T09:06:13.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 -- 172.21.15.1:0/2245456216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 msgr2=0x7f714c110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 --2- 172.21.15.1:0/2245456216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 0x7f714c110870 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7144009ca0 tx=0x7f714402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 -- 172.21.15.1:0/2245456216 shutdown_connections 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 --2- 172.21.15.1:0/2245456216 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 0x7f714c110870 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 --2- 172.21.15.1:0/2245456216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714c101280 0x7f714c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 --2- 172.21.15.1:0/2245456216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f714c1008d0 0x7f714c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 -- 172.21.15.1:0/2245456216 >> 172.21.15.1:0/2245456216 conn(0x7f714c0fc7a0 msgr2=0x7f714c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 -- 172.21.15.1:0/2245456216 shutdown_connections 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.873+0000 7f7153a54640 1 -- 172.21.15.1:0/2245456216 wait complete. 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7153a54640 1 Processor -- start 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7153a54640 1 -- start start 2024-09-19T09:06:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7153a54640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f714c1008d0 0x7f714c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7153a54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714c101280 0x7f714c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7153a54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 0x7f714c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7153a54640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1142a0 con 0x7f714c10e480 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7153a54640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f714c114120 con 0x7f714c101280 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7153a54640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f714c114420 con 0x7f714c1008d0 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7151ff1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 0x7f714c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7151ff1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 0x7f714c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41412/0 (socket says 172.21.15.1:41412) 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7151ff1640 1 -- 172.21.15.1:0/545163602 learned_addr learned my addr 172.21.15.1:0/545163602 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f71517f0640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f714c1008d0 0x7f714c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.874+0000 7f7150fef640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714c101280 0x7f714c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f7151ff1640 1 -- 172.21.15.1:0/545163602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f714c1008d0 msgr2=0x7f714c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f7151ff1640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f714c1008d0 0x7f714c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f7151ff1640 1 -- 172.21.15.1:0/545163602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714c101280 msgr2=0x7f714c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f7151ff1640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714c101280 0x7f714c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f7151ff1640 1 -- 172.21.15.1:0/545163602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c19f5f0 con 0x7f714c10e480 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f7151ff1640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 0x7f714c19ef10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f714402ade0 tx=0x7f71440319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f71427fc640 1 -- 172.21.15.1:0/545163602 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144003c30 con 0x7f714c10e480 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f7153a54640 1 -- 172.21.15.1:0/545163602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c19f880 con 0x7f714c10e480 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f71427fc640 1 -- 172.21.15.1:0/545163602 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7144003dd0 con 0x7f714c10e480 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f71427fc640 1 -- 172.21.15.1:0/545163602 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714402fce0 con 0x7f714c10e480 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.875+0000 7f7153a54640 1 -- 172.21.15.1:0/545163602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c1a71c0 con 0x7f714c10e480 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.877+0000 7f71427fc640 1 -- 172.21.15.1:0/545163602 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f7144004050 con 0x7f714c10e480 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7155e2d740 1 Processor -- start 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7155e2d740 1 -- start start 2024-09-19T09:06:13.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f71427fc640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71380a3240 0x7f71380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e12d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 0x55573e138140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e13aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7155e2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55573e0932e0 con 0x55573e138680 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7155e2d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55573e03ace0 con 0x55573e12ddc0 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7155e2d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55573e08f2a0 con 0x55573e12d4a0 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7150fef640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71380a3240 0x7f71380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f71427fc640 1 -- 172.21.15.1:0/545163602 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f71440f0bc0 con 0x7f714c10e480 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7151ff1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e13aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.878+0000 7f7151ff1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e13aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41416/0 (socket says 172.21.15.1:41416) 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7151ff1640 1 -- 172.21.15.1:0/1001912787 learned_addr learned my addr 172.21.15.1:0/1001912787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f71517f0640 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7150fef640 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 0x55573e138140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7151ff1640 1 -- 172.21.15.1:0/1001912787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 msgr2=0x55573e12d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7151ff1640 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e12d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7151ff1640 1 -- 172.21.15.1:0/1001912787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 msgr2=0x55573e138140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7151ff1640 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 0x55573e138140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7151ff1640 1 -- 172.21.15.1:0/1001912787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55573e01f440 con 0x55573e138680 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7150fef640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71380a3240 0x7f71380a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f713c005e10 tx=0x7f713c0127c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f7151ff1640 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e13aa70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f71440b96e0 tx=0x7f71440bd050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78a2643ff87493c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f71377fe640 1 -- 172.21.15.1:0/1001912787 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440bd980 con 0x55573e138680 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f71377fe640 1 -- 172.21.15.1:0/1001912787 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7144036040 con 0x55573e138680 2024-09-19T09:06:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.879+0000 7f71377fe640 1 -- 172.21.15.1:0/1001912787 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440ee750 con 0x55573e138680 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 -- 172.21.15.1:0/1001912787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 msgr2=0x55573e13aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e13aa70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f71440b96e0 tx=0x7f71440bd050 comp rx=0 tx=0).stop 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 -- 172.21.15.1:0/1001912787 shutdown_connections 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e13aa70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 0x55573e138140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 --2- 172.21.15.1:0/1001912787 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e12d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 -- 172.21.15.1:0/1001912787 >> 172.21.15.1:0/1001912787 conn(0x55573e129a30 msgr2=0x55573e129e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 -- 172.21.15.1:0/1001912787 shutdown_connections 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 -- 172.21.15.1:0/1001912787 wait complete. 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 -- start start 2024-09-19T09:06:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.880+0000 7f7155e2d740 1 Processor -- start 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e137fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 0x55573e135280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e1357e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7155e2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55573e0932e0 con 0x55573e138680 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7155e2d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55573e04e050 con 0x55573e12ddc0 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7155e2d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55573e13b010 con 0x55573e12d4a0 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7155e2d740 10 client.0 _ll_register_callbacks cb 0x55573e08e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e1357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e1357e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41424/0 (socket says 172.21.15.1:41424) 2024-09-19T09:06:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 -- 172.21.15.1:0/2073701981 learned_addr learned my addr 172.21.15.1:0/2073701981 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:13.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f71517f0640 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e137fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7150fef640 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 0x55573e135280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 -- 172.21.15.1:0/2073701981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 msgr2=0x55573e137fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:13.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e137fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 -- 172.21.15.1:0/2073701981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 msgr2=0x55573e135280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:13.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 0x55573e135280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 -- 172.21.15.1:0/2073701981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55573de043c0 con 0x55573e138680 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7151ff1640 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e1357e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f71440c59c0 tx=0x7f71440bb790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996fd64594fbe985 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.881+0000 7f7134ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7134ff9640 1 -- 172.21.15.1:0/2073701981 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440bb390 con 0x55573e138680 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7134ff9640 1 -- 172.21.15.1:0/2073701981 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f71440c5a60 con 0x55573e138680 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 1 -- 172.21.15.1:0/2073701981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7144036040 con 0x55573e138680 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7134ff9640 1 -- 172.21.15.1:0/2073701981 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f71440bd980 con 0x55573e138680 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 10 client.16005 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 1 -- 172.21.15.1:0/2073701981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55573e1467d0 con 0x55573e138680 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7134ff9640 1 -- 172.21.15.1:0/2073701981 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7144036040 con 0x55573e138680 2024-09-19T09:06:13.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7134ff9640 1 -- 172.21.15.1:0/2073701981 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7144004340 con 0x55573e138680 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 10 client.16005 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 20 client.16005 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55573e147d70 0x55573e14a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 4 client.16005 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f7155e2d740 1 -- 172.21.15.1:0/2073701981 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55573e0a0850 con 0x55573e147d70 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.882+0000 7f71517f0640 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55573e147d70 0x55573e14a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.883+0000 7f7134ff9640 10 client.16005 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.883+0000 7f71517f0640 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55573e147d70 0x55573e14a1a0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec72de7fa1135407 server_cookie=82689d34bab19ffc in_seq=0 out_seq=0 2024-09-19T09:06:13.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.883+0000 7f7134ff9640 1 -- 172.21.15.1:0/2073701981 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55573e0a0850 con 0x55573e147d70 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.883+0000 7f7134ff9640 10 client.16005 handle_command_reply: tid=0 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.883+0000 7f7155e2d740 1 client.16005 shutdown 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 -- 172.21.15.1:0/2073701981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 msgr2=0x55573e1357e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e1357e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f71440c59c0 tx=0x7f71440bb790 comp rx=0 tx=0).stop 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 -- 172.21.15.1:0/2073701981 shutdown_connections 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55573e147d70 0x55573e14a1a0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e138680 0x55573e1357e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e12ddc0 0x55573e135280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7134ff9640 0 client.16005 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 --2- 172.21.15.1:0/2073701981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e137fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 -- 172.21.15.1:0/2073701981 >> 172.21.15.1:0/2073701981 conn(0x55573e129a30 msgr2=0x55573e12f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 -- 172.21.15.1:0/2073701981 shutdown_connections 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 1 -- 172.21.15.1:0/2073701981 wait complete. 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.884+0000 7f7155e2d740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7155e2d740 1 Processor -- start 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7155e2d740 1 -- start start 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e144060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12ddc0 0x55573e130780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 0x55573e14fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7155e2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1b20f0 con 0x55573e12ddc0 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7155e2d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1af9c0 con 0x55573e138680 2024-09-19T09:06:13.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7155e2d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1ad810 con 0x55573e12d4a0 2024-09-19T09:06:13.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7150fef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12ddc0 0x55573e130780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7150fef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12ddc0 0x55573e130780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41436/0 (socket says 172.21.15.1:41436) 2024-09-19T09:06:13.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7150fef640 1 -- 172.21.15.1:0/4201233378 learned_addr learned my addr 172.21.15.1:0/4201233378 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:13.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7150fef640 1 -- 172.21.15.1:0/4201233378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 msgr2=0x55573e144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:13.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7150fef640 1 --2- 172.21.15.1:0/4201233378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7150fef640 1 -- 172.21.15.1:0/4201233378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 msgr2=0x55573e14fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:13.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.902+0000 7f7150fef640 1 --2- 172.21.15.1:0/4201233378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 0x55573e14fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7150fef640 1 -- 172.21.15.1:0/4201233378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55573e12a6c0 con 0x55573e12ddc0 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7150fef640 1 --2- 172.21.15.1:0/4201233378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12ddc0 0x55573e130780 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f713c005940 tx=0x7f713c005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51ec0b93785bb29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7136ffd640 1 -- 172.21.15.1:0/4201233378 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c024070 con 0x55573e12ddc0 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7136ffd640 1 -- 172.21.15.1:0/4201233378 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f713c029b60 con 0x55573e12ddc0 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7136ffd640 1 -- 172.21.15.1:0/4201233378 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c020c00 con 0x55573e12ddc0 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7155e2d740 1 -- 172.21.15.1:0/4201233378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12ddc0 msgr2=0x55573e130780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7155e2d740 1 --2- 172.21.15.1:0/4201233378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12ddc0 0x55573e130780 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f713c005940 tx=0x7f713c005da0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7155e2d740 1 -- 172.21.15.1:0/4201233378 shutdown_connections 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7155e2d740 1 --2- 172.21.15.1:0/4201233378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 0x55573e14fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7155e2d740 1 --2- 172.21.15.1:0/4201233378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12ddc0 0x55573e130780 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7155e2d740 1 --2- 172.21.15.1:0/4201233378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12d4a0 0x55573e144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.903+0000 7f7155e2d740 1 -- 172.21.15.1:0/4201233378 >> 172.21.15.1:0/4201233378 conn(0x55573e129a30 msgr2=0x55573e130070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 -- 172.21.15.1:0/4201233378 shutdown_connections 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 -- 172.21.15.1:0/4201233378 wait complete. 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 -- start start 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 Processor -- start 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12d4a0 0x55573e140950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12ddc0 0x55573e13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 0x55573e13c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1ade80 con 0x55573e12d4a0 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1af2f0 con 0x55573e138680 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1ae550 con 0x55573e12ddc0 2024-09-19T09:06:13.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f7155e2d740 10 client.0 _ll_register_callbacks cb 0x7f71440b8eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f71517f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12d4a0 0x55573e140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f71517f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12d4a0 0x55573e140950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41446/0 (socket says 172.21.15.1:41446) 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.904+0000 7f71517f0640 1 -- 172.21.15.1:0/285516443 learned_addr learned my addr 172.21.15.1:0/285516443 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7151ff1640 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 0x55573e13c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7150fef640 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12ddc0 0x55573e13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f71517f0640 1 -- 172.21.15.1:0/285516443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12ddc0 msgr2=0x55573e13bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f71517f0640 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12ddc0 0x55573e13bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f71517f0640 1 -- 172.21.15.1:0/285516443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 msgr2=0x55573e13c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f71517f0640 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 0x55573e13c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f71517f0640 1 -- 172.21.15.1:0/285516443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55573e13c9c0 con 0x55573e12d4a0 2024-09-19T09:06:13.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f71517f0640 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12d4a0 0x55573e140950 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7148005940 tx=0x7f714800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421ee41aeba8c994 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7134ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7134ff9640 1 -- 172.21.15.1:0/285516443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148022020 con 0x55573e12d4a0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7134ff9640 1 -- 172.21.15.1:0/285516443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f714801d420 con 0x55573e12d4a0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7155e2d740 1 -- 172.21.15.1:0/285516443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f713c029b60 con 0x55573e12d4a0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7134ff9640 1 -- 172.21.15.1:0/285516443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f714802d050 con 0x55573e12d4a0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7155e2d740 10 client.16011 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.905+0000 7f7155e2d740 1 -- 172.21.15.1:0/285516443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55573e1b2ae0 con 0x55573e12d4a0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7134ff9640 1 -- 172.21.15.1:0/285516443 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f713c029b60 con 0x55573e12d4a0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7134ff9640 1 -- 172.21.15.1:0/285516443 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7148011ab0 con 0x55573e12d4a0 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7155e2d740 10 client.16011 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7155e2d740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:13.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7155e2d740 20 client.16011 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7155e2d740 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55573e1b3250 0x55573e1b5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7155e2d740 4 client.16011 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7155e2d740 1 -- 172.21.15.1:0/285516443 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55573e09ad60 con 0x55573e1b3250 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.906+0000 7f7150fef640 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55573e1b3250 0x55573e1b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.907+0000 7f7134ff9640 10 client.16011 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.907+0000 7f7150fef640 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55573e1b3250 0x55573e1b5640 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c5a8f22499653c server_cookie=beb518f2cc20600d in_seq=0 out_seq=0 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7134ff9640 1 -- 172.21.15.1:0/285516443 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55573e09ad60 con 0x55573e1b3250 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7134ff9640 10 client.16011 handle_command_reply: tid=0 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 client.16011 shutdown 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 -- 172.21.15.1:0/285516443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12d4a0 msgr2=0x55573e140950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12d4a0 0x55573e140950 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7148005940 tx=0x7f714800be50 comp rx=0 tx=0).stop 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 -- 172.21.15.1:0/285516443 shutdown_connections 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55573e1b3250 0x55573e1b5640 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7134ff9640 0 client.16011 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55573e138680 0x55573e13c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55573e12ddc0 0x55573e13bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 --2- 172.21.15.1:0/285516443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55573e12d4a0 0x55573e140950 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 -- 172.21.15.1:0/285516443 >> 172.21.15.1:0/285516443 conn(0x55573e129a30 msgr2=0x55573e128350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 -- 172.21.15.1:0/285516443 shutdown_connections 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 1 -- 172.21.15.1:0/285516443 wait complete. 2024-09-19T09:06:13.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.908+0000 7f7155e2d740 20 client.16011 trim_cache size 0 max 16384 2024-09-19T09:06:13.930 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:06:13.930 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:06:13.930 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:06:13.930 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:06:13.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 -- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71380a3240 msgr2=0x7f71380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71380a3240 0x7f71380a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f713c005e10 tx=0x7f713c0127c0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 -- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 msgr2=0x7f714c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:13.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 0x7f714c19ef10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f714402ade0 tx=0x7f71440319f0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 -- 172.21.15.1:0/545163602 shutdown_connections 2024-09-19T09:06:13.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f714c10e480 0x7f714c19ef10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f714c101280 0x7f714c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f71380a3240 0x7f71380a5700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 --2- 172.21.15.1:0/545163602 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f714c1008d0 0x7f714c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:13.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 -- 172.21.15.1:0/545163602 >> 172.21.15.1:0/545163602 conn(0x7f714c0fc7a0 msgr2=0x7f714c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:13.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 -- 172.21.15.1:0/545163602 shutdown_connections 2024-09-19T09:06:13.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:13.909+0000 7f7153a54640 1 -- 172.21.15.1:0/545163602 wait complete. 2024-09-19T09:06:14.650 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:06:14.651 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:06:14.910 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:15.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:15 smithi001 ceph-mon[30939]: pgmap v402: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-19T09:06:15.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:15 smithi064 ceph-mon[35179]: pgmap v402: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 -- 172.21.15.1:0/3959203269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4100a80 msgr2=0x7f9ab4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 --2- 172.21.15.1:0/3959203269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4100a80 0x7f9ab4100ee0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009930 tx=0x7f9aa802a420 comp rx=0 tx=0).stop 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 -- 172.21.15.1:0/3959203269 shutdown_connections 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 --2- 172.21.15.1:0/3959203269 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ab4101420 0x7f9ab410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 --2- 172.21.15.1:0/3959203269 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4100a80 0x7f9ab4100ee0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 --2- 172.21.15.1:0/3959203269 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ab4106a80 0x7f9ab4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 -- 172.21.15.1:0/3959203269 >> 172.21.15.1:0/3959203269 conn(0x7f9ab40fc7a0 msgr2=0x7f9ab40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 -- 172.21.15.1:0/3959203269 shutdown_connections 2024-09-19T09:06:15.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.355+0000 7f9abc763640 1 -- 172.21.15.1:0/3959203269 wait complete. 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abc763640 1 Processor -- start 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abc763640 1 -- start start 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abc763640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ab4100a80 0x7f9ab4102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abc763640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ab4101420 0x7f9ab4102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abc763640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4106a80 0x7f9ab41030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abc763640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab4110fa0 con 0x7f9ab4106a80 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abc763640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab4110e20 con 0x7f9ab4101420 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abc763640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab4111120 con 0x7f9ab4100a80 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abad00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4106a80 0x7f9ab41030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abad00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4106a80 0x7f9ab41030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41464/0 (socket says 172.21.15.1:41464) 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9abad00640 1 -- 172.21.15.1:0/2951273853 learned_addr learned my addr 172.21.15.1:0/2951273853 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.356+0000 7f9ab9cfe640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ab4101420 0x7f9ab4102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9aba4ff640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ab4100a80 0x7f9ab4102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:15.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9abad00640 1 -- 172.21.15.1:0/2951273853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ab4100a80 msgr2=0x7f9ab4102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9abad00640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ab4100a80 0x7f9ab4102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9abad00640 1 -- 172.21.15.1:0/2951273853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ab4101420 msgr2=0x7f9ab4102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9abad00640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ab4101420 0x7f9ab4102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9abad00640 1 -- 172.21.15.1:0/2951273853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab41a69e0 con 0x7f9ab4106a80 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9aba4ff640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ab4100a80 0x7f9ab4102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9abad00640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4106a80 0x7f9ab41030d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00eaa0 tx=0x7f9aac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9aa77fe640 1 -- 172.21.15.1:0/2951273853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac00cdb0 con 0x7f9ab4106a80 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9aa77fe640 1 -- 172.21.15.1:0/2951273853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9aac004b20 con 0x7f9ab4106a80 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab41a6cd0 con 0x7f9ab4106a80 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9aa77fe640 1 -- 172.21.15.1:0/2951273853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac011760 con 0x7f9ab4106a80 2024-09-19T09:06:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.357+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab41a71e0 con 0x7f9ab4106a80 2024-09-19T09:06:15.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.358+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab4100ee0 con 0x7f9ab4106a80 2024-09-19T09:06:15.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.359+0000 7f9aa77fe640 1 -- 172.21.15.1:0/2951273853 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f9aac011900 con 0x7f9ab4106a80 2024-09-19T09:06:15.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.360+0000 7f9aa77fe640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9aa00a32c0 0x7f9aa00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:15.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.360+0000 7f9aa77fe640 1 -- 172.21.15.1:0/2951273853 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9aac0cff30 con 0x7f9ab4106a80 2024-09-19T09:06:15.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.360+0000 7f9aba4ff640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9aa00a32c0 0x7f9aa00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:15.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.361+0000 7f9aba4ff640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9aa00a32c0 0x7f9aa00a5780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0005fd0 tx=0x7f9ab0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:15.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.363+0000 7f9aa77fe640 1 -- 172.21.15.1:0/2951273853 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9aac0ff210 con 0x7f9ab4106a80 2024-09-19T09:06:15.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:15 smithi022 ceph-mon[35107]: pgmap v402: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-19T09:06:15.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.581+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ab4103b80 con 0x7f9ab4106a80 2024-09-19T09:06:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.581+0000 7f9aa77fe640 1 -- 172.21.15.1:0/2951273853 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f9ab4103b80 con 0x7f9ab4106a80 2024-09-19T09:06:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:06:15.582 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:06:15.582 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:06:15.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9aa00a32c0 msgr2=0x7f9aa00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:15.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9aa00a32c0 0x7f9aa00a5780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0005fd0 tx=0x7f9ab0005850 comp rx=0 tx=0).stop 2024-09-19T09:06:15.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4106a80 msgr2=0x7f9ab41030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:15.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4106a80 0x7f9ab41030d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00eaa0 tx=0x7f9aac00ef60 comp rx=0 tx=0).stop 2024-09-19T09:06:15.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 shutdown_connections 2024-09-19T09:06:15.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ab4106a80 0x7f9ab41030d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ab4101420 0x7f9ab4102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9aa00a32c0 0x7f9aa00a5780 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 --2- 172.21.15.1:0/2951273853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ab4100a80 0x7f9ab4102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:15.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 >> 172.21.15.1:0/2951273853 conn(0x7f9ab40fc7a0 msgr2=0x7f9ab4104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:15.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 shutdown_connections 2024-09-19T09:06:15.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:15.584+0000 7f9abc763640 1 -- 172.21.15.1:0/2951273853 wait complete. 2024-09-19T09:06:16.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:16 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2951273853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:16.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:16 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2951273853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:16.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:06:16.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:16 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2951273853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:16.645 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 -- 172.21.15.1:0/1608706812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4101c40 msgr2=0x7fc9d41020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/1608706812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4101c40 0x7fc9d41020c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009ca0 tx=0x7fc9c402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 -- 172.21.15.1:0/1608706812 shutdown_connections 2024-09-19T09:06:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/1608706812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d4102600 0x7fc9d4108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/1608706812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4101c40 0x7fc9d41020c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/1608706812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9d4100a50 0x7fc9d4100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 -- 172.21.15.1:0/1608706812 >> 172.21.15.1:0/1608706812 conn(0x7fc9d40fc1b0 msgr2=0x7fc9d40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 -- 172.21.15.1:0/1608706812 shutdown_connections 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 -- 172.21.15.1:0/1608706812 wait complete. 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 Processor -- start 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.845+0000 7fc9dadc4640 1 -- start start 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9dadc4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9d4100a50 0x7fc9d406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9dadc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d4101c40 0x7fc9d419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9dadc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4102600 0x7fc9d419f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9dadc4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d410c830 con 0x7fc9d4102600 2024-09-19T09:06:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9dadc4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d410c6b0 con 0x7fc9d4101c40 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9dadc4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d410c9b0 con 0x7fc9d4100a50 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4102600 0x7fc9d419f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4102600 0x7fc9d419f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41474/0 (socket says 172.21.15.1:41474) 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 -- 172.21.15.1:0/4008278760 learned_addr learned my addr 172.21.15.1:0/4008278760 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9d4100a50 0x7fc9d406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d4101c40 0x7fc9d419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 -- 172.21.15.1:0/4008278760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9d4100a50 msgr2=0x7fc9d406ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9d4100a50 0x7fc9d406ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 -- 172.21.15.1:0/4008278760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d4101c40 msgr2=0x7fc9d419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d4101c40 0x7fc9d419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 -- 172.21.15.1:0/4008278760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d419fc70 con 0x7fc9d4102600 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d4101c40 0x7fc9d419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d9361640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4102600 0x7fc9d419f360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00d950 tx=0x7fc9cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d1ffb640 1 -- 172.21.15.1:0/4008278760 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc017030 con 0x7fc9d4102600 2024-09-19T09:06:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9d1ffb640 1 -- 172.21.15.1:0/4008278760 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9cc004020 con 0x7fc9d4102600 2024-09-19T09:06:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.846+0000 7fc9dadc4640 1 -- 172.21.15.1:0/4008278760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d419ff00 con 0x7fc9d4102600 2024-09-19T09:06:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.847+0000 7fc9d1ffb640 1 -- 172.21.15.1:0/4008278760 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc003cf0 con 0x7fc9d4102600 2024-09-19T09:06:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.847+0000 7fc9dadc4640 1 -- 172.21.15.1:0/4008278760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d41a0370 con 0x7fc9d4102600 2024-09-19T09:06:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9d1ffb640 1 -- 172.21.15.1:0/4008278760 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fc9cc01a070 con 0x7fc9d4102600 2024-09-19T09:06:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9ddc3d740 1 Processor -- start 2024-09-19T09:06:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9ddc3d740 1 -- start start 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dcc1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 0x56354dcc6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcc9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56354dc252f0 con 0x56354dcc7370 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56354dbcd270 con 0x56354dcc19a0 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.849+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56354dc212b0 con 0x56354dcc22e0 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d1ffb640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9c00a3240 0x7fc9c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcc9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcc9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41482/0 (socket says 172.21.15.1:41482) 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 -- 172.21.15.1:0/3131672291 learned_addr learned my addr 172.21.15.1:0/3131672291 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 0x56354dcc6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d9361640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9c00a3240 0x7fc9c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dcc1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d1ffb640 1 -- 172.21.15.1:0/4008278760 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc9cc0cf150 con 0x7fc9d4102600 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 -- 172.21.15.1:0/3131672291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 msgr2=0x56354dcc6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 0x56354dcc6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 -- 172.21.15.1:0/3131672291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 msgr2=0x56354dcc1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dcc1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 -- 172.21.15.1:0/3131672291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354dbcc340 con 0x56354dcc7370 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 0x56354dcc6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcc9830 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005e30 tx=0x7fc9c4005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810e74f134077096 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9d9361640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9c00a3240 0x7fc9c00a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc097b50 tx=0x7fc9cc06e570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9caffd640 1 -- 172.21.15.1:0/3131672291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4003b70 con 0x56354dcc7370 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9caffd640 1 -- 172.21.15.1:0/3131672291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9c4036040 con 0x56354dcc7370 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.850+0000 7fc9caffd640 1 -- 172.21.15.1:0/3131672291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4004500 con 0x56354dcc7370 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/3131672291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 msgr2=0x56354dcc9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcc9830 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005e30 tx=0x7fc9c4005d80 comp rx=0 tx=0).stop 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/3131672291 shutdown_connections 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcc9830 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 0x56354dcc6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/3131672291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dcc1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/3131672291 >> 172.21.15.1:0/3131672291 conn(0x56354dcbd010 msgr2=0x56354dcbd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/3131672291 shutdown_connections 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/3131672291 wait complete. 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.851+0000 7fc9ddc3d740 1 -- start start 2024-09-19T09:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9ddc3d740 1 Processor -- start 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dccbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dccc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 0x56354dcd30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56354dcca2e0 con 0x56354dcc22e0 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56354dbae290 con 0x56354dcc19a0 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56354dcca460 con 0x56354dcc7370 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9ddc3d740 10 client.0 _ll_register_callbacks cb 0x56354dbdf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d8b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dccc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d8b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dccc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41486/0 (socket says 172.21.15.1:41486) 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d8b60640 1 -- 172.21.15.1:0/2541540217 learned_addr learned my addr 172.21.15.1:0/2541540217 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 0x56354dcd30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d8b60640 1 -- 172.21.15.1:0/2541540217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 msgr2=0x56354dcd30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 0x56354dcd30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dccbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d8b60640 1 -- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 msgr2=0x56354dccbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dccbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d8b60640 1 -- 172.21.15.1:0/2541540217 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354d938210 con 0x56354dcc22e0 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.852+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dccbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dccc0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00bf50 tx=0x7fc9bc0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b8e631a53f9fce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9b3fff640 1 -- 172.21.15.1:0/2541540217 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc005020 con 0x56354dcc22e0 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9b3fff640 1 -- 172.21.15.1:0/2541540217 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc9bc0051c0 con 0x56354dcc22e0 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2541540217 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c4036040 con 0x56354dcc22e0 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9b3fff640 1 -- 172.21.15.1:0/2541540217 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc9bc005400 con 0x56354dcc22e0 2024-09-19T09:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 10 client.16029 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2541540217 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56354da04620 con 0x56354dcc22e0 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9b3fff640 1 -- 172.21.15.1:0/2541540217 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9c4036040 con 0x56354dcc22e0 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9b3fff640 1 -- 172.21.15.1:0/2541540217 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc9bc010a80 con 0x56354dcc22e0 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 10 client.16029 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 20 client.16029 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56354dcd77f0 0x56354dcd9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 4 client.16029 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.853+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2541540217 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56354dc32a20 con 0x56354dcd77f0 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.854+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56354dcd77f0 0x56354dcd9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.854+0000 7fc9b3fff640 10 client.16029 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.854+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56354dcd77f0 0x56354dcd9c40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8820f1e5b550b404 server_cookie=96fbe09f08c2b160 in_seq=0 out_seq=0 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9b3fff640 1 -- 172.21.15.1:0/2541540217 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56354dc32a20 con 0x56354dcd77f0 2024-09-19T09:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9b3fff640 10 client.16029 handle_command_reply: tid=0 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 client.16029 shutdown 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2541540217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 msgr2=0x56354dccc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dccc0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00bf50 tx=0x7fc9bc0118d0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2541540217 shutdown_connections 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56354dcd77f0 0x56354dcd9c40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 0x56354dcd30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9b3fff640 0 client.16029 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dccc0a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2541540217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dccbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2541540217 >> 172.21.15.1:0/2541540217 conn(0x56354dcbd010 msgr2=0x56354dcbe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2541540217 shutdown_connections 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2541540217 wait complete. 2024-09-19T09:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.855+0000 7fc9ddc3d740 20 client.16029 trim_cache size 0 max 16384 2024-09-19T09:06:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ddc3d740 1 Processor -- start 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ddc3d740 1 -- start start 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dcbc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 0x56354dcbe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcbe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d41abbe0 con 0x56354dcc7370 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d41a94b0 con 0x56354dcc19a0 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d41a7300 con 0x56354dcc22e0 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcbe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcbe940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41490/0 (socket says 172.21.15.1:41490) 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 -- 172.21.15.1:0/2399771338 learned_addr learned my addr 172.21.15.1:0/2399771338 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2399771338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dcbc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 -- 172.21.15.1:0/2399771338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 msgr2=0x56354dcbe400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2399771338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 0x56354dcbe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 -- 172.21.15.1:0/2399771338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 msgr2=0x56354dcbc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2399771338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dcbc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 -- 172.21.15.1:0/2399771338 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354dcbce30 con 0x56354dcc7370 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/2399771338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcbe940 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4004af0 tx=0x7fc9c402f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4107ee465b39fb89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.870+0000 7fc9ca7fc640 1 -- 172.21.15.1:0/2399771338 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4004d90 con 0x56354dcc7370 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ca7fc640 1 -- 172.21.15.1:0/2399771338 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9c4036070 con 0x56354dcc7370 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ca7fc640 1 -- 172.21.15.1:0/2399771338 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40041b0 con 0x56354dcc7370 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2399771338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 msgr2=0x56354dcbe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2399771338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcbe940 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4004af0 tx=0x7fc9c402f310 comp rx=0 tx=0).stop 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2399771338 shutdown_connections 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2399771338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc7370 0x56354dcbe940 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2399771338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc22e0 0x56354dcbe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/2399771338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dcbc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2399771338 >> 172.21.15.1:0/2399771338 conn(0x56354dcbd010 msgr2=0x56354dcbb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2399771338 shutdown_connections 2024-09-19T09:06:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/2399771338 wait complete. 2024-09-19T09:06:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 -- start start 2024-09-19T09:06:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.871+0000 7fc9ddc3d740 1 Processor -- start 2024-09-19T09:06:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dd3d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dd3de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9ddc3d740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 0x56354dd44ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d41a7970 con 0x56354dcc22e0 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d41a8de0 con 0x56354dcc19a0 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9ddc3d740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d41a8040 con 0x56354dcc7370 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9ddc3d740 10 client.0 _ll_register_callbacks cb 0x7fc9bc00b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dd3de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dd3de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41496/0 (socket says 172.21.15.1:41496) 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 -- 172.21.15.1:0/999485010 learned_addr learned my addr 172.21.15.1:0/999485010 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dd3d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 -- 172.21.15.1:0/999485010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 msgr2=0x56354dd44ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 0x56354dd44ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 -- 172.21.15.1:0/999485010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 msgr2=0x56354dd3d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dd3d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 -- 172.21.15.1:0/999485010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354dd454e0 con 0x56354dcc22e0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9d8b60640 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dd3de90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc010f40 tx=0x7fc9bc0056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8ecc81b1ef0c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.872+0000 7fc9b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9b3fff640 1 -- 172.21.15.1:0/999485010 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc032060 con 0x56354dcc22e0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9b3fff640 1 -- 172.21.15.1:0/999485010 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc9bc01a8b0 con 0x56354dcc22e0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/999485010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c4036070 con 0x56354dcc22e0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9b3fff640 1 -- 172.21.15.1:0/999485010 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc9bc029040 con 0x56354dcc22e0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 10 client.16035 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/999485010 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56354dd46850 con 0x56354dcc22e0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9b3fff640 1 -- 172.21.15.1:0/999485010 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9c4036070 con 0x56354dcc22e0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9b3fff640 1 -- 172.21.15.1:0/999485010 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc9bc0255f0 con 0x56354dcc22e0 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 10 client.16035 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 20 client.16035 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56354dcd77f0 0x56354dd49270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 4 client.16035 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.873+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/999485010 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56354dc2cd70 con 0x56354dcd77f0 2024-09-19T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.874+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56354dcd77f0 0x56354dd49270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.874+0000 7fc9b3fff640 10 client.16035 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.874+0000 7fc9d3fff640 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56354dcd77f0 0x56354dd49270 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfc9f16466e99a2e server_cookie=946688f3ddbad64c in_seq=0 out_seq=0 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9b3fff640 1 -- 172.21.15.1:0/999485010 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56354dc2cd70 con 0x56354dcd77f0 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9b3fff640 10 client.16035 handle_command_reply: tid=0 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 client.16035 shutdown 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/999485010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 msgr2=0x56354dd3de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dd3de90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc010f40 tx=0x7fc9bc0056f0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/999485010 shutdown_connections 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56354dcd77f0 0x56354dd49270 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56354dcc7370 0x56354dd44ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56354dcc22e0 0x56354dd3de90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9b3fff640 0 client.16035 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 --2- 172.21.15.1:0/999485010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56354dcc19a0 0x56354dd3d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.881+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/999485010 >> 172.21.15.1:0/999485010 conn(0x56354dcbd010 msgr2=0x56354dcbc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/999485010 shutdown_connections 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9ddc3d740 1 -- 172.21.15.1:0/999485010 wait complete. 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9ddc3d740 20 client.16035 trim_cache size 0 max 16384 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 -- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9c00a3240 msgr2=0x7fc9c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9c00a3240 0x7fc9c00a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc097b50 tx=0x7fc9cc06e570 comp rx=0 tx=0).stop 2024-09-19T09:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 -- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4102600 msgr2=0x7fc9d419f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4102600 0x7fc9d419f360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00d950 tx=0x7fc9cc00de10 comp rx=0 tx=0).stop 2024-09-19T09:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 -- 172.21.15.1:0/4008278760 shutdown_connections 2024-09-19T09:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9d4102600 0x7fc9d419f360 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc9d4101c40 0x7fc9d419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc9c00a3240 0x7fc9c00a5700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 --2- 172.21.15.1:0/4008278760 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9d4100a50 0x7fc9d406ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 -- 172.21.15.1:0/4008278760 >> 172.21.15.1:0/4008278760 conn(0x7fc9d40fc1b0 msgr2=0x7fc9d4104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 -- 172.21.15.1:0/4008278760 shutdown_connections 2024-09-19T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:16.882+0000 7fc9dadc4640 1 -- 172.21.15.1:0/4008278760 wait complete. 2024-09-19T09:06:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.116+0000 7f8e349d1640 1 -- 172.21.15.1:0/61155265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30106f50 msgr2=0x7f8e3010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.116+0000 7f8e349d1640 1 --2- 172.21.15.1:0/61155265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30106f50 0x7f8e3010eaf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009cd0 tx=0x7f8e2802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.116+0000 7f8e349d1640 1 -- 172.21.15.1:0/61155265 shutdown_connections 2024-09-19T09:06:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.116+0000 7f8e349d1640 1 --2- 172.21.15.1:0/61155265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30106f50 0x7f8e3010eaf0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.116+0000 7f8e349d1640 1 --2- 172.21.15.1:0/61155265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e30100d00 0x7f8e30106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.116+0000 7f8e349d1640 1 --2- 172.21.15.1:0/61155265 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e30100350 0x7f8e30100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.116+0000 7f8e349d1640 1 -- 172.21.15.1:0/61155265 >> 172.21.15.1:0/61155265 conn(0x7f8e30077210 msgr2=0x7f8e300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.117+0000 7f8e349d1640 1 -- 172.21.15.1:0/61155265 shutdown_connections 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.117+0000 7f8e349d1640 1 -- 172.21.15.1:0/61155265 wait complete. 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.117+0000 7f8e349d1640 1 Processor -- start 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.117+0000 7f8e349d1640 1 -- start start 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e349d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e30100350 0x7f8e30198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e349d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30100d00 0x7f8e30198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e349d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e30106f50 0x7f8e3019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e349d1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301120c0 con 0x7f8e30100d00 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e349d1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30111f40 con 0x7f8e30106f50 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e349d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30112240 con 0x7f8e30100350 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30100d00 0x7f8e30198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30100d00 0x7f8e30198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41510/0 (socket says 172.21.15.1:41510) 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 -- 172.21.15.1:0/2583502279 learned_addr learned my addr 172.21.15.1:0/2583502279 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e30100350 0x7f8e30198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e30106f50 0x7f8e3019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 -- 172.21.15.1:0/2583502279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e30100350 msgr2=0x7f8e30198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e30100350 0x7f8e30198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 -- 172.21.15.1:0/2583502279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e30106f50 msgr2=0x7f8e3019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e30106f50 0x7f8e3019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 -- 172.21.15.1:0/2583502279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3019d4f0 con 0x7f8e30100d00 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30100d00 0x7f8e30198a80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8e18005fd0 tx=0x7f8e1800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e277fe640 1 -- 172.21.15.1:0/2583502279 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18017070 con 0x7f8e30100d00 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e349d1640 1 -- 172.21.15.1:0/2583502279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3019d7e0 con 0x7f8e30100d00 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e277fe640 1 -- 172.21.15.1:0/2583502279 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e18009c30 con 0x7f8e30100d00 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e277fe640 1 -- 172.21.15.1:0/2583502279 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18010460 con 0x7f8e30100d00 2024-09-19T09:06:17.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.118+0000 7f8e349d1640 1 -- 172.21.15.1:0/2583502279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e301a50c0 con 0x7f8e30100d00 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e277fe640 1 -- 172.21.15.1:0/2583502279 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f8e18003eb0 con 0x7f8e30100d00 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e36daa740 1 Processor -- start 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e36daa740 1 -- start start 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d26b40 0x560919d25090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d255d0 0x560919d25a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d36b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e36daa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560919c8b2f0 con 0x560919d255d0 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e36daa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560919c32cf0 con 0x560919d26b40 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.121+0000 7f8e36daa740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560919c872b0 con 0x560919d34780 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d255d0 0x560919d25a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d255d0 0x560919d25a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41518/0 (socket says 172.21.15.1:41518) 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 -- 172.21.15.1:0/3849023417 learned_addr learned my addr 172.21.15.1:0/3849023417 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:17.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d26b40 0x560919d25090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d36b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e277fe640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8e1c0a3240 0x7f8e1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 -- 172.21.15.1:0/3849023417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 msgr2=0x560919d36b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d36b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 -- 172.21.15.1:0/3849023417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d26b40 msgr2=0x560919d25090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d26b40 0x560919d25090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 -- 172.21.15.1:0/3849023417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560919c173a0 con 0x560919d255d0 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8e1c0a3240 0x7f8e1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e277fe640 1 -- 172.21.15.1:0/2583502279 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8e180cf4d0 con 0x7f8e30100d00 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d255d0 0x560919d25a10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000bd10 tx=0x7f8e200107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b532fd01f837efa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e24ff9640 1 -- 172.21.15.1:0/3849023417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20004030 con 0x560919d255d0 2024-09-19T09:06:17.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e24ff9640 1 -- 172.21.15.1:0/3849023417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e200041d0 con 0x560919d255d0 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.122+0000 7f8e24ff9640 1 -- 172.21.15.1:0/3849023417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e200118c0 con 0x560919d255d0 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 -- 172.21.15.1:0/3849023417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d255d0 msgr2=0x560919d25a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d255d0 0x560919d25a10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000bd10 tx=0x7f8e200107a0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8e1c0a3240 0x7f8e1c0a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8e28006010 tx=0x7f8e280095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 -- 172.21.15.1:0/3849023417 shutdown_connections 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d36b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d255d0 0x560919d25a10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3849023417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d26b40 0x560919d25090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 -- 172.21.15.1:0/3849023417 >> 172.21.15.1:0/3849023417 conn(0x560919cee310 msgr2=0x560919d21c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 -- 172.21.15.1:0/3849023417 shutdown_connections 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.123+0000 7f8e36daa740 1 -- 172.21.15.1:0/3849023417 wait complete. 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 1 -- start start 2024-09-19T09:06:17.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 1 Processor -- start 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d34140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 0x560919d313f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d319e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560919d37480 con 0x560919d34780 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560919c46060 con 0x560919d255d0 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560919d37600 con 0x560919d26b40 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e36daa740 10 client.0 _ll_register_callbacks cb 0x5609199998c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e2ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e2ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d319e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41530/0 (socket says 172.21.15.1:41530) 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e2ed9d640 1 -- 172.21.15.1:0/266336690 learned_addr learned my addr 172.21.15.1:0/266336690 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d34140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.124+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 0x560919d313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e2ed9d640 1 -- 172.21.15.1:0/266336690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 msgr2=0x560919d313f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 0x560919d313f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e2ed9d640 1 -- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 msgr2=0x560919d34140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d34140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e2ed9d640 1 -- 172.21.15.1:0/266336690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609199fc3c0 con 0x560919d34780 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d34140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d319e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8e28035000 tx=0x7f8e2802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af39938d1d48de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e15ffb640 1 -- 172.21.15.1:0/266336690 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28055060 con 0x560919d34780 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e15ffb640 1 -- 172.21.15.1:0/266336690 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8e280305a0 con 0x560919d34780 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e36daa740 1 -- 172.21.15.1:0/266336690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e200041d0 con 0x560919d34780 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e15ffb640 1 -- 172.21.15.1:0/266336690 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8e280317b0 con 0x560919d34780 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e36daa740 10 client.16047 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:17.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e36daa740 1 -- 172.21.15.1:0/266336690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560919d42f30 con 0x560919d34780 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.125+0000 7f8e15ffb640 1 -- 172.21.15.1:0/266336690 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e200041d0 con 0x560919d34780 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e15ffb640 1 -- 172.21.15.1:0/266336690 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8e28030070 con 0x560919d34780 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e36daa740 10 client.16047 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e36daa740 10 client.16047 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e36daa740 20 client.16047 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e36daa740 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560919d443f0 0x560919d46800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e36daa740 4 client.16047 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e36daa740 1 -- 172.21.15.1:0/266336690 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560919c98860 con 0x560919d443f0 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560919d443f0 0x560919d46800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560919d443f0 0x560919d46800 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b91da41dad8f95bf server_cookie=faec62e9fef62929 in_seq=0 out_seq=0 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.126+0000 7f8e15ffb640 10 client.16047 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e15ffb640 1 -- 172.21.15.1:0/266336690 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560919c98860 con 0x560919d443f0 2024-09-19T09:06:17.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e15ffb640 10 client.16047 handle_command_reply: tid=0 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 client.16047 shutdown 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 -- 172.21.15.1:0/266336690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 msgr2=0x560919d319e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d319e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8e28035000 tx=0x7f8e2802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 -- 172.21.15.1:0/266336690 shutdown_connections 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560919d443f0 0x560919d46800 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e15ffb640 0 client.16047 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d319e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 0x560919d313f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 --2- 172.21.15.1:0/266336690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d34140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 -- 172.21.15.1:0/266336690 >> 172.21.15.1:0/266336690 conn(0x560919cee310 msgr2=0x560919d27960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 -- 172.21.15.1:0/266336690 shutdown_connections 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 1 -- 172.21.15.1:0/266336690 wait complete. 2024-09-19T09:06:17.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.127+0000 7f8e36daa740 20 client.16047 trim_cache size 0 max 16384 2024-09-19T09:06:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.141+0000 7f8e36daa740 1 Processor -- start 2024-09-19T09:06:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.141+0000 7f8e36daa740 1 -- start start 2024-09-19T09:06:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.141+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d21e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.141+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 0x560919d40720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.141+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d30cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.141+0000 7f8e36daa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301addf0 con 0x560919d34780 2024-09-19T09:06:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.141+0000 7f8e36daa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301ab6c0 con 0x560919d255d0 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.141+0000 7f8e36daa740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301a9510 con 0x560919d26b40 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d30cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d30cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41532/0 (socket says 172.21.15.1:41532) 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 -- 172.21.15.1:0/1367817153 learned_addr learned my addr 172.21.15.1:0/1367817153 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d21e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 0x560919d40720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 -- 172.21.15.1:0/1367817153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 msgr2=0x560919d40720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 0x560919d40720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 -- 172.21.15.1:0/1367817153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 msgr2=0x560919d21e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d21e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 -- 172.21.15.1:0/1367817153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560919d303a0 con 0x560919d34780 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d30cb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009a60 tx=0x7f8e28004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1894ffff5e787 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e17fff640 1 -- 172.21.15.1:0/1367817153 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28055040 con 0x560919d34780 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e17fff640 1 -- 172.21.15.1:0/1367817153 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e28036040 con 0x560919d34780 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.142+0000 7f8e17fff640 1 -- 172.21.15.1:0/1367817153 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e280454e0 con 0x560919d34780 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 -- 172.21.15.1:0/1367817153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 msgr2=0x560919d30cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d30cb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009a60 tx=0x7f8e28004410 comp rx=0 tx=0).stop 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 -- 172.21.15.1:0/1367817153 shutdown_connections 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d34780 0x560919d30cb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d26b40 0x560919d40720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 --2- 172.21.15.1:0/1367817153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d21e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 -- 172.21.15.1:0/1367817153 >> 172.21.15.1:0/1367817153 conn(0x560919cee310 msgr2=0x560919d21700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 -- 172.21.15.1:0/1367817153 shutdown_connections 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.143+0000 7f8e36daa740 1 -- 172.21.15.1:0/1367817153 wait complete. 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 1 -- start start 2024-09-19T09:06:17.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 1 Processor -- start 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d3ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d26b40 0x560919d37ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d38530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301a9b80 con 0x560919d26b40 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301aaff0 con 0x560919d255d0 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301aa250 con 0x560919d34780 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e36daa740 10 client.0 _ll_register_callbacks cb 0x7f8e28031700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d26b40 0x560919d37ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d26b40 0x560919d37ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41534/0 (socket says 172.21.15.1:41534) 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2dd9b640 1 -- 172.21.15.1:0/3915407976 learned_addr learned my addr 172.21.15.1:0/3915407976 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d3ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2dd9b640 1 -- 172.21.15.1:0/3915407976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 msgr2=0x560919d38530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d38530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d38530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2dd9b640 1 -- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 msgr2=0x560919d3ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d3ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2dd9b640 1 -- 172.21.15.1:0/3915407976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560919d38a70 con 0x560919d26b40 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2ed9d640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d38530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.144+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d3ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e2dd9b640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d26b40 0x560919d37ff0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8e180ccfb0 tx=0x7f8e1809b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a97b79c72d1de52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e15ffb640 1 -- 172.21.15.1:0/3915407976 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18009de0 con 0x560919d26b40 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e15ffb640 1 -- 172.21.15.1:0/3915407976 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8e18098140 con 0x560919d26b40 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 1 -- 172.21.15.1:0/3915407976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e28036040 con 0x560919d26b40 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e15ffb640 1 -- 172.21.15.1:0/3915407976 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8e1809bad0 con 0x560919d26b40 2024-09-19T09:06:17.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 10 client.16053 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 1 -- 172.21.15.1:0/3915407976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560919daee20 con 0x560919d26b40 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e15ffb640 1 -- 172.21.15.1:0/3915407976 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e28036040 con 0x560919d26b40 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e15ffb640 1 -- 172.21.15.1:0/3915407976 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8e1809bd30 con 0x560919d26b40 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 10 client.16053 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 10 client.16053 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 20 client.16053 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560919d443f0 0x560919db1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 4 client.16053 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.145+0000 7f8e36daa740 1 -- 172.21.15.1:0/3915407976 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560919c92d70 con 0x560919d443f0 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560919d443f0 0x560919db1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e2e59c640 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560919d443f0 0x560919db1680 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=164194427dd33b34 server_cookie=4ba6a202a313706b in_seq=0 out_seq=0 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e15ffb640 10 client.16053 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:06:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e15ffb640 1 -- 172.21.15.1:0/3915407976 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560919c92d70 con 0x560919d443f0 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e15ffb640 10 client.16053 handle_command_reply: tid=0 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e36daa740 1 client.16053 shutdown 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e36daa740 1 -- 172.21.15.1:0/3915407976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d26b40 msgr2=0x560919d37ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d26b40 0x560919d37ff0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8e180ccfb0 tx=0x7f8e1809b960 comp rx=0 tx=0).stop 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e36daa740 1 -- 172.21.15.1:0/3915407976 shutdown_connections 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x560919d443f0 0x560919db1680 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.146+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560919d34780 0x560919d38530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e15ffb640 0 client.16053 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560919d26b40 0x560919d37ff0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e36daa740 1 --2- 172.21.15.1:0/3915407976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560919d255d0 0x560919d3ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e36daa740 1 -- 172.21.15.1:0/3915407976 >> 172.21.15.1:0/3915407976 conn(0x560919cee310 msgr2=0x560919d21680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e36daa740 1 -- 172.21.15.1:0/3915407976 shutdown_connections 2024-09-19T09:06:17.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e36daa740 1 -- 172.21.15.1:0/3915407976 wait complete. 2024-09-19T09:06:17.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e36daa740 20 client.16053 trim_cache size 0 max 16384 2024-09-19T09:06:17.162 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:06:17.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 -- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8e1c0a3240 msgr2=0x7f8e1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8e1c0a3240 0x7f8e1c0a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8e28006010 tx=0x7f8e280095c0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 -- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30100d00 msgr2=0x7f8e30198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30100d00 0x7f8e30198a80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8e18005fd0 tx=0x7f8e1800dde0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 -- 172.21.15.1:0/2583502279 shutdown_connections 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e30106f50 0x7f8e3019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8e30100d00 0x7f8e30198a80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f8e1c0a3240 0x7f8e1c0a5700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 --2- 172.21.15.1:0/2583502279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8e30100350 0x7f8e30198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.147+0000 7f8e349d1640 1 -- 172.21.15.1:0/2583502279 >> 172.21.15.1:0/2583502279 conn(0x7f8e30077210 msgr2=0x7f8e30105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:17.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.148+0000 7f8e349d1640 1 -- 172.21.15.1:0/2583502279 shutdown_connections 2024-09-19T09:06:17.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:17.148+0000 7f8e349d1640 1 -- 172.21.15.1:0/2583502279 wait complete. 2024-09-19T09:06:17.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:17 smithi001 ceph-mon[30939]: pgmap v403: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:06:17.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:17 smithi064 ceph-mon[35179]: pgmap v403: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:06:17.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:17 smithi022 ceph-mon[35107]: pgmap v403: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:06:17.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:06:18.085 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:18.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 -- 172.21.15.1:0/2322855842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102d30 msgr2=0x7f3154103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 --2- 172.21.15.1:0/2322855842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102d30 0x7f3154103110 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3144009930 tx=0x7f314402a420 comp rx=0 tx=0).stop 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 -- 172.21.15.1:0/2322855842 shutdown_connections 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 --2- 172.21.15.1:0/2322855842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31541082a0 0x7f315410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 --2- 172.21.15.1:0/2322855842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541036e0 0x7f3154107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 --2- 172.21.15.1:0/2322855842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3154102d30 0x7f3154103110 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 -- 172.21.15.1:0/2322855842 >> 172.21.15.1:0/2322855842 conn(0x7f31540fc7d0 msgr2=0x7f31540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 -- 172.21.15.1:0/2322855842 shutdown_connections 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.530+0000 7f315a818640 1 -- 172.21.15.1:0/2322855842 wait complete. 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f315a818640 1 Processor -- start 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f315a818640 1 -- start start 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f315a818640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154102d30 0x7f3154100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f315a818640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31541036e0 0x7f3154100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f315a818640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541082a0 0x7f3154101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f315a818640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31541121c0 con 0x7f31541036e0 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f315a818640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3154112040 con 0x7f3154102d30 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f315a818640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3154112340 con 0x7f31541082a0 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f31537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31541036e0 0x7f3154100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f31537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31541036e0 0x7f3154100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41556/0 (socket says 172.21.15.1:41556) 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.531+0000 7f31537fe640 1 -- 172.21.15.1:0/3426023797 learned_addr learned my addr 172.21.15.1:0/3426023797 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f3153fff640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154102d30 0x7f3154100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f3158db5640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541082a0 0x7f3154101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31537fe640 1 -- 172.21.15.1:0/3426023797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541082a0 msgr2=0x7f3154101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31537fe640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541082a0 0x7f3154101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31537fe640 1 -- 172.21.15.1:0/3426023797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154102d30 msgr2=0x7f3154100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31537fe640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154102d30 0x7f3154100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31537fe640 1 -- 172.21.15.1:0/3426023797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31541a6b50 con 0x7f31541036e0 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f3158db5640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541082a0 0x7f3154101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31537fe640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31541036e0 0x7f3154100ed0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f314800c970 tx=0x7f314800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31517fa640 1 -- 172.21.15.1:0/3426023797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148007bb0 con 0x7f31541036e0 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31517fa640 1 -- 172.21.15.1:0/3426023797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3148007d50 con 0x7f31541036e0 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f315a818640 1 -- 172.21.15.1:0/3426023797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31541a6e40 con 0x7f31541036e0 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f31517fa640 1 -- 172.21.15.1:0/3426023797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314800f450 con 0x7f31541036e0 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.532+0000 7f315a818640 1 -- 172.21.15.1:0/3426023797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541a7340 con 0x7f31541036e0 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.534+0000 7f31517fa640 1 -- 172.21.15.1:0/3426023797 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f3148005000 con 0x7f31541036e0 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f315cbf1740 1 Processor -- start 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f315cbf1740 1 -- start start 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751026090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751026a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751031370 0x55e751033760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f315cbf1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e750f8c2f0 con 0x55e751027b40 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f315cbf1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e750f33cf0 con 0x55e751031370 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f315cbf1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e750f882b0 con 0x55e7510265d0 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f3158db5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751026090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f3158db5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751026090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41572/0 (socket says 172.21.15.1:41572) 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f3158db5640 1 -- 172.21.15.1:0/3829615205 learned_addr learned my addr 172.21.15.1:0/3829615205 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f3153fff640 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751026a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f31517fa640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f313c0a32c0 0x7f313c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.535+0000 7f31537fe640 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751031370 0x55e751033760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f3158db5640 1 -- 172.21.15.1:0/3829615205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 msgr2=0x55e751026a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f3158db5640 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751026a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f3158db5640 1 -- 172.21.15.1:0/3829615205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751031370 msgr2=0x55e751033760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:18.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f3158db5640 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751031370 0x55e751033760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f3158db5640 1 -- 172.21.15.1:0/3829615205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e750f183a0 con 0x55e751027b40 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f3153fff640 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751026a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f31537fe640 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751031370 0x55e751033760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f31517fa640 1 -- 172.21.15.1:0/3426023797 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f31480cf710 con 0x7f31541036e0 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f3158db5640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f313c0a32c0 0x7f313c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f3158db5640 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751026090 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f314c009fa0 tx=0x7f314c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35ce45c61b81d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f313a7fc640 1 -- 172.21.15.1:0/3829615205 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c01a610 con 0x55e751027b40 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f313a7fc640 1 -- 172.21.15.1:0/3829615205 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f314c01acb0 con 0x55e751027b40 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.536+0000 7f313a7fc640 1 -- 172.21.15.1:0/3829615205 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c010a40 con 0x55e751027b40 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 -- 172.21.15.1:0/3829615205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 msgr2=0x55e751026090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f3158db5640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f313c0a32c0 0x7f313c0a5780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f314c020000 tx=0x7f314c01d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751026090 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f314c009fa0 tx=0x7f314c00f7f0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 -- 172.21.15.1:0/3829615205 shutdown_connections 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751031370 0x55e751033760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751026a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3829615205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751026090 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 -- 172.21.15.1:0/3829615205 >> 172.21.15.1:0/3829615205 conn(0x55e750fef310 msgr2=0x55e751022c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 -- 172.21.15.1:0/3829615205 shutdown_connections 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 -- 172.21.15.1:0/3829615205 wait complete. 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.537+0000 7f315cbf1740 1 -- start start 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f315cbf1740 1 Processor -- start 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e751030ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e75102df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 0x55e75102e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f315cbf1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e751034070 con 0x55e751027b40 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f315cbf1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e750f47060 con 0x55e7510265d0 2024-09-19T09:06:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f315cbf1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55e7510341f0 con 0x55e751031370 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f315cbf1740 10 client.0 _ll_register_callbacks cb 0x55e750c9a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f31537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e75102df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f3153fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e751030ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f3153fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e751030ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:35224/0 (socket says 172.21.15.1:35224) 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f3153fff640 1 -- 172.21.15.1:0/3318645377 learned_addr learned my addr 172.21.15.1:0/3318645377 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f3158db5640 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 0x55e75102e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.538+0000 7f3153fff640 1 -- 172.21.15.1:0/3318645377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 msgr2=0x55e75102e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f3153fff640 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 0x55e75102e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f3153fff640 1 -- 172.21.15.1:0/3318645377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 msgr2=0x55e75102df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f3153fff640 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e75102df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f3153fff640 1 -- 172.21.15.1:0/3318645377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e750cfd3c0 con 0x55e7510265d0 2024-09-19T09:06:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f31537fe640 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e75102df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f3153fff640 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e751030ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f314402a940 tx=0x7f31440318d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b363e52ff93d0bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f31337fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:06:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f31337fe640 1 -- 172.21.15.1:0/3318645377 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144035070 con 0x55e7510265d0 2024-09-19T09:06:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f31337fe640 1 -- 172.21.15.1:0/3318645377 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3144004240 con 0x55e7510265d0 2024-09-19T09:06:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f315cbf1740 1 -- 172.21.15.1:0/3318645377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f314c01acb0 con 0x55e7510265d0 2024-09-19T09:06:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f31337fe640 1 -- 172.21.15.1:0/3318645377 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f314404a070 con 0x55e7510265d0 2024-09-19T09:06:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f315cbf1740 10 client.25574 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.539+0000 7f315cbf1740 1 -- 172.21.15.1:0/3318645377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e75103fab0 con 0x55e7510265d0 2024-09-19T09:06:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f31337fe640 1 -- 172.21.15.1:0/3318645377 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f314c01acb0 con 0x55e7510265d0 2024-09-19T09:06:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f31337fe640 1 -- 172.21.15.1:0/3318645377 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3144004ac0 con 0x55e7510265d0 2024-09-19T09:06:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f315cbf1740 10 client.25574 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f315cbf1740 10 client.25574 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:06:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f315cbf1740 20 client.25574 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55e751040f70 0x55e751043360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f315cbf1740 4 client.25574 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f315cbf1740 1 -- 172.21.15.1:0/3318645377 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e750f99860 con 0x55e751040f70 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.540+0000 7f31537fe640 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55e751040f70 0x55e751043360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.541+0000 7f31337fe640 10 client.25574 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.541+0000 7f31537fe640 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55e751040f70 0x55e751043360 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=917453dc928c73fb server_cookie=3038e4178d2aaa0e in_seq=0 out_seq=0 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.541+0000 7f31337fe640 1 -- 172.21.15.1:0/3318645377 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e750f99860 con 0x55e751040f70 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.541+0000 7f31337fe640 10 client.25574 handle_command_reply: tid=0 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.541+0000 7f315cbf1740 1 client.25574 shutdown 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 -- 172.21.15.1:0/3318645377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 msgr2=0x55e751030ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e751030ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f314402a940 tx=0x7f31440318d0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 -- 172.21.15.1:0/3318645377 shutdown_connections 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55e751040f70 0x55e751043360 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 0x55e75102e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e75102df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 --2- 172.21.15.1:0/3318645377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e751030ce0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 -- 172.21.15.1:0/3318645377 >> 172.21.15.1:0/3318645377 conn(0x55e750fef310 msgr2=0x55e751028930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:18.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f31337fe640 0 client.25574 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:06:18.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 -- 172.21.15.1:0/3318645377 shutdown_connections 2024-09-19T09:06:18.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 1 -- 172.21.15.1:0/3318645377 wait complete. 2024-09-19T09:06:18.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.542+0000 7f315cbf1740 20 client.25574 trim_cache size 0 max 16384 2024-09-19T09:06:18.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f315cbf1740 1 Processor -- start 2024-09-19T09:06:18.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f315cbf1740 1 -- start start 2024-09-19T09:06:18.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e75103d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751029120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 0x55e751029660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f315cbf1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31541b21e0 con 0x55e751027b40 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f315cbf1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31541afab0 con 0x55e7510265d0 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f315cbf1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f31541ad900 con 0x55e751031370 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f31537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751029120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f31537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751029120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41594/0 (socket says 172.21.15.1:41594) 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.555+0000 7f31537fe640 1 -- 172.21.15.1:0/2983761791 learned_addr learned my addr 172.21.15.1:0/2983761791 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f3153fff640 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e75103d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f3158db5640 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 0x55e751029660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f31537fe640 1 -- 172.21.15.1:0/2983761791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 msgr2=0x55e751029660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f31537fe640 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 0x55e751029660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f31537fe640 1 -- 172.21.15.1:0/2983761791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 msgr2=0x55e75103d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f31537fe640 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e75103d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f31537fe640 1 -- 172.21.15.1:0/2983761791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e751029ba0 con 0x55e751027b40 2024-09-19T09:06:18.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f31537fe640 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751029120 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3148098680 tx=0x7f31480cd060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27c860d909b10cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:18.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f3139ffb640 1 -- 172.21.15.1:0/2983761791 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314801d040 con 0x55e751027b40 2024-09-19T09:06:18.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f3139ffb640 1 -- 172.21.15.1:0/2983761791 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31480a0060 con 0x55e751027b40 2024-09-19T09:06:18.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.556+0000 7f3139ffb640 1 -- 172.21.15.1:0/2983761791 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148098320 con 0x55e751027b40 2024-09-19T09:06:18.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 -- 172.21.15.1:0/2983761791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 msgr2=0x55e751029120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751029120 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3148098680 tx=0x7f31480cd060 comp rx=0 tx=0).stop 2024-09-19T09:06:18.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 -- 172.21.15.1:0/2983761791 shutdown_connections 2024-09-19T09:06:18.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e751031370 0x55e751029660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751027b40 0x55e751029120 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 --2- 172.21.15.1:0/2983761791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e7510265d0 0x55e75103d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 -- 172.21.15.1:0/2983761791 >> 172.21.15.1:0/2983761791 conn(0x55e750fef310 msgr2=0x55e75102d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 -- 172.21.15.1:0/2983761791 shutdown_connections 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 -- 172.21.15.1:0/2983761791 wait complete. 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.557+0000 7f315cbf1740 1 -- start start 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f315cbf1740 1 Processor -- start 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751039bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751027b40 0x55e75102ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f315cbf1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751031370 0x55e75102b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f315cbf1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31541adf70 con 0x55e751031370 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f315cbf1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f31541af3e0 con 0x55e751027b40 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f315cbf1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f31541ae640 con 0x55e7510265d0 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f315cbf1740 10 client.0 _ll_register_callbacks cb 0x7f3144009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3158db5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751031370 0x55e75102b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3158db5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751031370 0x55e75102b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41610/0 (socket says 172.21.15.1:41610) 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3158db5640 1 -- 172.21.15.1:0/4049576865 learned_addr learned my addr 172.21.15.1:0/4049576865 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3153fff640 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751039bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f31537fe640 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751027b40 0x55e75102ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3158db5640 1 -- 172.21.15.1:0/4049576865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 msgr2=0x55e751039bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3158db5640 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751039bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3158db5640 1 -- 172.21.15.1:0/4049576865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751027b40 msgr2=0x55e75102ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3158db5640 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751027b40 0x55e75102ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f3158db5640 1 -- 172.21.15.1:0/4049576865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e75102b9e0 con 0x55e751031370 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.558+0000 7f31537fe640 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751027b40 0x55e75102ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f3158db5640 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751031370 0x55e75102b1d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f314c0106d0 tx=0x7f314c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff5865b60bd1f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f31337fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f31337fe640 1 -- 172.21.15.1:0/4049576865 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c032020 con 0x55e751031370 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f31337fe640 1 -- 172.21.15.1:0/4049576865 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f314c012240 con 0x55e751031370 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 1 -- 172.21.15.1:0/4049576865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31480a0060 con 0x55e751031370 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f31337fe640 1 -- 172.21.15.1:0/4049576865 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f314c03d050 con 0x55e751031370 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 10 client.16068 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 1 -- 172.21.15.1:0/4049576865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e7510abbb0 con 0x55e751031370 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f31337fe640 1 -- 172.21.15.1:0/4049576865 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31480a0060 con 0x55e751031370 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f31337fe640 1 -- 172.21.15.1:0/4049576865 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f314c01aad0 con 0x55e751031370 2024-09-19T09:06:18.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 10 client.16068 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 10 client.16068 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 20 client.16068 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55e7510ac0a0 0x55e7510ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 4 client.16068 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.559+0000 7f315cbf1740 1 -- 172.21.15.1:0/4049576865 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e750f93d70 con 0x55e7510ac0a0 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.560+0000 7f3153fff640 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55e7510ac0a0 0x55e7510ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.560+0000 7f3153fff640 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55e7510ac0a0 0x55e7510ae4c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85eaf91ef36934df server_cookie=3b6d2c4a0b396ba5 in_seq=0 out_seq=0 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.560+0000 7f31337fe640 10 client.16068 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.560+0000 7f31337fe640 1 -- 172.21.15.1:0/4049576865 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e750f93d70 con 0x55e7510ac0a0 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.560+0000 7f31337fe640 10 client.16068 handle_command_reply: tid=0 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.560+0000 7f315cbf1740 1 client.16068 shutdown 2024-09-19T09:06:18.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 -- 172.21.15.1:0/4049576865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751031370 msgr2=0x55e75102b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751031370 0x55e75102b1d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f314c0106d0 tx=0x7f314c009240 comp rx=0 tx=0).stop 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 -- 172.21.15.1:0/4049576865 shutdown_connections 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55e7510ac0a0 0x55e7510ae4c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e751031370 0x55e75102b1d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e751027b40 0x55e75102ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 --2- 172.21.15.1:0/4049576865 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55e7510265d0 0x55e751039bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 -- 172.21.15.1:0/4049576865 >> 172.21.15.1:0/4049576865 conn(0x55e750fef310 msgr2=0x55e751021400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f31337fe640 0 client.16068 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 -- 172.21.15.1:0/4049576865 shutdown_connections 2024-09-19T09:06:18.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 1 -- 172.21.15.1:0/4049576865 wait complete. 2024-09-19T09:06:18.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315cbf1740 20 client.16068 trim_cache size 0 max 16384 2024-09-19T09:06:18.568 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:06:18.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 -- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f313c0a32c0 msgr2=0x7f313c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f313c0a32c0 0x7f313c0a5780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f314c020000 tx=0x7f314c01d000 comp rx=0 tx=0).stop 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 -- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31541036e0 msgr2=0x7f3154100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31541036e0 0x7f3154100ed0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f314800c970 tx=0x7f314800ce30 comp rx=0 tx=0).stop 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 -- 172.21.15.1:0/3426023797 shutdown_connections 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f313c0a32c0 0x7f313c0a5780 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31541082a0 0x7f3154101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31541036e0 0x7f3154100ed0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 --2- 172.21.15.1:0/3426023797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3154102d30 0x7f3154100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.561+0000 7f315a818640 1 -- 172.21.15.1:0/3426023797 >> 172.21.15.1:0/3426023797 conn(0x7f31540fc7d0 msgr2=0x7f3154105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.562+0000 7f315a818640 1 -- 172.21.15.1:0/3426023797 shutdown_connections 2024-09-19T09:06:18.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:18.562+0000 7f315a818640 1 -- 172.21.15.1:0/3426023797 wait complete. 2024-09-19T09:06:19.170 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:19 smithi001 ceph-mon[30939]: pgmap v404: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T09:06:19.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:06:19.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:19 smithi064 ceph-mon[35179]: pgmap v404: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T09:06:19.452 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:19.458 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:19 smithi022 ceph-mon[35107]: pgmap v404: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 -- 172.21.15.1:0/3693547033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc106a80 msgr2=0x7f13dc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 --2- 172.21.15.1:0/3693547033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc106a80 0x7f13dc106e60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009930 tx=0x7f13cc02a420 comp rx=0 tx=0).stop 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 -- 172.21.15.1:0/3693547033 shutdown_connections 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 --2- 172.21.15.1:0/3693547033 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13dc101420 0x7f13dc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 --2- 172.21.15.1:0/3693547033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13dc100a80 0x7f13dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 --2- 172.21.15.1:0/3693547033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc106a80 0x7f13dc106e60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 -- 172.21.15.1:0/3693547033 >> 172.21.15.1:0/3693547033 conn(0x7f13dc0fc7a0 msgr2=0x7f13dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 -- 172.21.15.1:0/3693547033 shutdown_connections 2024-09-19T09:06:19.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 -- 172.21.15.1:0/3693547033 wait complete. 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 Processor -- start 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.915+0000 7f13e274c640 1 -- start start 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e274c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc100a80 0x7f13dc10e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e274c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13dc101420 0x7f13dc10e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e274c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13dc106a80 0x7f13dc10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e274c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc112100 con 0x7f13dc100a80 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e274c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc111f80 con 0x7f13dc106a80 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e274c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc112280 con 0x7f13dc101420 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc100a80 0x7f13dc10e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc100a80 0x7f13dc10e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41638/0 (socket says 172.21.15.1:41638) 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 -- 172.21.15.1:0/1338390777 learned_addr learned my addr 172.21.15.1:0/1338390777 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13d3fff640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13dc101420 0x7f13dc10e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13dc106a80 0x7f13dc10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 -- 172.21.15.1:0/1338390777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13dc101420 msgr2=0x7f13dc10e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13dc101420 0x7f13dc10e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 -- 172.21.15.1:0/1338390777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13dc106a80 msgr2=0x7f13dc10ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13dc106a80 0x7f13dc10ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 -- 172.21.15.1:0/1338390777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc1a6a00 con 0x7f13dc100a80 2024-09-19T09:06:19.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13d3fff640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13dc101420 0x7f13dc10e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13dbfff640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc100a80 0x7f13dc10e3e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f13cc02a940 tx=0x7f13cc0329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13d9ffb640 1 -- 172.21.15.1:0/1338390777 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc03f030 con 0x7f13dc100a80 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13d9ffb640 1 -- 172.21.15.1:0/1338390777 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13cc032df0 con 0x7f13dc100a80 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13d9ffb640 1 -- 172.21.15.1:0/1338390777 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc035070 con 0x7f13dc100a80 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e274c640 1 -- 172.21.15.1:0/1338390777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13dc1a6c90 con 0x7f13dc100a80 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.916+0000 7f13e274c640 1 -- 172.21.15.1:0/1338390777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13dc1a71c0 con 0x7f13dc100a80 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13d9ffb640 1 -- 172.21.15.1:0/1338390777 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f13cc042030 con 0x7f13dc100a80 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13e4b25740 1 Processor -- start 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13e4b25740 1 -- start start 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 0x55fc551df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13e4b25740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc551382f0 con 0x55fc551d3b40 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13e4b25740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fc550dfcf0 con 0x55fc551d25d0 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13e4b25740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fc551342b0 con 0x55fc551dd370 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.919+0000 7f13d9ffb640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13c80a32c0 0x7f13c80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41644/0 (socket says 172.21.15.1:41644) 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 -- 172.21.15.1:0/2045572690 learned_addr learned my addr 172.21.15.1:0/2045572690 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13c80a32c0 0x7f13c80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13d3fff640 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 0x55fc551df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13d9ffb640 1 -- 172.21.15.1:0/1338390777 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f13cc0efa20 con 0x7f13dc100a80 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13dbfff640 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 -- 172.21.15.1:0/2045572690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 msgr2=0x55fc551df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 0x55fc551df760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 -- 172.21.15.1:0/2045572690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 msgr2=0x55fc551d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 -- 172.21.15.1:0/2045572690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc550c43a0 con 0x55fc551d3b40 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13dbfff640 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d2090 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f13d4014eb0 tx=0x7f13d40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabfb8ce76ffd387 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13c80a32c0 0x7f13c80a5780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13d4011cb0 tx=0x7f13d4016000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13d27fc640 1 -- 172.21.15.1:0/2045572690 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4009c20 con 0x55fc551d3b40 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13d27fc640 1 -- 172.21.15.1:0/2045572690 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13d4014810 con 0x55fc551d3b40 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.920+0000 7f13d27fc640 1 -- 172.21.15.1:0/2045572690 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4004d20 con 0x55fc551d3b40 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 -- 172.21.15.1:0/2045572690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 msgr2=0x55fc551d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d2090 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f13d4014eb0 tx=0x7f13d40117b0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 -- 172.21.15.1:0/2045572690 shutdown_connections 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 0x55fc551df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 --2- 172.21.15.1:0/2045572690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d2090 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 -- 172.21.15.1:0/2045572690 >> 172.21.15.1:0/2045572690 conn(0x55fc5519b310 msgr2=0x55fc551cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 -- 172.21.15.1:0/2045572690 shutdown_connections 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 -- 172.21.15.1:0/2045572690 wait complete. 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.921+0000 7f13e4b25740 1 -- start start 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e4b25740 1 Processor -- start 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d25d0 0x55fc551dcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d3b40 0x55fc551da040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551dd370 0x55fc551da650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e4b25740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fc551e0010 con 0x55fc551dd370 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e4b25740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fc550f3060 con 0x55fc551d3b40 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e4b25740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fc551e0190 con 0x55fc551d25d0 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e4b25740 10 client.0 _ll_register_callbacks cb 0x55fc54e468c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:19.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e0ce9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551dd370 0x55fc551da650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e0ce9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551dd370 0x55fc551da650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41656/0 (socket says 172.21.15.1:41656) 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e0ce9640 1 -- 172.21.15.1:0/4263981419 learned_addr learned my addr 172.21.15.1:0/4263981419 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13d3fff640 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d3b40 0x55fc551da040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13dbfff640 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d25d0 0x55fc551dcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e0ce9640 1 -- 172.21.15.1:0/4263981419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d25d0 msgr2=0x55fc551dcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d25d0 0x55fc551dcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e0ce9640 1 -- 172.21.15.1:0/4263981419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d3b40 msgr2=0x55fc551da040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d3b40 0x55fc551da040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.922+0000 7f13e0ce9640 1 -- 172.21.15.1:0/4263981419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc54ea93c0 con 0x55fc551dd370 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551dd370 0x55fc551da650 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f13d4014090 tx=0x7f13d4009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97dbab154e44bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:19.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13bb7fe640 1 -- 172.21.15.1:0/4263981419 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d402e070 con 0x55fc551dd370 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13bb7fe640 1 -- 172.21.15.1:0/4263981419 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f13d4033460 con 0x55fc551dd370 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13e4b25740 1 -- 172.21.15.1:0/4263981419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13d4014810 con 0x55fc551dd370 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13bb7fe640 1 -- 172.21.15.1:0/4263981419 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f13d400bc20 con 0x55fc551dd370 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13e4b25740 10 client.16080 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13e4b25740 1 -- 172.21.15.1:0/4263981419 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fc551ebae0 con 0x55fc551dd370 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.923+0000 7f13bb7fe640 1 -- 172.21.15.1:0/4263981419 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13d4014810 con 0x55fc551dd370 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13bb7fe640 1 -- 172.21.15.1:0/4263981419 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f13d401d070 con 0x55fc551dd370 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13e4b25740 10 client.16080 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13e4b25740 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13e4b25740 20 client.16080 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13e4b25740 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fc551ecfa0 0x55fc551ef390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13e4b25740 4 client.16080 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13e4b25740 1 -- 172.21.15.1:0/4263981419 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc55145860 con 0x55fc551ecfa0 2024-09-19T09:06:19.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13dbfff640 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fc551ecfa0 0x55fc551ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13bb7fe640 10 client.16080 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:19.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.924+0000 7f13dbfff640 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fc551ecfa0 0x55fc551ef390 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f4b18cf1968d33d server_cookie=6c6a16f1a069edc2 in_seq=0 out_seq=0 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13bb7fe640 1 -- 172.21.15.1:0/4263981419 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc55145860 con 0x55fc551ecfa0 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13bb7fe640 10 client.16080 handle_command_reply: tid=0 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13e4b25740 1 client.16080 shutdown 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13e4b25740 1 -- 172.21.15.1:0/4263981419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551dd370 msgr2=0x55fc551da650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13e4b25740 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551dd370 0x55fc551da650 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f13d4014090 tx=0x7f13d4009790 comp rx=0 tx=0).stop 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13e4b25740 1 -- 172.21.15.1:0/4263981419 shutdown_connections 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13e4b25740 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fc551ecfa0 0x55fc551ef390 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13bb7fe640 0 client.16080 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13e4b25740 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551dd370 0x55fc551da650 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13e4b25740 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d3b40 0x55fc551da040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.925+0000 7f13e4b25740 1 --2- 172.21.15.1:0/4263981419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d25d0 0x55fc551dcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.926+0000 7f13e4b25740 1 -- 172.21.15.1:0/4263981419 >> 172.21.15.1:0/4263981419 conn(0x55fc5519b310 msgr2=0x55fc551d4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.926+0000 7f13e4b25740 1 -- 172.21.15.1:0/4263981419 shutdown_connections 2024-09-19T09:06:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.926+0000 7f13e4b25740 1 -- 172.21.15.1:0/4263981419 wait complete. 2024-09-19T09:06:19.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.926+0000 7f13e4b25740 20 client.16080 trim_cache size 0 max 16384 2024-09-19T09:06:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e4b25740 1 Processor -- start 2024-09-19T09:06:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e4b25740 1 -- start start 2024-09-19T09:06:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d25d0 0x55fc551dbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d3b40 0x55fc551d5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551dd370 0x55fc551d5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e4b25740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1b21e0 con 0x55fc551d25d0 2024-09-19T09:06:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e4b25740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1afab0 con 0x55fc551dd370 2024-09-19T09:06:19.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e4b25740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1ad900 con 0x55fc551d3b40 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d25d0 0x55fc551dbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d25d0 0x55fc551dbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41666/0 (socket says 172.21.15.1:41666) 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 -- 172.21.15.1:0/1819873895 learned_addr learned my addr 172.21.15.1:0/1819873895 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551dd370 0x55fc551d5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 -- 172.21.15.1:0/1819873895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d3b40 msgr2=0x55fc551d5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13d3fff640 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d3b40 0x55fc551d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d3b40 0x55fc551d5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 -- 172.21.15.1:0/1819873895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551dd370 msgr2=0x55fc551d5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551dd370 0x55fc551d5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 -- 172.21.15.1:0/1819873895 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc551d8ff0 con 0x55fc551d25d0 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13e0ce9640 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551dd370 0x55fc551d5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13d3fff640 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d3b40 0x55fc551d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:19.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.939+0000 7f13dbfff640 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d25d0 0x55fc551dbfb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f13cc006010 tx=0x7f13cc0ed370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d152dd57e9548c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:19.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13d1ffb640 1 -- 172.21.15.1:0/1819873895 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc049040 con 0x55fc551d25d0 2024-09-19T09:06:19.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13d1ffb640 1 -- 172.21.15.1:0/1819873895 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13cc0c4c30 con 0x55fc551d25d0 2024-09-19T09:06:19.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13d1ffb640 1 -- 172.21.15.1:0/1819873895 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0c47a0 con 0x55fc551d25d0 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 -- 172.21.15.1:0/1819873895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d25d0 msgr2=0x55fc551dbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d25d0 0x55fc551dbfb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f13cc006010 tx=0x7f13cc0ed370 comp rx=0 tx=0).stop 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 -- 172.21.15.1:0/1819873895 shutdown_connections 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551dd370 0x55fc551d5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551d3b40 0x55fc551d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 --2- 172.21.15.1:0/1819873895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d25d0 0x55fc551dbfb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 -- 172.21.15.1:0/1819873895 >> 172.21.15.1:0/1819873895 conn(0x55fc5519b310 msgr2=0x55fc551db8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 -- 172.21.15.1:0/1819873895 shutdown_connections 2024-09-19T09:06:19.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.940+0000 7f13e4b25740 1 -- 172.21.15.1:0/1819873895 wait complete. 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 1 -- start start 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 1 Processor -- start 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 0x55fc551d7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1adf70 con 0x55fc551d3b40 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1af3e0 con 0x55fc551d25d0 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc1ae640 con 0x55fc551dd370 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13e4b25740 10 client.0 _ll_register_callbacks cb 0x7f13c40095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13d3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13d3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41672/0 (socket says 172.21.15.1:41672) 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13d3fff640 1 -- 172.21.15.1:0/3882442506 learned_addr learned my addr 172.21.15.1:0/3882442506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:19.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.941+0000 7f13dbfff640 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13d3fff640 1 -- 172.21.15.1:0/3882442506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 msgr2=0x55fc551d7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13d3fff640 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 0x55fc551d7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13d3fff640 1 -- 172.21.15.1:0/3882442506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 msgr2=0x55fc551e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13d3fff640 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13d3fff640 1 -- 172.21.15.1:0/3882442506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc551dd100 con 0x55fc551d3b40 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13d3fff640 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d6e40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55fc551d3070 tx=0x7f13c40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca7335c779fec87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13bb7fe640 1 -- 172.21.15.1:0/3882442506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4012660 con 0x55fc551d3b40 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13bb7fe640 1 -- 172.21.15.1:0/3882442506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f13c4012800 con 0x55fc551d3b40 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13e4b25740 1 -- 172.21.15.1:0/3882442506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13cc0c4c30 con 0x55fc551d3b40 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13bb7fe640 1 -- 172.21.15.1:0/3882442506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f13c4012a00 con 0x55fc551d3b40 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13e4b25740 10 client.16086 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13e4b25740 1 -- 172.21.15.1:0/3882442506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fc552578c0 con 0x55fc551d3b40 2024-09-19T09:06:19.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13bb7fe640 1 -- 172.21.15.1:0/3882442506 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13cc0c4c30 con 0x55fc551d3b40 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.942+0000 7f13bb7fe640 1 -- 172.21.15.1:0/3882442506 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f13c4029420 con 0x55fc551d3b40 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13e4b25740 10 client.16086 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13e4b25740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13e4b25740 20 client.16086 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13e4b25740 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fc551ecfa0 0x55fc5525a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13e4b25740 4 client.16086 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13e4b25740 1 -- 172.21.15.1:0/3882442506 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc5513fd70 con 0x55fc551ecfa0 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13dbfff640 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fc551ecfa0 0x55fc5525a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13dbfff640 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fc551ecfa0 0x55fc5525a0e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5009158e48a97f63 server_cookie=67b0881bceaf1d0d in_seq=0 out_seq=0 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13bb7fe640 10 client.16086 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13bb7fe640 1 -- 172.21.15.1:0/3882442506 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc5513fd70 con 0x55fc551ecfa0 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13bb7fe640 10 client.16086 handle_command_reply: tid=0 2024-09-19T09:06:19.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.943+0000 7f13e4b25740 1 client.16086 shutdown 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 -- 172.21.15.1:0/3882442506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 msgr2=0x55fc551d6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d6e40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55fc551d3070 tx=0x7f13c40039c0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 -- 172.21.15.1:0/3882442506 shutdown_connections 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55fc551ecfa0 0x55fc5525a0e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fc551dd370 0x55fc551d7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fc551d3b40 0x55fc551d6e40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13bb7fe640 0 client.16086 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 --2- 172.21.15.1:0/3882442506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fc551d25d0 0x55fc551e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 -- 172.21.15.1:0/3882442506 >> 172.21.15.1:0/3882442506 conn(0x55fc5519b310 msgr2=0x55fc551dc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 -- 172.21.15.1:0/3882442506 shutdown_connections 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 1 -- 172.21.15.1:0/3882442506 wait complete. 2024-09-19T09:06:19.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e4b25740 20 client.16086 trim_cache size 0 max 16384 2024-09-19T09:06:19.952 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:06:19.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 -- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13c80a32c0 msgr2=0x7f13c80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13c80a32c0 0x7f13c80a5780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13d4011cb0 tx=0x7f13d4016000 comp rx=0 tx=0).stop 2024-09-19T09:06:19.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 -- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc100a80 msgr2=0x7f13dc10e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:19.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc100a80 0x7f13dc10e3e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f13cc02a940 tx=0x7f13cc0329c0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 -- 172.21.15.1:0/1338390777 shutdown_connections 2024-09-19T09:06:19.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13dc106a80 0x7f13dc10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13c80a32c0 0x7f13c80a5780 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13dc101420 0x7f13dc10e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.944+0000 7f13e274c640 1 --2- 172.21.15.1:0/1338390777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13dc100a80 0x7f13dc10e3e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.945+0000 7f13e274c640 1 -- 172.21.15.1:0/1338390777 >> 172.21.15.1:0/1338390777 conn(0x7f13dc0fc7a0 msgr2=0x7f13dc0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.945+0000 7f13e274c640 1 -- 172.21.15.1:0/1338390777 shutdown_connections 2024-09-19T09:06:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:19.945+0000 7f13e274c640 1 -- 172.21.15.1:0/1338390777 wait complete. 2024-09-19T09:06:21.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:21 smithi064 ceph-mon[35179]: pgmap v405: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-19T09:06:21.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:21 smithi022 ceph-mon[35107]: pgmap v405: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-19T09:06:21.548 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:21 smithi001 ceph-mon[30939]: pgmap v405: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-19T09:06:21.625 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:06:21.626 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:06:21.895 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:22.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 -- 172.21.15.1:0/1555492594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258106a80 msgr2=0x7ff258106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 --2- 172.21.15.1:0/1555492594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258106a80 0x7ff258106e60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff248009930 tx=0x7ff24802a420 comp rx=0 tx=0).stop 2024-09-19T09:06:22.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 -- 172.21.15.1:0/1555492594 shutdown_connections 2024-09-19T09:06:22.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 --2- 172.21.15.1:0/1555492594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff258101420 0x7ff25810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 --2- 172.21.15.1:0/1555492594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff258100a80 0x7ff258100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 --2- 172.21.15.1:0/1555492594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258106a80 0x7ff258106e60 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 -- 172.21.15.1:0/1555492594 >> 172.21.15.1:0/1555492594 conn(0x7ff2580fc7a0 msgr2=0x7ff2580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 -- 172.21.15.1:0/1555492594 shutdown_connections 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.309+0000 7ff25e97b640 1 -- 172.21.15.1:0/1555492594 wait complete. 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff25e97b640 1 Processor -- start 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff25e97b640 1 -- start start 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff25e97b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff258100a80 0x7ff2581984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff25e97b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258101420 0x7ff258198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff25e97b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff258106a80 0x7ff25819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff25e97b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581120c0 con 0x7ff258101420 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff25e97b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff258111f40 con 0x7ff258100a80 2024-09-19T09:06:22.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff25e97b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff258112240 con 0x7ff258106a80 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258101420 0x7ff258198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258101420 0x7ff258198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41702/0 (socket says 172.21.15.1:41702) 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.310+0000 7ff2577fe640 1 -- 172.21.15.1:0/4092572744 learned_addr learned my addr 172.21.15.1:0/4092572744 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff257fff640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff258100a80 0x7ff2581984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff25cf18640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff258106a80 0x7ff25819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2577fe640 1 -- 172.21.15.1:0/4092572744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff258106a80 msgr2=0x7ff25819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2577fe640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff258106a80 0x7ff25819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2577fe640 1 -- 172.21.15.1:0/4092572744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff258100a80 msgr2=0x7ff2581984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2577fe640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff258100a80 0x7ff2581984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2577fe640 1 -- 172.21.15.1:0/4092572744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25819d490 con 0x7ff258101420 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff25cf18640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff258106a80 0x7ff25819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff257fff640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff258100a80 0x7ff2581984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2577fe640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258101420 0x7ff258198a20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00c970 tx=0x7ff24c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:22.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2557fa640 1 -- 172.21.15.1:0/4092572744 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c007bb0 con 0x7ff258101420 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff25e97b640 1 -- 172.21.15.1:0/4092572744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25819d780 con 0x7ff258101420 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2557fa640 1 -- 172.21.15.1:0/4092572744 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff24c007d50 con 0x7ff258101420 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff2557fa640 1 -- 172.21.15.1:0/4092572744 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c00f4b0 con 0x7ff258101420 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.311+0000 7ff25e97b640 1 -- 172.21.15.1:0/4092572744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2581a5060 con 0x7ff258101420 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.313+0000 7ff2557fa640 1 -- 172.21.15.1:0/4092572744 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7ff24c0046c0 con 0x7ff258101420 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff260d54740 1 Processor -- start 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff260d54740 1 -- start start 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff260d54740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b129ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff260d54740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b129f480 0x5643b12a9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff260d54740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b12a9d40 0x5643b12ac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff260d54740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5643b1204280 con 0x5643b129eb60 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff260d54740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5643b11abb10 con 0x5643b129f480 2024-09-19T09:06:22.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff260d54740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5643b1200240 con 0x5643b12a9d40 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff257fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b129f480 0x5643b12a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff257fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b129f480 0x5643b12a9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:35306/0 (socket says 172.21.15.1:35306) 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.314+0000 7ff257fff640 1 -- 172.21.15.1:0/1783099917 learned_addr learned my addr 172.21.15.1:0/1783099917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff2557fa640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff2400a3240 0x7ff2400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff2557fa640 1 -- 172.21.15.1:0/4092572744 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff24c0cf800 con 0x7ff258101420 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff257fff640 1 -- 172.21.15.1:0/1783099917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b12a9d40 msgr2=0x5643b12ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff257fff640 1 --2- 172.21.15.1:0/1783099917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b12a9d40 0x5643b12ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff257fff640 1 -- 172.21.15.1:0/1783099917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 msgr2=0x5643b129ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff257fff640 1 --2- 172.21.15.1:0/1783099917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b129ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff257fff640 1 -- 172.21.15.1:0/1783099917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b11b81f0 con 0x5643b129f480 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff25cf18640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff2400a3240 0x7ff2400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff257fff640 1 --2- 172.21.15.1:0/1783099917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b129f480 0x5643b12a9800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff248000c00 tx=0x7ff248032d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edb4814f145c93cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:22.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff23e7fc640 1 -- 172.21.15.1:0/1783099917 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24803f070 con 0x5643b129f480 2024-09-19T09:06:22.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff23e7fc640 1 -- 172.21.15.1:0/1783099917 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff248031840 con 0x5643b129f480 2024-09-19T09:06:22.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.315+0000 7ff23e7fc640 1 -- 172.21.15.1:0/1783099917 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248035070 con 0x5643b129f480 2024-09-19T09:06:22.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 -- 172.21.15.1:0/1783099917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b129f480 msgr2=0x5643b12a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff25cf18640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff2400a3240 0x7ff2400a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff250009ce0 tx=0x7ff2500092e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 --2- 172.21.15.1:0/1783099917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b129f480 0x5643b12a9800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff248000c00 tx=0x7ff248032d30 comp rx=0 tx=0).stop 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 -- 172.21.15.1:0/1783099917 shutdown_connections 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 --2- 172.21.15.1:0/1783099917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b12a9d40 0x5643b12ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 --2- 172.21.15.1:0/1783099917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b129f480 0x5643b12a9800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 --2- 172.21.15.1:0/1783099917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b129ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 -- 172.21.15.1:0/1783099917 >> 172.21.15.1:0/1783099917 conn(0x5643b129b0f0 msgr2=0x5643b129b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 -- 172.21.15.1:0/1783099917 shutdown_connections 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.316+0000 7ff260d54740 1 -- 172.21.15.1:0/1783099917 wait complete. 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 1 -- start start 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 1 Processor -- start 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129eb60 0x5643b12a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129f480 0x5643b12a7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12a7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5643b12b0d20 con 0x5643b129f480 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5643b11bef10 con 0x5643b12a9d40 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5643b12b0ea0 con 0x5643b129eb60 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff260d54740 10 client.0 _ll_register_callbacks cb 0x5643b1187a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129f480 0x5643b12a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129f480 0x5643b12a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41720/0 (socket says 172.21.15.1:41720) 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff2577fe640 1 -- 172.21.15.1:0/1625838556 learned_addr learned my addr 172.21.15.1:0/1625838556 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.317+0000 7ff257fff640 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129eb60 0x5643b12a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff25cf18640 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2577fe640 1 -- 172.21.15.1:0/1625838556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129eb60 msgr2=0x5643b12a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2577fe640 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129eb60 0x5643b12a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2577fe640 1 -- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 msgr2=0x5643b12a7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2577fe640 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12a7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2577fe640 1 -- 172.21.15.1:0/1625838556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b0f756a0 con 0x5643b129f480 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff25cf18640 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12a7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2577fe640 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129f480 0x5643b12a7130 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0058c0 tx=0x7ff24c09bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f374e596b14a2cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2377fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2377fe640 1 -- 172.21.15.1:0/1625838556 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c09f020 con 0x5643b129f480 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2377fe640 1 -- 172.21.15.1:0/1625838556 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff24c09b3f0 con 0x5643b129f480 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff260d54740 1 -- 172.21.15.1:0/1625838556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff248031840 con 0x5643b129f480 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2377fe640 1 -- 172.21.15.1:0/1625838556 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff24c01d040 con 0x5643b129f480 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff260d54740 10 client.16095 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff260d54740 1 -- 172.21.15.1:0/1625838556 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5643b12bc940 con 0x5643b129f480 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.318+0000 7ff2377fe640 1 -- 172.21.15.1:0/1625838556 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff248031840 con 0x5643b129f480 2024-09-19T09:06:22.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff2377fe640 1 -- 172.21.15.1:0/1625838556 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff24c0a1400 con 0x5643b129f480 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff260d54740 10 client.16095 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff260d54740 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff260d54740 20 client.16095 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff260d54740 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5643b12bdda0 0x5643b12c0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff260d54740 4 client.16095 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff260d54740 1 -- 172.21.15.1:0/1625838556 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643b12117f0 con 0x5643b12bdda0 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff257fff640 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5643b12bdda0 0x5643b12c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff257fff640 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5643b12bdda0 0x5643b12c0190 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e52e3608e505b52c server_cookie=5be2b9e994ade07e in_seq=0 out_seq=0 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.319+0000 7ff2377fe640 10 client.16095 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff2377fe640 1 -- 172.21.15.1:0/1625838556 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643b12117f0 con 0x5643b12bdda0 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff2377fe640 10 client.16095 handle_command_reply: tid=0 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 client.16095 shutdown 2024-09-19T09:06:22.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 -- 172.21.15.1:0/1625838556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129f480 msgr2=0x5643b12a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129f480 0x5643b12a7130 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0058c0 tx=0x7ff24c09bc70 comp rx=0 tx=0).stop 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 -- 172.21.15.1:0/1625838556 shutdown_connections 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5643b12bdda0 0x5643b12c0190 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12a7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129f480 0x5643b12a7130 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 --2- 172.21.15.1:0/1625838556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129eb60 0x5643b12a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.320+0000 7ff260d54740 1 -- 172.21.15.1:0/1625838556 >> 172.21.15.1:0/1625838556 conn(0x5643b129b0f0 msgr2=0x5643b12a0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.321+0000 7ff2377fe640 0 client.16095 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.321+0000 7ff260d54740 1 -- 172.21.15.1:0/1625838556 shutdown_connections 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.321+0000 7ff260d54740 1 -- 172.21.15.1:0/1625838556 wait complete. 2024-09-19T09:06:22.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.321+0000 7ff260d54740 20 client.16095 trim_cache size 0 max 16384 2024-09-19T09:06:22.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff260d54740 1 Processor -- start 2024-09-19T09:06:22.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff260d54740 1 -- start start 2024-09-19T09:06:22.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff260d54740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff260d54740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 0x5643b12c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff260d54740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b1299a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff260d54740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581add30 con 0x5643b129eb60 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff260d54740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581ab600 con 0x5643b12a9d40 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff260d54740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581a9450 con 0x5643b129f480 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff257fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff257fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41728/0 (socket says 172.21.15.1:41728) 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.338+0000 7ff257fff640 1 -- 172.21.15.1:0/1404991863 learned_addr learned my addr 172.21.15.1:0/1404991863 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff2577fe640 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 0x5643b12c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff25cf18640 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b1299a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff257fff640 1 -- 172.21.15.1:0/1404991863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 msgr2=0x5643b12c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:22.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff257fff640 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 0x5643b12c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff257fff640 1 -- 172.21.15.1:0/1404991863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 msgr2=0x5643b1299a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:22.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff257fff640 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b1299a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff257fff640 1 -- 172.21.15.1:0/1404991863 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b129af20 con 0x5643b129eb60 2024-09-19T09:06:22.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff25cf18640 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b1299a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:22.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff257fff640 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12c5a40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff248000c00 tx=0x7ff24802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddb42bff48d519e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:22.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff23dffb640 1 -- 172.21.15.1:0/1404991863 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248052070 con 0x5643b129eb60 2024-09-19T09:06:22.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff23dffb640 1 -- 172.21.15.1:0/1404991863 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2480316c0 con 0x5643b129eb60 2024-09-19T09:06:22.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.339+0000 7ff23dffb640 1 -- 172.21.15.1:0/1404991863 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24803f040 con 0x5643b129eb60 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 -- 172.21.15.1:0/1404991863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 msgr2=0x5643b12c5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12c5a40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff248000c00 tx=0x7ff24802a420 comp rx=0 tx=0).stop 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 -- 172.21.15.1:0/1404991863 shutdown_connections 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b1299a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 0x5643b12c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 --2- 172.21.15.1:0/1404991863 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12c5a40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 -- 172.21.15.1:0/1404991863 >> 172.21.15.1:0/1404991863 conn(0x5643b129b0f0 msgr2=0x5643b12a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 -- 172.21.15.1:0/1404991863 shutdown_connections 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 -- 172.21.15.1:0/1404991863 wait complete. 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 -- start start 2024-09-19T09:06:22.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.340+0000 7ff260d54740 1 Processor -- start 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff260d54740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff260d54740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 0x5643b12b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff260d54740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff260d54740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581a9ac0 con 0x5643b129eb60 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff260d54740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581aaf30 con 0x5643b12a9d40 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff260d54740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581aa190 con 0x5643b129f480 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff260d54740 10 client.0 _ll_register_callbacks cb 0x7ff24c00c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff2577fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 0x5643b12b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41742/0 (socket says 172.21.15.1:41742) 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 -- 172.21.15.1:0/2663918061 learned_addr learned my addr 172.21.15.1:0/2663918061 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff25cf18640 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 -- 172.21.15.1:0/2663918061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 msgr2=0x5643b12b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 0x5643b12b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 -- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 msgr2=0x5643b12b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 -- 172.21.15.1:0/2663918061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b1327a10 con 0x5643b129eb60 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff25cf18640 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff257fff640 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12b1da0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff24802aad0 tx=0x7ff248031520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28de0cba70b3caa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff2377fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.341+0000 7ff2377fe640 1 -- 172.21.15.1:0/2663918061 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248052040 con 0x5643b129eb60 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff2377fe640 1 -- 172.21.15.1:0/2663918061 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff248004240 con 0x5643b129eb60 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 1 -- 172.21.15.1:0/2663918061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2480316c0 con 0x5643b129eb60 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff2377fe640 1 -- 172.21.15.1:0/2663918061 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff24803f040 con 0x5643b129eb60 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 10 client.16101 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:22.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 1 -- 172.21.15.1:0/2663918061 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5643b1328c00 con 0x5643b129eb60 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff2377fe640 1 -- 172.21.15.1:0/2663918061 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2480316c0 con 0x5643b129eb60 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff2377fe640 1 -- 172.21.15.1:0/2663918061 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff248003a10 con 0x5643b129eb60 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 10 client.16101 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 20 client.16101 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5643b1328e30 0x5643b132b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 4 client.16101 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff260d54740 1 -- 172.21.15.1:0/2663918061 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5643b120bd00 con 0x5643b1328e30 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.342+0000 7ff2577fe640 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5643b1328e30 0x5643b132b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.343+0000 7ff2577fe640 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5643b1328e30 0x5643b132b220 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbe0792b6ce7bb1a server_cookie=653c0eb47ee44dc3 in_seq=0 out_seq=0 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.343+0000 7ff2377fe640 10 client.16101 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff2377fe640 1 -- 172.21.15.1:0/2663918061 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5643b120bd00 con 0x5643b1328e30 2024-09-19T09:06:22.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff2377fe640 10 client.16101 handle_command_reply: tid=0 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 client.16101 shutdown 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 -- 172.21.15.1:0/2663918061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 msgr2=0x5643b12b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12b1da0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff24802aad0 tx=0x7ff248031520 comp rx=0 tx=0).stop 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 -- 172.21.15.1:0/2663918061 shutdown_connections 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5643b1328e30 0x5643b132b220 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5643b12a9d40 0x5643b12b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5643b129f480 0x5643b12b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 --2- 172.21.15.1:0/2663918061 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5643b129eb60 0x5643b12b1da0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff2377fe640 0 client.16101 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 -- 172.21.15.1:0/2663918061 >> 172.21.15.1:0/2663918061 conn(0x5643b129b0f0 msgr2=0x5643b12a05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 -- 172.21.15.1:0/2663918061 shutdown_connections 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 1 -- 172.21.15.1:0/2663918061 wait complete. 2024-09-19T09:06:22.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.344+0000 7ff260d54740 20 client.16101 trim_cache size 0 max 16384 2024-09-19T09:06:22.351 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:06:22.351 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:06:22.351 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "a056656c-9cc9-4b38-9fef-32905c29d1ad", 2024-09-19T09:06:22.351 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:06:22.351 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 -- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff2400a3240 msgr2=0x7ff2400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff2400a3240 0x7ff2400a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff250009ce0 tx=0x7ff2500092e0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 -- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258101420 msgr2=0x7ff258198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258101420 0x7ff258198a20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00c970 tx=0x7ff24c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 -- 172.21.15.1:0/4092572744 shutdown_connections 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff2400a3240 0x7ff2400a5700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff258106a80 0x7ff25819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff258101420 0x7ff258198a20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 --2- 172.21.15.1:0/4092572744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff258100a80 0x7ff2581984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 -- 172.21.15.1:0/4092572744 >> 172.21.15.1:0/4092572744 conn(0x7ff2580fc7a0 msgr2=0x7ff2580fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:22.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 -- 172.21.15.1:0/4092572744 shutdown_connections 2024-09-19T09:06:22.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:22.345+0000 7ff25e97b640 1 -- 172.21.15.1:0/4092572744 wait complete. 2024-09-19T09:06:23.103 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:06:23.298 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:23 smithi001 ceph-mon[30939]: pgmap v406: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:06:23.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:23 smithi001 ceph-mon[30939]: scrub queued for path: / 2024-09-19T09:06:23.530 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:23 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:23.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:23 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:06:23.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:23 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:23.531 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:23 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:06:23.532 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:23 smithi022 ceph-mon[35107]: pgmap v406: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:06:23.532 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:23 smithi022 ceph-mon[35107]: scrub queued for path: / 2024-09-19T09:06:23.533 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:23 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:23.533 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:23 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:06:23.533 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:23 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:23.533 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:23 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:06:23.533 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:23 smithi064 ceph-mon[35179]: pgmap v406: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:06:23.533 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:23 smithi064 ceph-mon[35179]: scrub queued for path: / 2024-09-19T09:06:23.534 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:23 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:23.534 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:23 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:06:23.534 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:23 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:23.534 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:23 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:06:23.534 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:24.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 -- 172.21.15.1:0/1004867323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c106a80 msgr2=0x7f6b8c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1004867323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c106a80 0x7f6b8c106e60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009930 tx=0x7f6b8802a420 comp rx=0 tx=0).stop 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 -- 172.21.15.1:0/1004867323 shutdown_connections 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1004867323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8c101420 0x7f6b8c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1004867323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c100a80 0x7f6b8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1004867323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c106a80 0x7f6b8c106e60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 -- 172.21.15.1:0/1004867323 >> 172.21.15.1:0/1004867323 conn(0x7f6b8c0fc7a0 msgr2=0x7f6b8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 -- 172.21.15.1:0/1004867323 shutdown_connections 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.992+0000 7f6b9367b640 1 -- 172.21.15.1:0/1004867323 wait complete. 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b9367b640 1 Processor -- start 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b9367b640 1 -- start start 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b9367b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8c100a80 0x7f6b8c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b9367b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c101420 0x7f6b8c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b9367b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c106a80 0x7f6b8c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b9367b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1120e0 con 0x7f6b8c101420 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b9367b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c111f60 con 0x7f6b8c100a80 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b9367b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c112260 con 0x7f6b8c106a80 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b90c16640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c101420 0x7f6b8c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b90c16640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c101420 0x7f6b8c198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39016/0 (socket says 172.21.15.1:39016) 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b90c16640 1 -- 172.21.15.1:0/1819916971 learned_addr learned my addr 172.21.15.1:0/1819916971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.993+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c106a80 0x7f6b8c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b91417640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8c100a80 0x7f6b8c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b90c16640 1 -- 172.21.15.1:0/1819916971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c106a80 msgr2=0x7f6b8c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c106a80 0x7f6b8c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b90c16640 1 -- 172.21.15.1:0/1819916971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8c100a80 msgr2=0x7f6b8c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8c100a80 0x7f6b8c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b90c16640 1 -- 172.21.15.1:0/1819916971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c19d510 con 0x7f6b8c101420 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c106a80 0x7f6b8c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c101420 0x7f6b8c198aa0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00d950 tx=0x7f6b7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b827fc640 1 -- 172.21.15.1:0/1819916971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c017070 con 0x7f6b8c101420 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b9367b640 1 -- 172.21.15.1:0/1819916971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8c19d800 con 0x7f6b8c101420 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b827fc640 1 -- 172.21.15.1:0/1819916971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b7c009c30 con 0x7f6b8c101420 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b827fc640 1 -- 172.21.15.1:0/1819916971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00f740 con 0x7f6b8c101420 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.994+0000 7f6b9367b640 1 -- 172.21.15.1:0/1819916971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8c1a50e0 con 0x7f6b8c101420 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.997+0000 7f6b827fc640 1 -- 172.21.15.1:0/1819916971 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f6b7c010a80 con 0x7f6b8c101420 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.997+0000 7f6b95a54740 1 Processor -- start 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.997+0000 7f6b95a54740 1 -- start start 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.997+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e967414a0 0x560e96741880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.997+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e9674c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.997+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e9674ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.997+0000 7f6b95a54740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560e966a72e0 con 0x560e96741dc0 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b95a54740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560e9664ece0 con 0x560e9674c680 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b95a54740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560e966a32a0 con 0x560e967414a0 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e9674c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e9674c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39030/0 (socket says 172.21.15.1:39030) 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 -- 172.21.15.1:0/1948455237 learned_addr learned my addr 172.21.15.1:0/1948455237 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b827fc640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6b780a3240 0x7f6b780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e9674ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e967414a0 0x560e96741880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6b780a3240 0x7f6b780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 -- 172.21.15.1:0/1948455237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e967414a0 msgr2=0x560e96741880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e967414a0 0x560e96741880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 -- 172.21.15.1:0/1948455237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 msgr2=0x560e9674ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e9674ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 -- 172.21.15.1:0/1948455237 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e96633440 con 0x560e96741dc0 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b827fc640 1 -- 172.21.15.1:0/1819916971 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6b7c0cf630 con 0x7f6b8c101420 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e967414a0 0x560e96741880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91417640 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e9674c140 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009930 tx=0x7f6b88032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9013bbc6becd3a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.998+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6b780a3240 0x7f6b780a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009fd0 tx=0x7f6b8400c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b777fe640 1 -- 172.21.15.1:0/1948455237 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8803f070 con 0x560e96741dc0 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b777fe640 1 -- 172.21.15.1:0/1948455237 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b88032e20 con 0x560e96741dc0 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b777fe640 1 -- 172.21.15.1:0/1948455237 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88035070 con 0x560e96741dc0 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 -- 172.21.15.1:0/1948455237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 msgr2=0x560e9674c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e9674c140 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009930 tx=0x7f6b88032d30 comp rx=0 tx=0).stop 2024-09-19T09:06:24.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 -- 172.21.15.1:0/1948455237 shutdown_connections 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e9674ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e9674c140 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1948455237 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e967414a0 0x560e96741880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 -- 172.21.15.1:0/1948455237 >> 172.21.15.1:0/1948455237 conn(0x560e9673da30 msgr2=0x560e9673de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 -- 172.21.15.1:0/1948455237 shutdown_connections 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:23.999+0000 7f6b95a54740 1 -- 172.21.15.1:0/1948455237 wait complete. 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 1 -- start start 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 1 Processor -- start 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e9674bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e96749220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96749760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560e9674f250 con 0x560e967414a0 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560e96662050 con 0x560e9674c680 2024-09-19T09:06:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x560e9674f3d0 con 0x560e96741dc0 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b95a54740 10 client.0 _ll_register_callbacks cb 0x560e966a2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b91417640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e9674bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b91417640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e9674bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39038/0 (socket says 172.21.15.1:39038) 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b91417640 1 -- 172.21.15.1:0/1341692354 learned_addr learned my addr 172.21.15.1:0/1341692354 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.000+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96749760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e96749220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b91417640 1 -- 172.21.15.1:0/1341692354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 msgr2=0x560e96749220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b91417640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e96749220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b91417640 1 -- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 msgr2=0x560e96749760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b91417640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96749760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b91417640 1 -- 172.21.15.1:0/1341692354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e964183c0 con 0x560e967414a0 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96749760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e96749220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b91417640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e9674bf70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6b8802a940 tx=0x7f6b8802aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9cc20c72a05157 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b74ff9640 1 -- 172.21.15.1:0/1341692354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8804b060 con 0x560e967414a0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b74ff9640 1 -- 172.21.15.1:0/1341692354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6b88004440 con 0x560e967414a0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.001+0000 7f6b95a54740 1 -- 172.21.15.1:0/1341692354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b88032e20 con 0x560e967414a0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b74ff9640 1 -- 172.21.15.1:0/1341692354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b8803f030 con 0x560e967414a0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b95a54740 10 client.16113 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b95a54740 1 -- 172.21.15.1:0/1341692354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560e9675abc0 con 0x560e967414a0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b74ff9640 1 -- 172.21.15.1:0/1341692354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b88032e20 con 0x560e967414a0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b74ff9640 1 -- 172.21.15.1:0/1341692354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b880049c0 con 0x560e967414a0 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b95a54740 10 client.16113 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b95a54740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:24.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b95a54740 20 client.16113 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560e9675bf10 0x560e9675e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b95a54740 4 client.16113 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b95a54740 1 -- 172.21.15.1:0/1341692354 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e966b4850 con 0x560e9675bf10 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.002+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560e9675bf10 0x560e9675e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.003+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560e9675bf10 0x560e9675e300 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cce5a39e3d1e8855 server_cookie=db1abcb3844dd79f in_seq=0 out_seq=0 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.003+0000 7f6b74ff9640 10 client.16113 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.003+0000 7f6b74ff9640 1 -- 172.21.15.1:0/1341692354 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e966b4850 con 0x560e9675bf10 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.003+0000 7f6b74ff9640 10 client.16113 handle_command_reply: tid=0 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.003+0000 7f6b95a54740 1 client.16113 shutdown 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 -- 172.21.15.1:0/1341692354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 msgr2=0x560e9674bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e9674bf70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6b8802a940 tx=0x7f6b8802aa80 comp rx=0 tx=0).stop 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 -- 172.21.15.1:0/1341692354 shutdown_connections 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560e9675bf10 0x560e9675e300 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96749760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e96749220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b74ff9640 0 client.16113 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:24.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1341692354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e9674bf70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 -- 172.21.15.1:0/1341692354 >> 172.21.15.1:0/1341692354 conn(0x560e9673da30 msgr2=0x560e9673cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:24.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 -- 172.21.15.1:0/1341692354 shutdown_connections 2024-09-19T09:06:24.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 1 -- 172.21.15.1:0/1341692354 wait complete. 2024-09-19T09:06:24.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.004+0000 7f6b95a54740 20 client.16113 trim_cache size 0 max 16384 2024-09-19T09:06:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b95a54740 1 Processor -- start 2024-09-19T09:06:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b95a54740 1 -- start start 2024-09-19T09:06:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e967584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e967638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96763e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b95a54740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1aff80 con 0x560e967414a0 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b95a54740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1ad850 con 0x560e9674c680 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b95a54740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1ab6a0 con 0x560e96741dc0 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b91417640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e967584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b91417640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e967584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39052/0 (socket says 172.21.15.1:39052) 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b91417640 1 -- 172.21.15.1:0/1830317650 learned_addr learned my addr 172.21.15.1:0/1830317650 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b91c18640 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96763e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.022+0000 7f6b90c16640 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e967638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b91417640 1 -- 172.21.15.1:0/1830317650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 msgr2=0x560e967638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b91417640 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e967638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b91417640 1 -- 172.21.15.1:0/1830317650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 msgr2=0x560e96763e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b91417640 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96763e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b91417640 1 -- 172.21.15.1:0/1830317650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9673d4d0 con 0x560e967414a0 2024-09-19T09:06:24.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b91417640 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e967584b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6b8802a460 tx=0x7f6b8802aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3eb5ecd7392ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b76ffd640 1 -- 172.21.15.1:0/1830317650 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88035040 con 0x560e967414a0 2024-09-19T09:06:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b76ffd640 1 -- 172.21.15.1:0/1830317650 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b88004bc0 con 0x560e967414a0 2024-09-19T09:06:24.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.023+0000 7f6b76ffd640 1 -- 172.21.15.1:0/1830317650 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88003e00 con 0x560e967414a0 2024-09-19T09:06:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 -- 172.21.15.1:0/1830317650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 msgr2=0x560e967584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e967584b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6b8802a460 tx=0x7f6b8802aaf0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 -- 172.21.15.1:0/1830317650 shutdown_connections 2024-09-19T09:06:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9674c680 0x560e96763e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e96741dc0 0x560e967638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 --2- 172.21.15.1:0/1830317650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e967414a0 0x560e967584b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 -- 172.21.15.1:0/1830317650 >> 172.21.15.1:0/1830317650 conn(0x560e9673da30 msgr2=0x560e967448b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 -- 172.21.15.1:0/1830317650 shutdown_connections 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 -- 172.21.15.1:0/1830317650 wait complete. 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 -- start start 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.024+0000 7f6b95a54740 1 Processor -- start 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e967414a0 0x560e9674fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e967500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b95a54740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e9674c680 0x560e967c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b95a54740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1abd10 con 0x560e96741dc0 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b95a54740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1ad180 con 0x560e967414a0 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b95a54740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1ac3e0 con 0x560e9674c680 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b95a54740 10 client.0 _ll_register_callbacks cb 0x7f6b7c09ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:24.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e967500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e967500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39058/0 (socket says 172.21.15.1:39058) 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 -- 172.21.15.1:0/2295727769 learned_addr learned my addr 172.21.15.1:0/2295727769 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b91417640 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e967414a0 0x560e9674fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b91c18640 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e9674c680 0x560e967c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 -- 172.21.15.1:0/2295727769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e9674c680 msgr2=0x560e967c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e9674c680 0x560e967c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 -- 172.21.15.1:0/2295727769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e967414a0 msgr2=0x560e9674fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e967414a0 0x560e9674fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 -- 172.21.15.1:0/2295727769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e967c4ed0 con 0x560e96741dc0 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b91c18640 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e9674c680 0x560e967c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b90c16640 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e967500a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c098600 tx=0x7f6b7c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c81037fa216966d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:24.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.025+0000 7f6b74ff9640 1 -- 172.21.15.1:0/2295727769 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c020040 con 0x560e96741dc0 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b74ff9640 1 -- 172.21.15.1:0/2295727769 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6b7c0982a0 con 0x560e96741dc0 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 1 -- 172.21.15.1:0/2295727769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b88004bc0 con 0x560e96741dc0 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b74ff9640 1 -- 172.21.15.1:0/2295727769 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b7c0a48a0 con 0x560e96741dc0 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 10 client.16119 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 1 -- 172.21.15.1:0/2295727769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560e967c6200 con 0x560e96741dc0 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b74ff9640 1 -- 172.21.15.1:0/2295727769 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b88004bc0 con 0x560e96741dc0 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b74ff9640 1 -- 172.21.15.1:0/2295727769 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b7c09b080 con 0x560e96741dc0 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 10 client.16119 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 20 client.16119 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560e967c6960 0x560e967c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 4 client.16119 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:06:24.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b95a54740 1 -- 172.21.15.1:0/2295727769 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e966aed60 con 0x560e967c6960 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.026+0000 7f6b91417640 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560e967c6960 0x560e967c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b91417640 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560e967c6960 0x560e967c8d80 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5751b6540e529e server_cookie=768787cb9dac2526 in_seq=0 out_seq=0 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b74ff9640 10 client.16119 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b74ff9640 1 -- 172.21.15.1:0/2295727769 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560e966aed60 con 0x560e967c6960 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b74ff9640 10 client.16119 handle_command_reply: tid=0 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 client.16119 shutdown 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 -- 172.21.15.1:0/2295727769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 msgr2=0x560e967500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e967500a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c098600 tx=0x7f6b7c005d30 comp rx=0 tx=0).stop 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 -- 172.21.15.1:0/2295727769 shutdown_connections 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x560e967c6960 0x560e967c8d80 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560e9674c680 0x560e967c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560e96741dc0 0x560e967500a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 --2- 172.21.15.1:0/2295727769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e967414a0 0x560e9674fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 -- 172.21.15.1:0/2295727769 >> 172.21.15.1:0/2295727769 conn(0x560e9673da30 msgr2=0x560e9673c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b74ff9640 0 client.16119 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 -- 172.21.15.1:0/2295727769 shutdown_connections 2024-09-19T09:06:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 1 -- 172.21.15.1:0/2295727769 wait complete. 2024-09-19T09:06:24.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.027+0000 7f6b95a54740 20 client.16119 trim_cache size 0 max 16384 2024-09-19T09:06:24.037 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:06:24.037 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:06:24.037 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:06:24.037 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 -- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6b780a3240 msgr2=0x7f6b780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6b780a3240 0x7f6b780a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009fd0 tx=0x7f6b8400c040 comp rx=0 tx=0).stop 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 -- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c101420 msgr2=0x7f6b8c198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c101420 0x7f6b8c198aa0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00d950 tx=0x7f6b7c00de10 comp rx=0 tx=0).stop 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 -- 172.21.15.1:0/1819916971 shutdown_connections 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f6b780a3240 0x7f6b780a5700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c106a80 0x7f6b8c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b8c101420 0x7f6b8c198aa0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 --2- 172.21.15.1:0/1819916971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8c100a80 0x7f6b8c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:24.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 -- 172.21.15.1:0/1819916971 >> 172.21.15.1:0/1819916971 conn(0x7f6b8c0fc7a0 msgr2=0x7f6b8c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:24.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 -- 172.21.15.1:0/1819916971 shutdown_connections 2024-09-19T09:06:24.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:24.028+0000 7f6b9367b640 1 -- 172.21.15.1:0/1819916971 wait complete. 2024-09-19T09:06:24.853 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:06:24.854 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:06:25.118 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 -- 172.21.15.1:0/2975748606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460102d40 msgr2=0x7f9460103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 --2- 172.21.15.1:0/2975748606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460102d40 0x7f9460103120 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9450009900 tx=0x7f945002a480 comp rx=0 tx=0).stop 2024-09-19T09:06:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 -- 172.21.15.1:0/2975748606 shutdown_connections 2024-09-19T09:06:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 --2- 172.21.15.1:0/2975748606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f946010c170 0x7f946010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 --2- 172.21.15.1:0/2975748606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9460103660 0x7f946010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 --2- 172.21.15.1:0/2975748606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460102d40 0x7f9460103120 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 -- 172.21.15.1:0/2975748606 >> 172.21.15.1:0/2975748606 conn(0x7f94600fc7a0 msgr2=0x7f94600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 -- 172.21.15.1:0/2975748606 shutdown_connections 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.573+0000 7f946572e640 1 -- 172.21.15.1:0/2975748606 wait complete. 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.574+0000 7f946572e640 1 Processor -- start 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.574+0000 7f946572e640 1 -- start start 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.574+0000 7f946572e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9460102d40 0x7f94601985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.574+0000 7f946572e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460103660 0x7f9460198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.574+0000 7f946572e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f946010c170 0x7f946019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.574+0000 7f946572e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9460112090 con 0x7f9460103660 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.574+0000 7f946572e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9460111f10 con 0x7f9460102d40 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.574+0000 7f946572e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9460112210 con 0x7f946010c170 2024-09-19T09:06:25.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460103660 0x7f9460198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9460102d40 0x7f94601985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460103660 0x7f9460198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39080/0 (socket says 172.21.15.1:39080) 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 -- 172.21.15.1:0/1448303898 learned_addr learned my addr 172.21.15.1:0/1448303898 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945f7fe640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f946010c170 0x7f946019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 -- 172.21.15.1:0/1448303898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f946010c170 msgr2=0x7f946019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f946010c170 0x7f946019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 -- 172.21.15.1:0/1448303898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9460102d40 msgr2=0x7f94601985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9460102d40 0x7f94601985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 -- 172.21.15.1:0/1448303898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946019d560 con 0x7f9460103660 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945f7fe640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f946010c170 0x7f946019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f945e7fc640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460103660 0x7f9460198af0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f945400c970 tx=0x7f945400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f9447fff640 1 -- 172.21.15.1:0/1448303898 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454007bb0 con 0x7f9460103660 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f9447fff640 1 -- 172.21.15.1:0/1448303898 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9454007d50 con 0x7f9460103660 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946019d850 con 0x7f9460103660 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f9447fff640 1 -- 172.21.15.1:0/1448303898 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945400f450 con 0x7f9460103660 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.575+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94601a5130 con 0x7f9460103660 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.576+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9460103120 con 0x7f9460103660 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.578+0000 7f9447fff640 1 -- 172.21.15.1:0/1448303898 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f9454005000 con 0x7f9460103660 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.578+0000 7f9447fff640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f94480a3240 0x7f94480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.578+0000 7f945effd640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f94480a3240 0x7f94480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.578+0000 7f9447fff640 1 -- 172.21.15.1:0/1448303898 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f94540cfb70 con 0x7f9460103660 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.579+0000 7f945effd640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f94480a3240 0x7f94480a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9450009230 tx=0x7f94500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.581+0000 7f9447fff640 1 -- 172.21.15.1:0/1448303898 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9454014030 con 0x7f9460103660 2024-09-19T09:06:25.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:25 smithi001 ceph-mon[30939]: pgmap v407: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:06:25.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.799+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9460199910 con 0x7f9460103660 2024-09-19T09:06:25.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.800+0000 7f9447fff640 1 -- 172.21.15.1:0/1448303898 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11878 (secure 0 0 0) 0x7f945409c810 con 0x7f9460103660 2024-09-19T09:06:25.801 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:06:25.801 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":24,"btime":"2024-09-19T09:03:44:394352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:03:43.446158+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:06:25.802 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 24 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f94480a3240 msgr2=0x7f94480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f94480a3240 0x7f94480a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9450009230 tx=0x7f94500058d0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460103660 msgr2=0x7f9460198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460103660 0x7f9460198af0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f945400c970 tx=0x7f945400ce30 comp rx=0 tx=0).stop 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 shutdown_connections 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f94480a3240 0x7f94480a5700 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f946010c170 0x7f946019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9460103660 0x7f9460198af0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 --2- 172.21.15.1:0/1448303898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9460102d40 0x7f94601985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 >> 172.21.15.1:0/1448303898 conn(0x7f94600fc7a0 msgr2=0x7f94600fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:25.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 shutdown_connections 2024-09-19T09:06:25.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:25.802+0000 7f946572e640 1 -- 172.21.15.1:0/1448303898 wait complete. 2024-09-19T09:06:25.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:25 smithi064 ceph-mon[35179]: pgmap v407: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:06:25.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:25 smithi022 ceph-mon[35107]: pgmap v407: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:06:26.559 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:06:26.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:26 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1448303898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:26.820 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:26.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:26 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1448303898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:26.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:26 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1448303898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:06:27.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.258+0000 7f5093e52640 1 -- 172.21.15.1:0/1835285245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c103660 msgr2=0x7f508c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.258+0000 7f5093e52640 1 --2- 172.21.15.1:0/1835285245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c103660 0x7f508c10bb50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f507c009900 tx=0x7f507c02a480 comp rx=0 tx=0).stop 2024-09-19T09:06:27.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.258+0000 7f5093e52640 1 -- 172.21.15.1:0/1835285245 shutdown_connections 2024-09-19T09:06:27.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.258+0000 7f5093e52640 1 --2- 172.21.15.1:0/1835285245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c10c170 0x7f508c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.258+0000 7f5093e52640 1 --2- 172.21.15.1:0/1835285245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c103660 0x7f508c10bb50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.258+0000 7f5093e52640 1 --2- 172.21.15.1:0/1835285245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f508c102d40 0x7f508c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.258+0000 7f5093e52640 1 -- 172.21.15.1:0/1835285245 >> 172.21.15.1:0/1835285245 conn(0x7f508c0fc7a0 msgr2=0x7f508c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 -- 172.21.15.1:0/1835285245 shutdown_connections 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 -- 172.21.15.1:0/1835285245 wait complete. 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 Processor -- start 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 -- start start 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c102d40 0x7f508c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c103660 0x7f508c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f508c10c170 0x7f508c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f508c112090 con 0x7f508c102d40 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f508c111f10 con 0x7f508c103660 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.259+0000 7f5093e52640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f508c112210 con 0x7f508c10c170 2024-09-19T09:06:27.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c102d40 0x7f508c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c102d40 0x7f508c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39110/0 (socket says 172.21.15.1:39110) 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 -- 172.21.15.1:0/3342251114 learned_addr learned my addr 172.21.15.1:0/3342251114 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f50913ed640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c103660 0x7f508c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f50923ef640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f508c10c170 0x7f508c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 -- 172.21.15.1:0/3342251114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f508c10c170 msgr2=0x7f508c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f508c10c170 0x7f508c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 -- 172.21.15.1:0/3342251114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c103660 msgr2=0x7f508c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c103660 0x7f508c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 -- 172.21.15.1:0/3342251114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c1a6a20 con 0x7f508c102d40 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5091bee640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c102d40 0x7f508c1009a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f508800d770 tx=0x7f508800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:27.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5082ffd640 1 -- 172.21.15.1:0/3342251114 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088017070 con 0x7f508c102d40 2024-09-19T09:06:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5082ffd640 1 -- 172.21.15.1:0/3342251114 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5088005520 con 0x7f508c102d40 2024-09-19T09:06:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5093e52640 1 -- 172.21.15.1:0/3342251114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c1a6d10 con 0x7f508c102d40 2024-09-19T09:06:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.260+0000 7f5082ffd640 1 -- 172.21.15.1:0/3342251114 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088010460 con 0x7f508c102d40 2024-09-19T09:06:27.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.261+0000 7f5093e52640 1 -- 172.21.15.1:0/3342251114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c1a71c0 con 0x7f508c102d40 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.263+0000 7f5082ffd640 1 -- 172.21.15.1:0/3342251114 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f5088004ea0 con 0x7f508c102d40 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.263+0000 7f509622b740 1 Processor -- start 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.263+0000 7f509622b740 1 -- start start 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.263+0000 7f509622b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d24ffb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.263+0000 7f509622b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d24ffba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.263+0000 7f509622b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d25008760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.263+0000 7f509622b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556d24f612f0 con 0x556d24ffcb40 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.263+0000 7f509622b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556d24f08cf0 con 0x556d25006370 2024-09-19T09:06:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f509622b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556d24f5d2b0 con 0x556d24ffb5d0 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f5082ffd640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f50780a32c0 0x7f50780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50923ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d24ffb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50923ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d24ffb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39116/0 (socket says 172.21.15.1:39116) 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50923ef640 1 -- 172.21.15.1:0/3040691441 learned_addr learned my addr 172.21.15.1:0/3040691441 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50913ed640 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d25008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f5091bee640 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d24ffba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50923ef640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f50780a32c0 0x7f50780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f5082ffd640 1 -- 172.21.15.1:0/3342251114 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f50880cf300 con 0x7f508c102d40 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50913ed640 1 -- 172.21.15.1:0/3040691441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 msgr2=0x556d24ffba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50913ed640 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d24ffba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50913ed640 1 -- 172.21.15.1:0/3040691441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 msgr2=0x556d24ffb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50913ed640 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d24ffb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50913ed640 1 -- 172.21.15.1:0/3040691441 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d24eed3a0 con 0x556d25006370 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50923ef640 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d24ffb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50913ed640 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d25008760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f507c005940 tx=0x7f507c005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=964ffe82625ebef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.264+0000 7f50923ef640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f50780a32c0 0x7f50780a5780 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5084005f40 tx=0x7f5084004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f5077fff640 1 -- 172.21.15.1:0/3040691441 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c040070 con 0x556d25006370 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f5077fff640 1 -- 172.21.15.1:0/3040691441 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f507c031980 con 0x556d25006370 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f5077fff640 1 -- 172.21.15.1:0/3040691441 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c035040 con 0x556d25006370 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f509622b740 1 -- 172.21.15.1:0/3040691441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 msgr2=0x556d25008760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f509622b740 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d25008760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f507c005940 tx=0x7f507c005c00 comp rx=0 tx=0).stop 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f509622b740 1 -- 172.21.15.1:0/3040691441 shutdown_connections 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f509622b740 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d25008760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f509622b740 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d24ffba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f509622b740 1 --2- 172.21.15.1:0/3040691441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d24ffb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f509622b740 1 -- 172.21.15.1:0/3040691441 >> 172.21.15.1:0/3040691441 conn(0x556d24fc4310 msgr2=0x556d24ff7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.265+0000 7f509622b740 1 -- 172.21.15.1:0/3040691441 shutdown_connections 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 -- 172.21.15.1:0/3040691441 wait complete. 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 -- start start 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 Processor -- start 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d25005c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffcb40 0x556d25002f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d25003480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556d25009010 con 0x556d25006370 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556d24f1c060 con 0x556d24ffcb40 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556d25009190 con 0x556d24ffb5d0 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.266+0000 7f509622b740 10 client.0 _ll_register_callbacks cb 0x556d24c6f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50923ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d25003480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50923ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d25003480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39122/0 (socket says 172.21.15.1:39122) 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50923ef640 1 -- 172.21.15.1:0/1895797947 learned_addr learned my addr 172.21.15.1:0/1895797947 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50913ed640 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffcb40 0x556d25002f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f5091bee640 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d25005c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50913ed640 1 -- 172.21.15.1:0/1895797947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 msgr2=0x556d25005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50913ed640 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d25005c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50913ed640 1 -- 172.21.15.1:0/1895797947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 msgr2=0x556d25003480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50913ed640 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d25003480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50913ed640 1 -- 172.21.15.1:0/1895797947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d24cd23c0 con 0x556d24ffcb40 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50923ef640 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d25003480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50913ed640 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffcb40 0x556d25002f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f507c0056f0 tx=0x7f507c031b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d4a8103f790b3a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50757fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50757fa640 1 -- 172.21.15.1:0/1895797947 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c040030 con 0x556d24ffcb40 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50757fa640 1 -- 172.21.15.1:0/1895797947 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f507c031780 con 0x556d24ffcb40 2024-09-19T09:06:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f509622b740 1 -- 172.21.15.1:0/1895797947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f507c031980 con 0x556d24ffcb40 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f50757fa640 1 -- 172.21.15.1:0/1895797947 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f507c035070 con 0x556d24ffcb40 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.267+0000 7f509622b740 10 client.25637 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f509622b740 1 -- 172.21.15.1:0/1895797947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556d250149d0 con 0x556d24ffcb40 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f50757fa640 1 -- 172.21.15.1:0/1895797947 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f507c031980 con 0x556d24ffcb40 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f50757fa640 1 -- 172.21.15.1:0/1895797947 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f507c003680 con 0x556d24ffcb40 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f509622b740 10 client.25637 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f509622b740 10 client.25637 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f509622b740 20 client.25637 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f509622b740 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x556d25015d20 0x556d25018110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f509622b740 4 client.25637 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f509622b740 1 -- 172.21.15.1:0/1895797947 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d24f6e860 con 0x556d25015d20 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.268+0000 7f5091bee640 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x556d25015d20 0x556d25018110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.269+0000 7f50757fa640 10 client.25637 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.269+0000 7f5091bee640 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x556d25015d20 0x556d25018110 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9430ea115ded011c server_cookie=e599e6139f3c39c9 in_seq=0 out_seq=0 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.269+0000 7f50757fa640 1 -- 172.21.15.1:0/1895797947 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d24f6e860 con 0x556d25015d20 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.269+0000 7f50757fa640 10 client.25637 handle_command_reply: tid=0 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.269+0000 7f509622b740 1 client.25637 shutdown 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.269+0000 7f509622b740 1 -- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffcb40 msgr2=0x556d25002f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.269+0000 7f509622b740 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffcb40 0x556d25002f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f507c0056f0 tx=0x7f507c031b30 comp rx=0 tx=0).stop 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.269+0000 7f509622b740 1 -- 172.21.15.1:0/1895797947 shutdown_connections 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f509622b740 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x556d25015d20 0x556d25018110 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f509622b740 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d25003480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f509622b740 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffcb40 0x556d25002f40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f509622b740 1 --2- 172.21.15.1:0/1895797947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d25005c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f50757fa640 0 client.25637 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:06:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f509622b740 1 -- 172.21.15.1:0/1895797947 >> 172.21.15.1:0/1895797947 conn(0x556d24fc4310 msgr2=0x556d24ffd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f509622b740 1 -- 172.21.15.1:0/1895797947 shutdown_connections 2024-09-19T09:06:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f509622b740 1 -- 172.21.15.1:0/1895797947 wait complete. 2024-09-19T09:06:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.270+0000 7f509622b740 20 client.25637 trim_cache size 0 max 16384 2024-09-19T09:06:27.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f509622b740 1 Processor -- start 2024-09-19T09:06:27.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f509622b740 1 -- start start 2024-09-19T09:06:27.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f509622b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d250122b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f509622b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d2501d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f509622b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d2501dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f509622b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1b20e0 con 0x556d24ffcb40 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f509622b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1af9b0 con 0x556d25006370 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f509622b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1ad800 con 0x556d24ffb5d0 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50913ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d2501d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50913ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d2501d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39134/0 (socket says 172.21.15.1:39134) 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50913ed640 1 -- 172.21.15.1:0/628786565 learned_addr learned my addr 172.21.15.1:0/628786565 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50923ef640 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d2501dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f5091bee640 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d250122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50913ed640 1 -- 172.21.15.1:0/628786565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 msgr2=0x556d250122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50913ed640 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d250122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50913ed640 1 -- 172.21.15.1:0/628786565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 msgr2=0x556d2501dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:27.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50913ed640 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d2501dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50913ed640 1 -- 172.21.15.1:0/628786565 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d25001490 con 0x556d24ffcb40 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f5091bee640 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d250122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.283+0000 7f50923ef640 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d2501dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f50913ed640 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d2501d7a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f507c003c40 tx=0x7f507c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f15a9f4123b9fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f50777fe640 1 -- 172.21.15.1:0/628786565 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c040070 con 0x556d24ffcb40 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f50777fe640 1 -- 172.21.15.1:0/628786565 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f507c05d020 con 0x556d24ffcb40 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f50777fe640 1 -- 172.21.15.1:0/628786565 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0053a0 con 0x556d24ffcb40 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f509622b740 1 -- 172.21.15.1:0/628786565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 msgr2=0x556d2501d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f509622b740 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d2501d7a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f507c003c40 tx=0x7f507c02a480 comp rx=0 tx=0).stop 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f509622b740 1 -- 172.21.15.1:0/628786565 shutdown_connections 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f509622b740 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d25006370 0x556d2501dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f509622b740 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d24ffcb40 0x556d2501d7a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f509622b740 1 --2- 172.21.15.1:0/628786565 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffb5d0 0x556d250122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.284+0000 7f509622b740 1 -- 172.21.15.1:0/628786565 >> 172.21.15.1:0/628786565 conn(0x556d24fc4310 msgr2=0x556d25004fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 -- 172.21.15.1:0/628786565 shutdown_connections 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 -- 172.21.15.1:0/628786565 wait complete. 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 -- start start 2024-09-19T09:06:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 Processor -- start 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffb5d0 0x556d2500eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffcb40 0x556d25009ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d2500a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1ade70 con 0x556d25006370 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1af2e0 con 0x556d24ffb5d0 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f508c1ae540 con 0x556d24ffcb40 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.285+0000 7f509622b740 10 client.0 _ll_register_callbacks cb 0x7f507c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f50923ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d2500a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f50923ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d2500a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39146/0 (socket says 172.21.15.1:39146) 2024-09-19T09:06:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f5091bee640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffb5d0 0x556d2500eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f50923ef640 1 -- 172.21.15.1:0/2707346793 learned_addr learned my addr 172.21.15.1:0/2707346793 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f50913ed640 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffcb40 0x556d25009ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f5091bee640 1 -- 172.21.15.1:0/2707346793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffcb40 msgr2=0x556d25009ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f5091bee640 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffcb40 0x556d25009ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f5091bee640 1 -- 172.21.15.1:0/2707346793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 msgr2=0x556d2500a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f5091bee640 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d2500a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f5091bee640 1 -- 172.21.15.1:0/2707346793 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d2500abc0 con 0x556d24ffb5d0 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f50923ef640 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d2500a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f5091bee640 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffb5d0 0x556d2500eb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50880cce30 tx=0x7f508801e310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d67d652bab082f39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f50757fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f50757fa640 1 -- 172.21.15.1:0/2707346793 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880b3070 con 0x556d24ffb5d0 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f50757fa640 1 -- 172.21.15.1:0/2707346793 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5088009d50 con 0x556d24ffb5d0 2024-09-19T09:06:27.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.286+0000 7f509622b740 1 -- 172.21.15.1:0/2707346793 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f507c05d020 con 0x556d24ffb5d0 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f50757fa640 1 -- 172.21.15.1:0/2707346793 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5088020040 con 0x556d24ffb5d0 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f509622b740 10 client.25643 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f509622b740 1 -- 172.21.15.1:0/2707346793 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556d25080750 con 0x556d24ffb5d0 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f50757fa640 1 -- 172.21.15.1:0/2707346793 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f507c05d020 con 0x556d24ffb5d0 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f50757fa640 1 -- 172.21.15.1:0/2707346793 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5088098020 con 0x556d24ffb5d0 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f509622b740 10 client.25643 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f509622b740 10 client.25643 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f509622b740 20 client.25643 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f509622b740 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x556d25080dd0 0x556d25083200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f509622b740 4 client.25643 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f509622b740 1 -- 172.21.15.1:0/2707346793 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d24f68d70 con 0x556d25080dd0 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f50913ed640 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x556d25080dd0 0x556d25083200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f50757fa640 10 client.25643 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.287+0000 7f50913ed640 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x556d25080dd0 0x556d25083200 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca33d0b476ca1193 server_cookie=f68bbd78c65e440 in_seq=0 out_seq=0 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f50757fa640 1 -- 172.21.15.1:0/2707346793 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d24f68d70 con 0x556d25080dd0 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f50757fa640 10 client.25643 handle_command_reply: tid=0 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 client.25643 shutdown 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 -- 172.21.15.1:0/2707346793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffb5d0 msgr2=0x556d2500eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffb5d0 0x556d2500eb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50880cce30 tx=0x7f508801e310 comp rx=0 tx=0).stop 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 -- 172.21.15.1:0/2707346793 shutdown_connections 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x556d25080dd0 0x556d25083200 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556d25006370 0x556d2500a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556d24ffcb40 0x556d25009ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f50757fa640 0 client.25643 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 --2- 172.21.15.1:0/2707346793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556d24ffb5d0 0x556d2500eb70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 -- 172.21.15.1:0/2707346793 >> 172.21.15.1:0/2707346793 conn(0x556d24fc4310 msgr2=0x556d24ffd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 -- 172.21.15.1:0/2707346793 shutdown_connections 2024-09-19T09:06:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 1 -- 172.21.15.1:0/2707346793 wait complete. 2024-09-19T09:06:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.288+0000 7f509622b740 20 client.25643 trim_cache size 0 max 16384 2024-09-19T09:06:27.296 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 -- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f50780a32c0 msgr2=0x7f50780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f50780a32c0 0x7f50780a5780 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5084005f40 tx=0x7f5084004ab0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 -- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c102d40 msgr2=0x7f508c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c102d40 0x7f508c1009a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f508800d770 tx=0x7f508800dc30 comp rx=0 tx=0).stop 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 -- 172.21.15.1:0/3342251114 shutdown_connections 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f50780a32c0 0x7f50780a5780 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f508c10c170 0x7f508c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c103660 0x7f508c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 --2- 172.21.15.1:0/3342251114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f508c102d40 0x7f508c1009a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 -- 172.21.15.1:0/3342251114 >> 172.21.15.1:0/3342251114 conn(0x7f508c0fc7a0 msgr2=0x7f508c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 -- 172.21.15.1:0/3342251114 shutdown_connections 2024-09-19T09:06:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:27.289+0000 7f5093e52640 1 -- 172.21.15.1:0/3342251114 wait complete. 2024-09-19T09:06:27.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:27 smithi064 ceph-mon[35179]: pgmap v408: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T09:06:27.933 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:27 smithi001 ceph-mon[30939]: pgmap v408: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T09:06:27.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:06:27.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:27 smithi022 ceph-mon[35107]: pgmap v408: 97 pgs: 97 active+clean; 24 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T09:06:28.215 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 -- 172.21.15.1:0/58065944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214101420 msgr2=0x7f321410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 --2- 172.21.15.1:0/58065944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214101420 0x7f321410d950 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f320c009cd0 tx=0x7f320c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 -- 172.21.15.1:0/58065944 shutdown_connections 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 --2- 172.21.15.1:0/58065944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214101420 0x7f321410d950 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 --2- 172.21.15.1:0/58065944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3214100a80 0x7f3214100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 --2- 172.21.15.1:0/58065944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3214106a80 0x7f3214106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 -- 172.21.15.1:0/58065944 >> 172.21.15.1:0/58065944 conn(0x7f32140fc7a0 msgr2=0x7f32140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 -- 172.21.15.1:0/58065944 shutdown_connections 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 -- 172.21.15.1:0/58065944 wait complete. 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 Processor -- start 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.668+0000 7f321ab65640 1 -- start start 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f321ab65640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3214100a80 0x7f32140fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f321ab65640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3214101420 0x7f32140fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f321ab65640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214106a80 0x7f32140fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f321ab65640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3214110fa0 con 0x7f3214106a80 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f321ab65640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3214110e20 con 0x7f3214101420 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f321ab65640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3214111120 con 0x7f3214100a80 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214106a80 0x7f32140fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214106a80 0x7f32140fd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39170/0 (socket says 172.21.15.1:39170) 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 -- 172.21.15.1:0/1650610781 learned_addr learned my addr 172.21.15.1:0/1650610781 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3218901640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3214100a80 0x7f32140fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f320bfff640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3214101420 0x7f32140fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 -- 172.21.15.1:0/1650610781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3214100a80 msgr2=0x7f32140fcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3214100a80 0x7f32140fcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 -- 172.21.15.1:0/1650610781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3214101420 msgr2=0x7f32140fd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3214101420 0x7f32140fd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 -- 172.21.15.1:0/1650610781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32141a69b0 con 0x7f3214106a80 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3219102640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214106a80 0x7f32140fd7b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f320c006010 tx=0x7f320c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.669+0000 7f3209ffb640 1 -- 172.21.15.1:0/1650610781 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c004040 con 0x7f3214106a80 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.670+0000 7f321ab65640 1 -- 172.21.15.1:0/1650610781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32141a6c40 con 0x7f3214106a80 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.670+0000 7f3209ffb640 1 -- 172.21.15.1:0/1650610781 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f320c0046e0 con 0x7f3214106a80 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.670+0000 7f3209ffb640 1 -- 172.21.15.1:0/1650610781 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c046480 con 0x7f3214106a80 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.670+0000 7f321ab65640 1 -- 172.21.15.1:0/1650610781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32141a71d0 con 0x7f3214106a80 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.672+0000 7f3209ffb640 1 -- 172.21.15.1:0/1650610781 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f320c030630 con 0x7f3214106a80 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.672+0000 7f321cf3e740 1 Processor -- start 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.672+0000 7f321cf3e740 1 -- start start 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8db40 0x5610f2e8c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e8ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e99760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f321cf3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610f2df22f0 con 0x5610f2e8c5d0 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f321cf3e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5610f2d99cf0 con 0x5610f2e97370 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f321cf3e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610f2dee2b0 con 0x5610f2e8db40 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e8ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e8ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39178/0 (socket says 172.21.15.1:39178) 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 -- 172.21.15.1:0/3648052038 learned_addr learned my addr 172.21.15.1:0/3648052038 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3209ffb640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31fc0a3240 0x7f31fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f320bfff640 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e99760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f320bfff640 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8db40 0x5610f2e8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3219102640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31fc0a3240 0x7f31fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 -- 172.21.15.1:0/3648052038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8db40 msgr2=0x5610f2e8c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8db40 0x5610f2e8c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 -- 172.21.15.1:0/3648052038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 msgr2=0x5610f2e99760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e99760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 -- 172.21.15.1:0/3648052038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f2d7e3a0 con 0x5610f2e8c5d0 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f320bfff640 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e99760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3209ffb640 1 -- 172.21.15.1:0/1650610781 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f320c02e030 con 0x7f3214106a80 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.673+0000 7f3218901640 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e8ca10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f321000bc50 tx=0x7f32100107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37615008ce1679b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f3219102640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31fc0a3240 0x7f31fc0a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f320c0eef20 tx=0x7f320c090550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f31faffd640 1 -- 172.21.15.1:0/3648052038 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321001c480 con 0x5610f2e8c5d0 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f31faffd640 1 -- 172.21.15.1:0/3648052038 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f321001cb20 con 0x5610f2e8c5d0 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f31faffd640 1 -- 172.21.15.1:0/3648052038 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210011c80 con 0x5610f2e8c5d0 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 -- 172.21.15.1:0/3648052038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 msgr2=0x5610f2e8ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e8ca10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f321000bc50 tx=0x7f32100107a0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 -- 172.21.15.1:0/3648052038 shutdown_connections 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e99760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e8ca10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3648052038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8db40 0x5610f2e8c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 -- 172.21.15.1:0/3648052038 >> 172.21.15.1:0/3648052038 conn(0x5610f2e55310 msgr2=0x5610f2e88c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 -- 172.21.15.1:0/3648052038 shutdown_connections 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.674+0000 7f321cf3e740 1 -- 172.21.15.1:0/3648052038 wait complete. 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 1 -- start start 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 1 Processor -- start 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2e96d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8db40 0x5610f2e94020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e94610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610f2e9a070 con 0x5610f2e8db40 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5610f2dad060 con 0x5610f2e97370 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610f2e9a1f0 con 0x5610f2e8c5d0 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f321cf3e740 10 client.0 _ll_register_callbacks cb 0x5610f2b008c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f3218901640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8db40 0x5610f2e94020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.675+0000 7f3218901640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8db40 0x5610f2e94020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39180/0 (socket says 172.21.15.1:39180) 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f3218901640 1 -- 172.21.15.1:0/2771159355 learned_addr learned my addr 172.21.15.1:0/2771159355 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f320bfff640 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e94610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f320bfff640 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2e96d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f3218901640 1 -- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 msgr2=0x5610f2e96d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f3218901640 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2e96d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f3218901640 1 -- 172.21.15.1:0/2771159355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 msgr2=0x5610f2e94610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f3218901640 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e94610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f3218901640 1 -- 172.21.15.1:0/2771159355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f2b633c0 con 0x5610f2e8db40 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f320bfff640 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2e96d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f3218901640 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8db40 0x5610f2e94020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f321000bc20 tx=0x7f321000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e83e1d4aebcab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f31f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f31f3fff640 1 -- 172.21.15.1:0/2771159355 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210011b90 con 0x5610f2e8db40 2024-09-19T09:06:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f31f3fff640 1 -- 172.21.15.1:0/2771159355 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3210011d30 con 0x5610f2e8db40 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f321cf3e740 1 -- 172.21.15.1:0/2771159355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f321001cb20 con 0x5610f2e8db40 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f31f3fff640 1 -- 172.21.15.1:0/2771159355 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3210004020 con 0x5610f2e8db40 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f321cf3e740 10 client.16155 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f321cf3e740 1 -- 172.21.15.1:0/2771159355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5610f2ea5b40 con 0x5610f2e8db40 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.676+0000 7f31f3fff640 1 -- 172.21.15.1:0/2771159355 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f321001cb20 con 0x5610f2e8db40 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.677+0000 7f31f3fff640 1 -- 172.21.15.1:0/2771159355 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f32100037b0 con 0x5610f2e8db40 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.677+0000 7f321cf3e740 10 client.16155 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.677+0000 7f321cf3e740 10 client.16155 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.677+0000 7f321cf3e740 20 client.16155 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.677+0000 7f321cf3e740 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5610f2ea6fa0 0x5610f2ea9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.677+0000 7f321cf3e740 4 client.16155 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.677+0000 7f321cf3e740 1 -- 172.21.15.1:0/2771159355 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610f2dff860 con 0x5610f2ea6fa0 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.677+0000 7f320bfff640 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5610f2ea6fa0 0x5610f2ea9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f320bfff640 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5610f2ea6fa0 0x5610f2ea9390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e1fafdf8c29ee4f server_cookie=efd11718d146405b in_seq=0 out_seq=0 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f31f3fff640 10 client.16155 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f31f3fff640 1 -- 172.21.15.1:0/2771159355 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610f2dff860 con 0x5610f2ea6fa0 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f31f3fff640 10 client.16155 handle_command_reply: tid=0 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 client.16155 shutdown 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 -- 172.21.15.1:0/2771159355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8db40 msgr2=0x5610f2e94020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8db40 0x5610f2e94020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f321000bc20 tx=0x7f321000b8f0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 -- 172.21.15.1:0/2771159355 shutdown_connections 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5610f2ea6fa0 0x5610f2ea9390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e97370 0x5610f2e94610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8db40 0x5610f2e94020 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 --2- 172.21.15.1:0/2771159355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2e96d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f31f3fff640 0 client.16155 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:06:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.678+0000 7f321cf3e740 1 -- 172.21.15.1:0/2771159355 >> 172.21.15.1:0/2771159355 conn(0x5610f2e55310 msgr2=0x5610f2e8e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.679+0000 7f321cf3e740 1 -- 172.21.15.1:0/2771159355 shutdown_connections 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.679+0000 7f321cf3e740 1 -- 172.21.15.1:0/2771159355 wait complete. 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.679+0000 7f321cf3e740 20 client.16155 trim_cache size 0 max 16384 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f321cf3e740 1 Processor -- start 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f321cf3e740 1 -- start start 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e938e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2ea3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e97370 0x5610f2e93000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f321cf3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32141b2110 con 0x5610f2e8c5d0 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f321cf3e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32141af9e0 con 0x5610f2e8db40 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f321cf3e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f32141ad830 con 0x5610f2e97370 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f3218901640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2ea3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f3218901640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2ea3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:33646/0 (socket says 172.21.15.1:33646) 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.692+0000 7f3218901640 1 -- 172.21.15.1:0/571518790 learned_addr learned my addr 172.21.15.1:0/571518790 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f3218901640 1 -- 172.21.15.1:0/571518790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e97370 msgr2=0x5610f2e93000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f3218901640 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e97370 0x5610f2e93000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f320bfff640 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f3218901640 1 -- 172.21.15.1:0/571518790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 msgr2=0x5610f2e938e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f3218901640 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e938e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f3218901640 1 -- 172.21.15.1:0/571518790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f2e89960 con 0x5610f2e8db40 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f320bfff640 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f3218901640 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2ea3340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3210003d40 tx=0x7f321000b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11835a914750f62d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f31fa7fc640 1 -- 172.21.15.1:0/571518790 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210035070 con 0x5610f2e8db40 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f31fa7fc640 1 -- 172.21.15.1:0/571518790 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3210003dc0 con 0x5610f2e8db40 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.693+0000 7f31fa7fc640 1 -- 172.21.15.1:0/571518790 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321001c480 con 0x5610f2e8db40 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 -- 172.21.15.1:0/571518790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 msgr2=0x5610f2ea3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2ea3340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3210003d40 tx=0x7f321000b410 comp rx=0 tx=0).stop 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 -- 172.21.15.1:0/571518790 shutdown_connections 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e97370 0x5610f2e93000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2ea3340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 --2- 172.21.15.1:0/571518790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e8c5d0 0x5610f2e938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 -- 172.21.15.1:0/571518790 >> 172.21.15.1:0/571518790 conn(0x5610f2e55310 msgr2=0x5610f2e928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 -- 172.21.15.1:0/571518790 shutdown_connections 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 -- 172.21.15.1:0/571518790 wait complete. 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.694+0000 7f321cf3e740 1 -- start start 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f321cf3e740 1 Processor -- start 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2f0cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2f0d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f321cf3e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e97370 0x5610f2e9f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f321cf3e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32141adea0 con 0x5610f2e97370 2024-09-19T09:06:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f321cf3e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32141af310 con 0x5610f2e8db40 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f321cf3e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f32141ae570 con 0x5610f2e8c5d0 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f321cf3e740 10 client.0 _ll_register_callbacks cb 0x7f321000baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f320bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e97370 0x5610f2e9f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f320bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e97370 0x5610f2e9f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39200/0 (socket says 172.21.15.1:39200) 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f320bfff640 1 -- 172.21.15.1:0/3608715119 learned_addr learned my addr 172.21.15.1:0/3608715119 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f320bfff640 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2f0cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.695+0000 7f3218901640 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2f0d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f320bfff640 1 -- 172.21.15.1:0/3608715119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 msgr2=0x5610f2f0d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f320bfff640 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2f0d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f320bfff640 1 -- 172.21.15.1:0/3608715119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e97370 msgr2=0x5610f2e9f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f320bfff640 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e97370 0x5610f2e9f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f320bfff640 1 -- 172.21.15.1:0/3608715119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f2ea3880 con 0x5610f2e8c5d0 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f320bfff640 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2f0cc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3204000c00 tx=0x7f3204014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c84e643403f2f0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:28.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f31f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f31f3fff640 1 -- 172.21.15.1:0/3608715119 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320401faa0 con 0x5610f2e8c5d0 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f321cf3e740 1 -- 172.21.15.1:0/3608715119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3210003dc0 con 0x5610f2e8c5d0 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f31f3fff640 1 -- 172.21.15.1:0/3608715119 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f320401fc40 con 0x5610f2e8c5d0 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f31f3fff640 1 -- 172.21.15.1:0/3608715119 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3204004020 con 0x5610f2e8c5d0 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f321cf3e740 10 client.25624 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.696+0000 7f321cf3e740 1 -- 172.21.15.1:0/3608715119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5610f2e912b0 con 0x5610f2e8c5d0 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f31f3fff640 1 -- 172.21.15.1:0/3608715119 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3210003dc0 con 0x5610f2e8c5d0 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f31f3fff640 1 -- 172.21.15.1:0/3608715119 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f320402a460 con 0x5610f2e8c5d0 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f321cf3e740 10 client.25624 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f321cf3e740 10 client.25624 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f321cf3e740 20 client.25624 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5610f2f22a90 0x5610f2f24e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f321cf3e740 4 client.25624 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f321cf3e740 1 -- 172.21.15.1:0/3608715119 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5610f2df9d70 con 0x5610f2f22a90 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f3218901640 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5610f2f22a90 0x5610f2f24e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f3218901640 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5610f2f22a90 0x5610f2f24e80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64cb831e46edf04e server_cookie=464f451f634a26ad in_seq=0 out_seq=0 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.697+0000 7f31f3fff640 10 client.25624 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f31f3fff640 1 -- 172.21.15.1:0/3608715119 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5610f2df9d70 con 0x5610f2f22a90 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f31f3fff640 10 client.25624 handle_command_reply: tid=0 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 client.25624 shutdown 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 -- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 msgr2=0x5610f2f0cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2f0cc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3204000c00 tx=0x7f3204014040 comp rx=0 tx=0).stop 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 -- 172.21.15.1:0/3608715119 shutdown_connections 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x5610f2f22a90 0x5610f2f24e80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610f2e97370 0x5610f2e9f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610f2e8db40 0x5610f2f0d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 --2- 172.21.15.1:0/3608715119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610f2e8c5d0 0x5610f2f0cc30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f31f3fff640 0 client.25624 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:06:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 -- 172.21.15.1:0/3608715119 >> 172.21.15.1:0/3608715119 conn(0x5610f2e55310 msgr2=0x5610f2e960a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 -- 172.21.15.1:0/3608715119 shutdown_connections 2024-09-19T09:06:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 1 -- 172.21.15.1:0/3608715119 wait complete. 2024-09-19T09:06:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.698+0000 7f321cf3e740 20 client.25624 trim_cache size 0 max 16384 2024-09-19T09:06:28.715 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:06:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 -- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31fc0a3240 msgr2=0x7f31fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31fc0a3240 0x7f31fc0a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f320c0eef20 tx=0x7f320c090550 comp rx=0 tx=0).stop 2024-09-19T09:06:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 -- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214106a80 msgr2=0x7f32140fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214106a80 0x7f32140fd7b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f320c006010 tx=0x7f320c003f10 comp rx=0 tx=0).stop 2024-09-19T09:06:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 -- 172.21.15.1:0/1650610781 shutdown_connections 2024-09-19T09:06:28.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3214106a80 0x7f32140fd7b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3214101420 0x7f32140fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f31fc0a3240 0x7f31fc0a5700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 --2- 172.21.15.1:0/1650610781 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3214100a80 0x7f32140fcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:28.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 -- 172.21.15.1:0/1650610781 >> 172.21.15.1:0/1650610781 conn(0x7f32140fc7a0 msgr2=0x7f321406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:28.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 -- 172.21.15.1:0/1650610781 shutdown_connections 2024-09-19T09:06:28.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:28.699+0000 7f321ab65640 1 -- 172.21.15.1:0/1650610781 wait complete. 2024-09-19T09:06:29.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:06:29.788 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:29.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:29 smithi001 ceph-mon[30939]: pgmap v409: 97 pgs: 97 active+clean; 40 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-19T09:06:29.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:29 smithi064 ceph-mon[35179]: pgmap v409: 97 pgs: 97 active+clean; 40 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-19T09:06:29.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:29 smithi022 ceph-mon[35107]: pgmap v409: 97 pgs: 97 active+clean; 40 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-09-19T09:06:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 -- 172.21.15.1:0/3902332164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 msgr2=0x7f25fc1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 --2- 172.21.15.1:0/3902332164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 0x7f25fc1020b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009900 tx=0x7f25f002a410 comp rx=0 tx=0).stop 2024-09-19T09:06:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 -- 172.21.15.1:0/3902332164 shutdown_connections 2024-09-19T09:06:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 --2- 172.21.15.1:0/3902332164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25fc1025f0 0x7f25fc108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 --2- 172.21.15.1:0/3902332164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 0x7f25fc1020b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 --2- 172.21.15.1:0/3902332164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25fc100a40 0x7f25fc100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 -- 172.21.15.1:0/3902332164 >> 172.21.15.1:0/3902332164 conn(0x7f25fc0fc1c0 msgr2=0x7f25fc0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 -- 172.21.15.1:0/3902332164 shutdown_connections 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 -- 172.21.15.1:0/3902332164 wait complete. 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 Processor -- start 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.972+0000 7f2601b31640 1 -- start start 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f2601b31640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25fc100a40 0x7f25fc198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f2601b31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 0x7f25fc198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f2601b31640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25fc1025f0 0x7f25fc19f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f2601b31640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10c820 con 0x7f25fc101c30 2024-09-19T09:06:29.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f2601b31640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10c6a0 con 0x7f25fc100a40 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f2601b31640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc10c9a0 con 0x7f25fc1025f0 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 0x7f25fc198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 0x7f25fc198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39222/0 (socket says 172.21.15.1:39222) 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 -- 172.21.15.1:0/51533985 learned_addr learned my addr 172.21.15.1:0/51533985 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25fc100a40 0x7f25fc198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25fbfff640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25fc1025f0 0x7f25fc19f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 -- 172.21.15.1:0/51533985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25fc1025f0 msgr2=0x7f25fc19f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25fc1025f0 0x7f25fc19f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 -- 172.21.15.1:0/51533985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25fc100a40 msgr2=0x7f25fc198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25fc100a40 0x7f25fc198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 -- 172.21.15.1:0/51533985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc19fc30 con 0x7f25fc101c30 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25faffd640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 0x7f25fc198550 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f25f00315e0 tx=0x7f25f0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.973+0000 7f25f8ff9640 1 -- 172.21.15.1:0/51533985 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f003f030 con 0x7f25fc101c30 2024-09-19T09:06:29.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.974+0000 7f25f8ff9640 1 -- 172.21.15.1:0/51533985 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25f0003d00 con 0x7f25fc101c30 2024-09-19T09:06:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.974+0000 7f2601b31640 1 -- 172.21.15.1:0/51533985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc19fec0 con 0x7f25fc101c30 2024-09-19T09:06:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.974+0000 7f25f8ff9640 1 -- 172.21.15.1:0/51533985 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0035070 con 0x7f25fc101c30 2024-09-19T09:06:29.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.974+0000 7f2601b31640 1 -- 172.21.15.1:0/51533985 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc1a0330 con 0x7f25fc101c30 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f25f8ff9640 1 -- 172.21.15.1:0/51533985 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f25f0042030 con 0x7f25fc101c30 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f26048d1740 1 Processor -- start 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f26048d1740 1 -- start start 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f26048d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a1871b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f26048d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a1876f0 0x558b4a18c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f26048d1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a18c780 0x558b4a18ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f26048d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558b4a0e62f0 con 0x558b4a186db0 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f26048d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558b4a08e270 con 0x558b4a1876f0 2024-09-19T09:06:29.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.976+0000 7f26048d1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558b4a0e22b0 con 0x558b4a18c780 2024-09-19T09:06:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a1871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a1871b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39234/0 (socket says 172.21.15.1:39234) 2024-09-19T09:06:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 -- 172.21.15.1:0/2761372568 learned_addr learned my addr 172.21.15.1:0/2761372568 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25f8ff9640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25e40a32c0 0x7f25e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25faffd640 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a18c780 0x558b4a18ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a1876f0 0x558b4a18c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25e40a32c0 0x7f25e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25f8ff9640 1 -- 172.21.15.1:0/51533985 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f25f00efe70 con 0x7f25fc101c30 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 -- 172.21.15.1:0/2761372568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a18c780 msgr2=0x558b4a18ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a18c780 0x558b4a18ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 -- 172.21.15.1:0/2761372568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a1876f0 msgr2=0x558b4a18c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a1876f0 0x558b4a18c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 -- 172.21.15.1:0/2761372568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b4a08d340 con 0x558b4a186db0 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a1876f0 0x558b4a18c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25faffd640 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a18c780 0x558b4a18ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25fbfff640 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a1871b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f25f4005f40 tx=0x7f25f4014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89a18db97463c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25e1ffb640 1 -- 172.21.15.1:0/2761372568 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4012d90 con 0x558b4a186db0 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25e1ffb640 1 -- 172.21.15.1:0/2761372568 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25f4023070 con 0x558b4a186db0 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.977+0000 7f25e1ffb640 1 -- 172.21.15.1:0/2761372568 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4005770 con 0x558b4a186db0 2024-09-19T09:06:29.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 -- 172.21.15.1:0/2761372568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 msgr2=0x558b4a1871b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f25fbfff640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25e40a32c0 0x7f25e40a5780 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f25f4022000 tx=0x7f25f4020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a1871b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f25f4005f40 tx=0x7f25f4014f70 comp rx=0 tx=0).stop 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 -- 172.21.15.1:0/2761372568 shutdown_connections 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a18c780 0x558b4a18ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a1876f0 0x558b4a18c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 --2- 172.21.15.1:0/2761372568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a1871b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 -- 172.21.15.1:0/2761372568 >> 172.21.15.1:0/2761372568 conn(0x558b4a17e010 msgr2=0x558b4a17e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 -- 172.21.15.1:0/2761372568 shutdown_connections 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 -- 172.21.15.1:0/2761372568 wait complete. 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.978+0000 7f26048d1740 1 -- start start 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f26048d1740 1 Processor -- start 2024-09-19T09:06:29.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f26048d1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 0x558b4a191060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f26048d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a1915a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f26048d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f26048d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558b4a18f750 con 0x558b4a1876f0 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f26048d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558b4a06f290 con 0x558b4a18c780 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f26048d1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558b4a18f8d0 con 0x558b4a186db0 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f26048d1740 10 client.0 _ll_register_callbacks cb 0x558b4a0a0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a1915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a1915a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39242/0 (socket says 172.21.15.1:39242) 2024-09-19T09:06:29.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 -- 172.21.15.1:0/2932800795 learned_addr learned my addr 172.21.15.1:0/2932800795 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25fbfff640 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 -- 172.21.15.1:0/2932800795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 msgr2=0x558b4a191060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 0x558b4a191060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 -- 172.21.15.1:0/2932800795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 msgr2=0x558b4a1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 -- 172.21.15.1:0/2932800795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b49df9210 con 0x558b4a1876f0 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25faffd640 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a1915a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f25f0005c20 tx=0x7f25f008b200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a565d6be6c56456a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.979+0000 7f25daffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f25daffd640 1 -- 172.21.15.1:0/2932800795 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0049040 con 0x558b4a1876f0 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f25daffd640 1 -- 172.21.15.1:0/2932800795 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f25f003b660 con 0x558b4a1876f0 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 1 -- 172.21.15.1:0/2932800795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f4023070 con 0x558b4a1876f0 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f25daffd640 1 -- 172.21.15.1:0/2932800795 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f25f00bbe20 con 0x558b4a1876f0 2024-09-19T09:06:29.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 10 client.16170 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 1 -- 172.21.15.1:0/2932800795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558b49ec5620 con 0x558b4a1876f0 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f25daffd640 1 -- 172.21.15.1:0/2932800795 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25f4023070 con 0x558b4a1876f0 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f25daffd640 1 -- 172.21.15.1:0/2932800795 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f25f0036260 con 0x558b4a1876f0 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 10 client.16170 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 10 client.16170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 20 client.16170 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b4a19cce0 0x558b4a19f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 4 client.16170 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f26048d1740 1 -- 172.21.15.1:0/2932800795 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b4a0f3a20 con 0x558b4a19cce0 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.980+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b4a19cce0 0x558b4a19f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.981+0000 7f25daffd640 10 client.16170 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.981+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b4a19cce0 0x558b4a19f140 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a166e795d0432476 server_cookie=35f2414b0f70fb50 in_seq=0 out_seq=0 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f25daffd640 1 -- 172.21.15.1:0/2932800795 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b4a0f3a20 con 0x558b4a19cce0 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f25daffd640 10 client.16170 handle_command_reply: tid=0 2024-09-19T09:06:29.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 client.16170 shutdown 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 -- 172.21.15.1:0/2932800795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 msgr2=0x558b4a1915a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a1915a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f25f0005c20 tx=0x7f25f008b200 comp rx=0 tx=0).stop 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 -- 172.21.15.1:0/2932800795 shutdown_connections 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b4a19cce0 0x558b4a19f140 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a1915a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 --2- 172.21.15.1:0/2932800795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 0x558b4a191060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f25daffd640 0 client.16170 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 -- 172.21.15.1:0/2932800795 >> 172.21.15.1:0/2932800795 conn(0x558b4a17e010 msgr2=0x558b4a17f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 -- 172.21.15.1:0/2932800795 shutdown_connections 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 1 -- 172.21.15.1:0/2932800795 wait complete. 2024-09-19T09:06:29.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.982+0000 7f26048d1740 20 client.16170 trim_cache size 0 max 16384 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.996+0000 7f26048d1740 1 Processor -- start 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.996+0000 7f26048d1740 1 -- start start 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f26048d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a17eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f26048d1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a1876f0 0x558b4a1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f26048d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a17f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f26048d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc1a9840 con 0x558b4a186db0 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f26048d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc1a7110 con 0x558b4a18c780 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f26048d1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc1a4f60 con 0x558b4a1876f0 2024-09-19T09:06:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a17eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a17eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39256/0 (socket says 172.21.15.1:39256) 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 -- 172.21.15.1:0/1229564813 learned_addr learned my addr 172.21.15.1:0/1229564813 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fbfff640 1 --2- 172.21.15.1:0/1229564813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a17f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 -- 172.21.15.1:0/1229564813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a1876f0 msgr2=0x558b4a1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/1229564813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a1876f0 0x558b4a1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 -- 172.21.15.1:0/1229564813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 msgr2=0x558b4a17f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/1229564813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a17f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 -- 172.21.15.1:0/1229564813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b4a19f720 con 0x558b4a186db0 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/1229564813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a17eec0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x558b4a188120 tx=0x7f25ec005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1fa215bb19a014 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25e17fa640 1 -- 172.21.15.1:0/1229564813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec01e030 con 0x558b4a186db0 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25e17fa640 1 -- 172.21.15.1:0/1229564813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25ec005520 con 0x558b4a186db0 2024-09-19T09:06:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.997+0000 7f25e17fa640 1 -- 172.21.15.1:0/1229564813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec01a520 con 0x558b4a186db0 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 -- 172.21.15.1:0/1229564813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 msgr2=0x558b4a17eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 --2- 172.21.15.1:0/1229564813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a17eec0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x558b4a188120 tx=0x7f25ec005d10 comp rx=0 tx=0).stop 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 -- 172.21.15.1:0/1229564813 shutdown_connections 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 --2- 172.21.15.1:0/1229564813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a17f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 --2- 172.21.15.1:0/1229564813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a1876f0 0x558b4a1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 --2- 172.21.15.1:0/1229564813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a186db0 0x558b4a17eec0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 -- 172.21.15.1:0/1229564813 >> 172.21.15.1:0/1229564813 conn(0x558b4a17e010 msgr2=0x558b4a188930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 -- 172.21.15.1:0/1229564813 shutdown_connections 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 -- 172.21.15.1:0/1229564813 wait complete. 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 -- start start 2024-09-19T09:06:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.998+0000 7f26048d1740 1 Processor -- start 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f26048d1740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 0x558b4a195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f26048d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a196220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f26048d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f26048d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc1a55d0 con 0x558b4a1876f0 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f26048d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc1a6a40 con 0x558b4a18c780 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f26048d1740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc1a5ca0 con 0x558b4a186db0 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f26048d1740 10 client.0 _ll_register_callbacks cb 0x7f25f0005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a196220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39270/0 (socket says 172.21.15.1:39270) 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 -- 172.21.15.1:0/171362277 learned_addr learned my addr 172.21.15.1:0/171362277 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 0x558b4a195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25fbfff640 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 -- 172.21.15.1:0/171362277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 msgr2=0x558b4a195ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 0x558b4a195ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 -- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 msgr2=0x558b4a1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 -- 172.21.15.1:0/171362277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b4a1977f0 con 0x558b4a1876f0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25fbfff640 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25faffd640 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a196220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f25f003d040 tx=0x7f25f003ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3378b619a64e9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25daffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25daffd640 1 -- 172.21.15.1:0/171362277 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0049070 con 0x558b4a1876f0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f25daffd640 1 -- 172.21.15.1:0/171362277 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f25f00c4bf0 con 0x558b4a1876f0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:29.999+0000 7f26048d1740 1 -- 172.21.15.1:0/171362277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25ec005520 con 0x558b4a1876f0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f25daffd640 1 -- 172.21.15.1:0/171362277 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f25f00c0810 con 0x558b4a1876f0 2024-09-19T09:06:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f26048d1740 10 client.16176 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f26048d1740 1 -- 172.21.15.1:0/171362277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558b4a2079e0 con 0x558b4a1876f0 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f25daffd640 1 -- 172.21.15.1:0/171362277 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25ec005520 con 0x558b4a1876f0 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f25daffd640 1 -- 172.21.15.1:0/171362277 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f25f00d5200 con 0x558b4a1876f0 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f26048d1740 10 client.16176 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f26048d1740 10 client.16176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f26048d1740 20 client.16176 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f26048d1740 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b4a207fd0 0x558b4a20a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f26048d1740 4 client.16176 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f26048d1740 1 -- 172.21.15.1:0/171362277 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558b4a0edd70 con 0x558b4a207fd0 2024-09-19T09:06:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.000+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b4a207fd0 0x558b4a20a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.001+0000 7f25daffd640 10 client.16176 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.001+0000 7f25fb7fe640 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b4a207fd0 0x558b4a20a3f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4fb6f4e3aa6c326 server_cookie=144f83970f52a522 in_seq=0 out_seq=0 2024-09-19T09:06:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f25daffd640 1 -- 172.21.15.1:0/171362277 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558b4a0edd70 con 0x558b4a207fd0 2024-09-19T09:06:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f25daffd640 10 client.16176 handle_command_reply: tid=0 2024-09-19T09:06:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 client.16176 shutdown 2024-09-19T09:06:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 -- 172.21.15.1:0/171362277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 msgr2=0x558b4a196220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a196220 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f25f003d040 tx=0x7f25f003ba00 comp rx=0 tx=0).stop 2024-09-19T09:06:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 -- 172.21.15.1:0/171362277 shutdown_connections 2024-09-19T09:06:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b4a207fd0 0x558b4a20a3f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b4a18c780 0x558b4a1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b4a1876f0 0x558b4a196220 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 --2- 172.21.15.1:0/171362277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b4a186db0 0x558b4a195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f25daffd640 0 client.16176 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 -- 172.21.15.1:0/171362277 >> 172.21.15.1:0/171362277 conn(0x558b4a17e010 msgr2=0x558b4a17c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 -- 172.21.15.1:0/171362277 shutdown_connections 2024-09-19T09:06:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 1 -- 172.21.15.1:0/171362277 wait complete. 2024-09-19T09:06:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.008+0000 7f26048d1740 20 client.16176 trim_cache size 0 max 16384 2024-09-19T09:06:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:06:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:06:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:06:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:06:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 -- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25e40a32c0 msgr2=0x7f25e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25e40a32c0 0x7f25e40a5780 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f25f4022000 tx=0x7f25f4020000 comp rx=0 tx=0).stop 2024-09-19T09:06:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 -- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 msgr2=0x7f25fc198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 0x7f25fc198550 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f25f00315e0 tx=0x7f25f0004430 comp rx=0 tx=0).stop 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 -- 172.21.15.1:0/51533985 shutdown_connections 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25e40a32c0 0x7f25e40a5780 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25fc1025f0 0x7f25fc19f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25fc101c30 0x7f25fc198550 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 --2- 172.21.15.1:0/51533985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25fc100a40 0x7f25fc198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 -- 172.21.15.1:0/51533985 >> 172.21.15.1:0/51533985 conn(0x7f25fc0fc1c0 msgr2=0x7f25fc069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 -- 172.21.15.1:0/51533985 shutdown_connections 2024-09-19T09:06:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:30.009+0000 7f2601b31640 1 -- 172.21.15.1:0/51533985 wait complete. 2024-09-19T09:06:30.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.277+0000 7fa8249f5640 1 -- 172.21.15.1:0/629153306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82010c180 msgr2=0x7fa82010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.277+0000 7fa8249f5640 1 --2- 172.21.15.1:0/629153306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82010c180 0x7fa82010e610 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa818009ca0 tx=0x7fa81802a950 comp rx=0 tx=0).stop 2024-09-19T09:06:30.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 -- 172.21.15.1:0/629153306 shutdown_connections 2024-09-19T09:06:30.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 --2- 172.21.15.1:0/629153306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa82010c180 0x7fa82010e610 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 --2- 172.21.15.1:0/629153306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa820103700 0x7fa82010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 --2- 172.21.15.1:0/629153306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa820102de0 0x7fa8201031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 -- 172.21.15.1:0/629153306 >> 172.21.15.1:0/629153306 conn(0x7fa8200fc7a0 msgr2=0x7fa8200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 -- 172.21.15.1:0/629153306 shutdown_connections 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 -- 172.21.15.1:0/629153306 wait complete. 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 Processor -- start 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.278+0000 7fa8249f5640 1 -- start start 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa8249f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa820102de0 0x7fa820198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa8249f5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa820103700 0x7fa820198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa8249f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa82010c180 0x7fa82019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa8249f5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa820112070 con 0x7fa820102de0 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa8249f5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa820111ef0 con 0x7fa82010c180 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa8249f5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201121f0 con 0x7fa820103700 2024-09-19T09:06:30.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa820102de0 0x7fa820198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa820102de0 0x7fa820198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39280/0 (socket says 172.21.15.1:39280) 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 -- 172.21.15.1:0/2482749875 learned_addr learned my addr 172.21.15.1:0/2482749875 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81ed9d640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa82010c180 0x7fa82019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa820103700 0x7fa820198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 -- 172.21.15.1:0/2482749875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa820103700 msgr2=0x7fa820198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa820103700 0x7fa820198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 -- 172.21.15.1:0/2482749875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa82010c180 msgr2=0x7fa82019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa82010c180 0x7fa82019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 -- 172.21.15.1:0/2482749875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82019d4c0 con 0x7fa820102de0 2024-09-19T09:06:30.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.279+0000 7fa81e59c640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa820102de0 0x7fa820198510 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa81000ea60 tx=0x7fa81000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.280+0000 7fa80f7fe640 1 -- 172.21.15.1:0/2482749875 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81000cde0 con 0x7fa820102de0 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.280+0000 7fa8249f5640 1 -- 172.21.15.1:0/2482749875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82019d7b0 con 0x7fa820102de0 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.280+0000 7fa80f7fe640 1 -- 172.21.15.1:0/2482749875 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8100035f0 con 0x7fa820102de0 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.280+0000 7fa80f7fe640 1 -- 172.21.15.1:0/2482749875 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810010720 con 0x7fa820102de0 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.280+0000 7fa8249f5640 1 -- 172.21.15.1:0/2482749875 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8201a5090 con 0x7fa820102de0 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.282+0000 7fa80f7fe640 1 -- 172.21.15.1:0/2482749875 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fa8100037a0 con 0x7fa820102de0 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.282+0000 7fa826dce740 1 Processor -- start 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.282+0000 7fa826dce740 1 -- start start 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa826dce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f75090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa826dce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f755d0 0x562a07f75a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa826dce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f82760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa826dce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562a07edb2f0 con 0x562a07f76b40 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa826dce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a07e82cf0 con 0x562a07f755d0 2024-09-19T09:06:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa826dce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562a07ed72b0 con 0x562a07f80370 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f75090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f755d0 0x562a07f75a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f75090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39286/0 (socket says 172.21.15.1:39286) 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 -- 172.21.15.1:0/154418509 learned_addr learned my addr 172.21.15.1:0/154418509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f755d0 0x562a07f75a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:33724/0 (socket says 172.21.15.1:33724) 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/154418509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f82760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa80f7fe640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8080a3240 0x7fa8080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 -- 172.21.15.1:0/154418509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 msgr2=0x562a07f82760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 --2- 172.21.15.1:0/154418509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f82760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 -- 172.21.15.1:0/154418509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f755d0 msgr2=0x562a07f75a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 --2- 172.21.15.1:0/154418509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f755d0 0x562a07f75a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 -- 172.21.15.1:0/154418509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a07e673a0 con 0x562a07f76b40 2024-09-19T09:06:30.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa80f7fe640 1 -- 172.21.15.1:0/2482749875 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa8100cfd10 con 0x7fa820102de0 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.283+0000 7fa81ed9d640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8080a3240 0x7fa8080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.284+0000 7fa81ed9d640 1 --2- 172.21.15.1:0/154418509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f75090 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa8180098d0 tx=0x7fa818009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bc23db04bd2e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.284+0000 7fa80cff9640 1 -- 172.21.15.1:0/154418509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818034040 con 0x562a07f76b40 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.284+0000 7fa81ed9d640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8080a3240 0x7fa8080a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa81804d000 tx=0x7fa81804a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.284+0000 7fa80cff9640 1 -- 172.21.15.1:0/154418509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa818003c30 con 0x562a07f76b40 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.284+0000 7fa80cff9640 1 -- 172.21.15.1:0/154418509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8180467d0 con 0x562a07f76b40 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 -- 172.21.15.1:0/154418509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 msgr2=0x562a07f75090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 --2- 172.21.15.1:0/154418509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f75090 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa8180098d0 tx=0x7fa818009900 comp rx=0 tx=0).stop 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 -- 172.21.15.1:0/154418509 shutdown_connections 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 --2- 172.21.15.1:0/154418509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f82760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 --2- 172.21.15.1:0/154418509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f755d0 0x562a07f75a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 --2- 172.21.15.1:0/154418509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f75090 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 -- 172.21.15.1:0/154418509 >> 172.21.15.1:0/154418509 conn(0x562a07f3e310 msgr2=0x562a07f71c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 -- 172.21.15.1:0/154418509 shutdown_connections 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 -- 172.21.15.1:0/154418509 wait complete. 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 -- start start 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.285+0000 7fa826dce740 1 Processor -- start 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa826dce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f7fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa826dce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f7d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa826dce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f7d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa826dce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562a07f83070 con 0x562a07f755d0 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa826dce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a07e96060 con 0x562a07f76b40 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa826dce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562a07f831f0 con 0x562a07f80370 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa826dce740 10 client.0 _ll_register_callbacks cb 0x562a07be98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f7fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f7fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39292/0 (socket says 172.21.15.1:39292) 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 -- 172.21.15.1:0/1481266405 learned_addr learned my addr 172.21.15.1:0/1481266405 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f7d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81ed9d640 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f7d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 -- 172.21.15.1:0/1481266405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 msgr2=0x562a07f7d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f7d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 -- 172.21.15.1:0/1481266405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 msgr2=0x562a07f7d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f7d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 -- 172.21.15.1:0/1481266405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a07c4c3c0 con 0x562a07f755d0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa81e59c640 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f7fd90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa81000d010 tx=0x7fa8100d34e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375cfa6b950621a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa805ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa805ffb640 1 -- 172.21.15.1:0/1481266405 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810003bc0 con 0x562a07f755d0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.286+0000 7fa805ffb640 1 -- 172.21.15.1:0/1481266405 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa8100c3b90 con 0x562a07f755d0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 1 -- 172.21.15.1:0/1481266405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa818003c30 con 0x562a07f755d0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa805ffb640 1 -- 172.21.15.1:0/1481266405 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa81009ca10 con 0x562a07f755d0 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 10 client.16188 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 1 -- 172.21.15.1:0/1481266405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562a07f8ebf0 con 0x562a07f755d0 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa805ffb640 1 -- 172.21.15.1:0/1481266405 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa818003c30 con 0x562a07f755d0 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa805ffb640 1 -- 172.21.15.1:0/1481266405 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa8100b5170 con 0x562a07f755d0 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 10 client.16188 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 20 client.16188 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562a07f900b0 0x562a07f924a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 4 client.16188 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa826dce740 1 -- 172.21.15.1:0/1481266405 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a07ee8860 con 0x562a07f900b0 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.287+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562a07f900b0 0x562a07f924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.288+0000 7fa805ffb640 10 client.16188 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:30.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.288+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562a07f900b0 0x562a07f924a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46ac6317248ab8bd server_cookie=94759d34197370db in_seq=0 out_seq=0 2024-09-19T09:06:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.288+0000 7fa805ffb640 1 -- 172.21.15.1:0/1481266405 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a07ee8860 con 0x562a07f900b0 2024-09-19T09:06:30.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.288+0000 7fa805ffb640 10 client.16188 handle_command_reply: tid=0 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.288+0000 7fa826dce740 1 client.16188 shutdown 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 -- 172.21.15.1:0/1481266405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 msgr2=0x562a07f7fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f7fd90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa81000d010 tx=0x7fa8100d34e0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 -- 172.21.15.1:0/1481266405 shutdown_connections 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562a07f900b0 0x562a07f924a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f7d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f7d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 --2- 172.21.15.1:0/1481266405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f7fd90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 -- 172.21.15.1:0/1481266405 >> 172.21.15.1:0/1481266405 conn(0x562a07f3e310 msgr2=0x562a07f77960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa805ffb640 0 client.16188 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 -- 172.21.15.1:0/1481266405 shutdown_connections 2024-09-19T09:06:30.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 1 -- 172.21.15.1:0/1481266405 wait complete. 2024-09-19T09:06:30.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.289+0000 7fa826dce740 20 client.16188 trim_cache size 0 max 16384 2024-09-19T09:06:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa826dce740 1 Processor -- start 2024-09-19T09:06:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa826dce740 1 -- start start 2024-09-19T09:06:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa826dce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f70c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa826dce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f71150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa826dce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f78120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa826dce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201b2170 con 0x562a07f755d0 2024-09-19T09:06:30.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa826dce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201afa40 con 0x562a07f76b40 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa826dce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201ad890 con 0x562a07f80370 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa81e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f70c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa81e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f70c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39296/0 (socket says 172.21.15.1:39296) 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.302+0000 7fa81e59c640 1 -- 172.21.15.1:0/4069578222 learned_addr learned my addr 172.21.15.1:0/4069578222 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f71150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa81e59c640 1 -- 172.21.15.1:0/4069578222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 msgr2=0x562a07f78120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa81e59c640 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f78120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa81e59c640 1 -- 172.21.15.1:0/4069578222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 msgr2=0x562a07f71150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa81e59c640 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f71150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa81e59c640 1 -- 172.21.15.1:0/4069578222 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a07f7dfe0 con 0x562a07f755d0 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f71150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa81e59c640 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f70c10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa810098ce0 tx=0x7fa810097f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68e57811bf01d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa807fff640 1 -- 172.21.15.1:0/4069578222 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81009c0e0 con 0x562a07f755d0 2024-09-19T09:06:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa807fff640 1 -- 172.21.15.1:0/4069578222 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa810003bc0 con 0x562a07f755d0 2024-09-19T09:06:30.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.303+0000 7fa807fff640 1 -- 172.21.15.1:0/4069578222 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8100040f0 con 0x562a07f755d0 2024-09-19T09:06:30.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 -- 172.21.15.1:0/4069578222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 msgr2=0x562a07f70c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f70c10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa810098ce0 tx=0x7fa810097f80 comp rx=0 tx=0).stop 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 -- 172.21.15.1:0/4069578222 shutdown_connections 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f80370 0x562a07f78120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f76b40 0x562a07f71150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 --2- 172.21.15.1:0/4069578222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f755d0 0x562a07f70c10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 -- 172.21.15.1:0/4069578222 >> 172.21.15.1:0/4069578222 conn(0x562a07f3e310 msgr2=0x562a07f70500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 -- 172.21.15.1:0/4069578222 shutdown_connections 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 -- 172.21.15.1:0/4069578222 wait complete. 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 -- start start 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.304+0000 7fa826dce740 1 Processor -- start 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa826dce740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f755d0 0x562a07f889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa826dce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f83ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa826dce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f80370 0x562a07f84220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa826dce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201adf00 con 0x562a07f76b40 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa826dce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201af370 con 0x562a07f80370 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa826dce740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201ae5d0 con 0x562a07f755d0 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa826dce740 10 client.0 _ll_register_callbacks cb 0x7fa8100baf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f83ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f83ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39308/0 (socket says 172.21.15.1:39308) 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 -- 172.21.15.1:0/784657235 learned_addr learned my addr 172.21.15.1:0/784657235 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81ed9d640 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f80370 0x562a07f84220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81e59c640 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f755d0 0x562a07f889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 -- 172.21.15.1:0/784657235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f755d0 msgr2=0x562a07f889b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f755d0 0x562a07f889b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 -- 172.21.15.1:0/784657235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f80370 msgr2=0x562a07f84220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f80370 0x562a07f84220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 -- 172.21.15.1:0/784657235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a07f84810 con 0x562a07f76b40 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81e59c640 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f755d0 0x562a07f889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa81dd9b640 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f83ce0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x562a07f7c8d0 tx=0x7fa814004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12034110df67261 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.305+0000 7fa805ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa805ffb640 1 -- 172.21.15.1:0/784657235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814027430 con 0x562a07f76b40 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 1 -- 172.21.15.1:0/784657235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562a07ee2d70 con 0x562a07f76b40 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa805ffb640 1 -- 172.21.15.1:0/784657235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa8140275d0 con 0x562a07f76b40 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa805ffb640 1 -- 172.21.15.1:0/784657235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa8140277f0 con 0x562a07f76b40 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 10 client.16194 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 1 -- 172.21.15.1:0/784657235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562a07ffaae0 con 0x562a07f76b40 2024-09-19T09:06:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa805ffb640 1 -- 172.21.15.1:0/784657235 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x562a07ee2d70 con 0x562a07f76b40 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa805ffb640 1 -- 172.21.15.1:0/784657235 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa814010af0 con 0x562a07f76b40 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 10 client.16194 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 10 client.16194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 20 client.16194 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562a07ffb240 0x562a07ffd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 4 client.16194 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa826dce740 1 -- 172.21.15.1:0/784657235 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562a07e5f170 con 0x562a07ffb240 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.306+0000 7fa81e59c640 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562a07ffb240 0x562a07ffd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa81e59c640 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562a07ffb240 0x562a07ffd660 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ce89d1863a2587b server_cookie=802d4c923b492739 in_seq=0 out_seq=0 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa805ffb640 10 client.16194 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa805ffb640 1 -- 172.21.15.1:0/784657235 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562a07e5f170 con 0x562a07ffb240 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa805ffb640 10 client.16194 handle_command_reply: tid=0 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 client.16194 shutdown 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 -- 172.21.15.1:0/784657235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 msgr2=0x562a07f83ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f83ce0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x562a07f7c8d0 tx=0x7fa814004410 comp rx=0 tx=0).stop 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 -- 172.21.15.1:0/784657235 shutdown_connections 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562a07ffb240 0x562a07ffd660 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a07f80370 0x562a07f84220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562a07f76b40 0x562a07f83ce0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa805ffb640 0 client.16194 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 --2- 172.21.15.1:0/784657235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562a07f755d0 0x562a07f889b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 -- 172.21.15.1:0/784657235 >> 172.21.15.1:0/784657235 conn(0x562a07f3e310 msgr2=0x562a07f8b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 -- 172.21.15.1:0/784657235 shutdown_connections 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 1 -- 172.21.15.1:0/784657235 wait complete. 2024-09-19T09:06:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.307+0000 7fa826dce740 20 client.16194 trim_cache size 0 max 16384 2024-09-19T09:06:30.315 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:06:30.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 -- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8080a3240 msgr2=0x7fa8080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8080a3240 0x7fa8080a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa81804d000 tx=0x7fa81804a000 comp rx=0 tx=0).stop 2024-09-19T09:06:30.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 -- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa820102de0 msgr2=0x7fa820198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:30.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa820102de0 0x7fa820198510 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa81000ea60 tx=0x7fa81000ef20 comp rx=0 tx=0).stop 2024-09-19T09:06:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 -- 172.21.15.1:0/2482749875 shutdown_connections 2024-09-19T09:06:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa82010c180 0x7fa82019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8080a3240 0x7fa8080a5700 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa820103700 0x7fa820198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 --2- 172.21.15.1:0/2482749875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa820102de0 0x7fa820198510 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 -- 172.21.15.1:0/2482749875 >> 172.21.15.1:0/2482749875 conn(0x7fa8200fc7a0 msgr2=0x7fa8200fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 -- 172.21.15.1:0/2482749875 shutdown_connections 2024-09-19T09:06:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:30.308+0000 7fa8249f5640 1 -- 172.21.15.1:0/2482749875 wait complete. 2024-09-19T09:06:31.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:31 smithi064 ceph-mon[35179]: pgmap v410: 97 pgs: 97 active+clean; 65 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 MiB/s wr, 11 op/s 2024-09-19T09:06:31.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:31 smithi022 ceph-mon[35107]: pgmap v410: 97 pgs: 97 active+clean; 65 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 MiB/s wr, 11 op/s 2024-09-19T09:06:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:31 smithi001 ceph-mon[30939]: pgmap v410: 97 pgs: 97 active+clean; 65 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 MiB/s wr, 11 op/s 2024-09-19T09:06:32.143 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:06:32.144 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:06:32.416 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:32.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 -- 172.21.15.1:0/2615020770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc101de0 msgr2=0x7f9cbc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2615020770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc101de0 0x7f9cbc1021c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009900 tx=0x7f9cac02a410 comp rx=0 tx=0).stop 2024-09-19T09:06:32.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 -- 172.21.15.1:0/2615020770 shutdown_connections 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2615020770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cbc106f10 0x7f9cbc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2615020770 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cbc102790 0x7f9cbc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2615020770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc101de0 0x7f9cbc1021c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 -- 172.21.15.1:0/2615020770 >> 172.21.15.1:0/2615020770 conn(0x7f9cbc0fd8c0 msgr2=0x7f9cbc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 -- 172.21.15.1:0/2615020770 shutdown_connections 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.847+0000 7f9cc204e640 1 -- 172.21.15.1:0/2615020770 wait complete. 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cc204e640 1 Processor -- start 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cc204e640 1 -- start start 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cc204e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cbc101de0 0x7f9cbc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cc204e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc102790 0x7f9cbc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cc204e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cbc106f10 0x7f9cbc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cc204e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc112090 con 0x7f9cbc102790 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cc204e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc111f10 con 0x7f9cbc101de0 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cc204e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc112210 con 0x7f9cbc106f10 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cbaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc102790 0x7f9cbc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cbaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc102790 0x7f9cbc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37274/0 (socket says 172.21.15.1:37274) 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cbaffd640 1 -- 172.21.15.1:0/2423379569 learned_addr learned my addr 172.21.15.1:0/2423379569 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.848+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cbc101de0 0x7f9cbc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cbc106f10 0x7f9cbc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbaffd640 1 -- 172.21.15.1:0/2423379569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cbc106f10 msgr2=0x7f9cbc19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbaffd640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cbc106f10 0x7f9cbc19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbaffd640 1 -- 172.21.15.1:0/2423379569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cbc101de0 msgr2=0x7f9cbc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbaffd640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cbc101de0 0x7f9cbc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbaffd640 1 -- 172.21.15.1:0/2423379569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc19d440 con 0x7f9cbc102790 2024-09-19T09:06:32.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cbc101de0 0x7f9cbc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:32.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cbc106f10 0x7f9cbc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:32.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cbaffd640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc102790 0x7f9cbc1989d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000d770 tx=0x7f9cb000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:32.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cb8ff9640 1 -- 172.21.15.1:0/2423379569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0017070 con 0x7f9cbc102790 2024-09-19T09:06:32.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cb8ff9640 1 -- 172.21.15.1:0/2423379569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9cb0005520 con 0x7f9cbc102790 2024-09-19T09:06:32.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cc204e640 1 -- 172.21.15.1:0/2423379569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc19d730 con 0x7f9cbc102790 2024-09-19T09:06:32.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cb8ff9640 1 -- 172.21.15.1:0/2423379569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0010460 con 0x7f9cbc102790 2024-09-19T09:06:32.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.849+0000 7f9cc204e640 1 -- 172.21.15.1:0/2423379569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc1a5010 con 0x7f9cbc102790 2024-09-19T09:06:32.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.851+0000 7f9cb8ff9640 1 -- 172.21.15.1:0/2423379569 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f9cb0004ea0 con 0x7f9cbc102790 2024-09-19T09:06:32.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cc4427740 1 Processor -- start 2024-09-19T09:06:32.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cc4427740 1 -- start start 2024-09-19T09:06:32.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e068f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e076130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cc4427740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562d9dfce280 con 0x562d9e073d40 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cc4427740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562d9df75b10 con 0x562d9e068b60 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cc4427740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562d9dfca240 con 0x562d9e069480 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cbaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e076130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cbaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e076130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37282/0 (socket says 172.21.15.1:37282) 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cbaffd640 1 -- 172.21.15.1:0/3293141417 learned_addr learned my addr 172.21.15.1:0/3293141417 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cb8ff9640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9ca40a32c0 0x7f9ca40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.852+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9ca40a32c0 0x7f9ca40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cb8ff9640 1 -- 172.21.15.1:0/2423379569 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9cb00cf450 con 0x7f9cbc102790 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbaffd640 1 -- 172.21.15.1:0/3293141417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 msgr2=0x562d9e073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbaffd640 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbaffd640 1 -- 172.21.15.1:0/3293141417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 msgr2=0x562d9e068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbaffd640 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbaffd640 1 -- 172.21.15.1:0/3293141417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d9df821f0 con 0x562d9e073d40 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbaffd640 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e076130 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00a4190 tx=0x7f9cb0004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b904791ec8924e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9ca1ffb640 1 -- 172.21.15.1:0/3293141417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0020070 con 0x562d9e073d40 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9ca40a32c0 0x7f9ca40a5780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4005cc0 tx=0x7f9cb4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9ca1ffb640 1 -- 172.21.15.1:0/3293141417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9cb00d2b40 con 0x562d9e073d40 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.853+0000 7f9ca1ffb640 1 -- 172.21.15.1:0/3293141417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00d2d80 con 0x562d9e073d40 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 -- 172.21.15.1:0/3293141417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 msgr2=0x562d9e076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e076130 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00a4190 tx=0x7f9cb0004940 comp rx=0 tx=0).stop 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 -- 172.21.15.1:0/3293141417 shutdown_connections 2024-09-19T09:06:32.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e076130 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 --2- 172.21.15.1:0/3293141417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 -- 172.21.15.1:0/3293141417 >> 172.21.15.1:0/3293141417 conn(0x562d9e0650f0 msgr2=0x562d9e0654d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 -- 172.21.15.1:0/3293141417 shutdown_connections 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 -- 172.21.15.1:0/3293141417 wait complete. 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.854+0000 7f9cc4427740 1 -- start start 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cc4427740 1 Processor -- start 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e068b60 0x562d9e070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e069480 0x562d9e071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cc4427740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562d9e076910 con 0x562d9e073d40 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cc4427740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562d9df88f10 con 0x562d9e069480 2024-09-19T09:06:32.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cc4427740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562d9e076a90 con 0x562d9e068b60 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cc4427740 10 client.0 _ll_register_callbacks cb 0x562d9df51a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37284/0 (socket says 172.21.15.1:37284) 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbbfff640 1 -- 172.21.15.1:0/2869914584 learned_addr learned my addr 172.21.15.1:0/2869914584 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbaffd640 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e069480 0x562d9e071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e068b60 0x562d9e070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbbfff640 1 -- 172.21.15.1:0/2869914584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e068b60 msgr2=0x562d9e070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e068b60 0x562d9e070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbbfff640 1 -- 172.21.15.1:0/2869914584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e069480 msgr2=0x562d9e071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e069480 0x562d9e071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbbfff640 1 -- 172.21.15.1:0/2869914584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d9dd3f6a0 con 0x562d9e073d40 2024-09-19T09:06:32.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.855+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e068b60 0x562d9e070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e071690 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4011ee0 tx=0x7f9cb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4485ef9c5887a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9c9affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9c9affd640 1 -- 172.21.15.1:0/2869914584 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb401b050 con 0x562d9e073d40 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 1 -- 172.21.15.1:0/2869914584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d9dfdb7f0 con 0x562d9e073d40 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9c9affd640 1 -- 172.21.15.1:0/2869914584 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9cb4004b20 con 0x562d9e073d40 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9c9affd640 1 -- 172.21.15.1:0/2869914584 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9cb40144b0 con 0x562d9e073d40 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 10 client.16206 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 1 -- 172.21.15.1:0/2869914584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d9e0825c0 con 0x562d9e073d40 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9c9affd640 1 -- 172.21.15.1:0/2869914584 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x562d9dfdb7f0 con 0x562d9e073d40 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9c9affd640 1 -- 172.21.15.1:0/2869914584 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9cb4005020 con 0x562d9e073d40 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 10 client.16206 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 20 client.16206 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:32.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d9e0839d0 0x562d9e085e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 4 client.16206 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:32.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.856+0000 7f9cc4427740 1 -- 172.21.15.1:0/2869914584 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d9dfd5d00 con 0x562d9e0839d0 2024-09-19T09:06:32.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.857+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d9e0839d0 0x562d9e085e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.857+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d9e0839d0 0x562d9e085e50 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd792ea3e7e8caa9 server_cookie=8592c3ffb6babae9 in_seq=0 out_seq=0 2024-09-19T09:06:32.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.857+0000 7f9c9affd640 10 client.16206 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:32.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9c9affd640 1 -- 172.21.15.1:0/2869914584 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d9dfd5d00 con 0x562d9e0839d0 2024-09-19T09:06:32.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9c9affd640 10 client.16206 handle_command_reply: tid=0 2024-09-19T09:06:32.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 client.16206 shutdown 2024-09-19T09:06:32.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 -- 172.21.15.1:0/2869914584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 msgr2=0x562d9e071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e071690 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4011ee0 tx=0x7f9cb4004a40 comp rx=0 tx=0).stop 2024-09-19T09:06:32.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 -- 172.21.15.1:0/2869914584 shutdown_connections 2024-09-19T09:06:32.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d9e0839d0 0x562d9e085e50 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e071690 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e069480 0x562d9e071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 --2- 172.21.15.1:0/2869914584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e068b60 0x562d9e070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9cc4427740 1 -- 172.21.15.1:0/2869914584 >> 172.21.15.1:0/2869914584 conn(0x562d9e0650f0 msgr2=0x562d9e06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:32.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.858+0000 7f9c9affd640 0 client.16206 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:32.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.859+0000 7f9cc4427740 1 -- 172.21.15.1:0/2869914584 shutdown_connections 2024-09-19T09:06:32.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.859+0000 7f9cc4427740 1 -- 172.21.15.1:0/2869914584 wait complete. 2024-09-19T09:06:32.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.859+0000 7f9cc4427740 20 client.16206 trim_cache size 0 max 16384 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cc4427740 1 Processor -- start 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cc4427740 1 -- start start 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e068b60 0x562d9e06c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e06acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e073d40 0x562d9e08b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cc4427740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1ade30 con 0x562d9e068b60 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cc4427740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1ab700 con 0x562d9e073d40 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cc4427740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1a9550 con 0x562d9e069480 2024-09-19T09:06:32.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e068b60 0x562d9e06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e068b60 0x562d9e06c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37294/0 (socket says 172.21.15.1:37294) 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbb7fe640 1 -- 172.21.15.1:0/3492468756 learned_addr learned my addr 172.21.15.1:0/3492468756 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbaffd640 1 --2- 172.21.15.1:0/3492468756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e06acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbb7fe640 1 -- 172.21.15.1:0/3492468756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 msgr2=0x562d9e06acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/3492468756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e06acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbb7fe640 1 -- 172.21.15.1:0/3492468756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e073d40 msgr2=0x562d9e08b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/3492468756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e073d40 0x562d9e08b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.876+0000 7f9cbb7fe640 1 -- 172.21.15.1:0/3492468756 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d9e066260 con 0x562d9e068b60 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.877+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/3492468756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e068b60 0x562d9e06c380 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009900 tx=0x7f9cac009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57fa05da5f6ea7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.877+0000 7f9ca17fa640 1 -- 172.21.15.1:0/3492468756 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac035040 con 0x562d9e068b60 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.877+0000 7f9ca17fa640 1 -- 172.21.15.1:0/3492468756 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9cac005540 con 0x562d9e068b60 2024-09-19T09:06:32.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.877+0000 7f9ca17fa640 1 -- 172.21.15.1:0/3492468756 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac004920 con 0x562d9e068b60 2024-09-19T09:06:32.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.877+0000 7f9cc4427740 1 -- 172.21.15.1:0/3492468756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e068b60 msgr2=0x562d9e06c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.877+0000 7f9cc4427740 1 --2- 172.21.15.1:0/3492468756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e068b60 0x562d9e06c380 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009900 tx=0x7f9cac009560 comp rx=0 tx=0).stop 2024-09-19T09:06:32.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 -- 172.21.15.1:0/3492468756 shutdown_connections 2024-09-19T09:06:32.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 --2- 172.21.15.1:0/3492468756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e073d40 0x562d9e08b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 --2- 172.21.15.1:0/3492468756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e06acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 --2- 172.21.15.1:0/3492468756 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e068b60 0x562d9e06c380 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 -- 172.21.15.1:0/3492468756 >> 172.21.15.1:0/3492468756 conn(0x562d9e0650f0 msgr2=0x562d9e06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 -- 172.21.15.1:0/3492468756 shutdown_connections 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 -- 172.21.15.1:0/3492468756 wait complete. 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 -- start start 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 Processor -- start 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e077400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e077940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e0e6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1a9bc0 con 0x562d9e073d40 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1ab030 con 0x562d9e068b60 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc1aa290 con 0x562d9e069480 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.878+0000 7f9cc4427740 10 client.0 _ll_register_callbacks cb 0x7f9cb4011b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e0e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e0e6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37298/0 (socket says 172.21.15.1:37298) 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 -- 172.21.15.1:0/1613546947 learned_addr learned my addr 172.21.15.1:0/1613546947 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbaffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e077940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 -- 172.21.15.1:0/1613546947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 msgr2=0x562d9e077940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e077940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 -- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 msgr2=0x562d9e077400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e077400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 -- 172.21.15.1:0/1613546947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d9e0e6d40 con 0x562d9e073d40 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cbbfff640 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e0e6700 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40118d0 tx=0x7f9cb4008310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4604778e86a5a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9c9affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9c9affd640 1 -- 172.21.15.1:0/1613546947 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4005890 con 0x562d9e073d40 2024-09-19T09:06:32.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9c9affd640 1 -- 172.21.15.1:0/1613546947 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9cb4004b20 con 0x562d9e073d40 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.879+0000 7f9cc4427740 1 -- 172.21.15.1:0/1613546947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cac005540 con 0x562d9e073d40 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9c9affd640 1 -- 172.21.15.1:0/1613546947 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9cb4004d20 con 0x562d9e073d40 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cc4427740 10 client.16212 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cc4427740 1 -- 172.21.15.1:0/1613546947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d9e0ee130 con 0x562d9e073d40 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9c9affd640 1 -- 172.21.15.1:0/1613546947 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9cac005540 con 0x562d9e073d40 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9c9affd640 1 -- 172.21.15.1:0/1613546947 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9cb4040480 con 0x562d9e073d40 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cc4427740 10 client.16212 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cc4427740 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cc4427740 20 client.16212 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cc4427740 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d9e0ee850 0x562d9e0f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cc4427740 4 client.16212 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cc4427740 1 -- 172.21.15.1:0/1613546947 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562d9df52110 con 0x562d9e0ee850 2024-09-19T09:06:32.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.880+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d9e0ee850 0x562d9e0f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:32.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.881+0000 7f9cbb7fe640 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d9e0ee850 0x562d9e0f0c70 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f74ab94fb87150ec server_cookie=b82ce9bc3899d019 in_seq=0 out_seq=0 2024-09-19T09:06:32.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.881+0000 7f9c9affd640 10 client.16212 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:32.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9c9affd640 1 -- 172.21.15.1:0/1613546947 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562d9df52110 con 0x562d9e0ee850 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9c9affd640 10 client.16212 handle_command_reply: tid=0 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 client.16212 shutdown 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 -- 172.21.15.1:0/1613546947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 msgr2=0x562d9e0e6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e0e6700 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40118d0 tx=0x7f9cb4008310 comp rx=0 tx=0).stop 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 -- 172.21.15.1:0/1613546947 shutdown_connections 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d9e0ee850 0x562d9e0f0c70 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d9e073d40 0x562d9e0e6700 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d9e069480 0x562d9e077940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 --2- 172.21.15.1:0/1613546947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d9e068b60 0x562d9e077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9c9affd640 0 client.16212 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 -- 172.21.15.1:0/1613546947 >> 172.21.15.1:0/1613546947 conn(0x562d9e0650f0 msgr2=0x562d9e06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 -- 172.21.15.1:0/1613546947 shutdown_connections 2024-09-19T09:06:32.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 1 -- 172.21.15.1:0/1613546947 wait complete. 2024-09-19T09:06:32.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.882+0000 7f9cc4427740 20 client.16212 trim_cache size 0 max 16384 2024-09-19T09:06:32.888 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:06:32.888 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:06:32.888 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "add21bfc-3055-4afe-8627-66bf2e757d34", 2024-09-19T09:06:32.888 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:06:32.888 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 -- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9ca40a32c0 msgr2=0x7f9ca40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9ca40a32c0 0x7f9ca40a5780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4005cc0 tx=0x7f9cb4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 -- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc102790 msgr2=0x7f9cbc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc102790 0x7f9cbc1989d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000d770 tx=0x7f9cb000dc30 comp rx=0 tx=0).stop 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 -- 172.21.15.1:0/2423379569 shutdown_connections 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9ca40a32c0 0x7f9ca40a5780 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cbc106f10 0x7f9cbc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9cbc102790 0x7f9cbc1989d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 --2- 172.21.15.1:0/2423379569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cbc101de0 0x7f9cbc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:32.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 -- 172.21.15.1:0/2423379569 >> 172.21.15.1:0/2423379569 conn(0x7f9cbc0fd8c0 msgr2=0x7f9cbc0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:32.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 -- 172.21.15.1:0/2423379569 shutdown_connections 2024-09-19T09:06:32.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:32.883+0000 7f9cc204e640 1 -- 172.21.15.1:0/2423379569 wait complete. 2024-09-19T09:06:33.698 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:06:33.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:33 smithi001 ceph-mon[30939]: pgmap v411: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.4 MiB/s wr, 7 op/s 2024-09-19T09:06:33.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:33 smithi064 ceph-mon[35179]: pgmap v411: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.4 MiB/s wr, 7 op/s 2024-09-19T09:06:33.957 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:06:33.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:33 smithi022 ceph-mon[35107]: pgmap v411: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.4 MiB/s wr, 7 op/s 2024-09-19T09:06:34.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 -- 172.21.15.1:0/3861843456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 msgr2=0x7f4524100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 --2- 172.21.15.1:0/3861843456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 0x7f4524100d10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4514009900 tx=0x7f451402a410 comp rx=0 tx=0).stop 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 -- 172.21.15.1:0/3861843456 shutdown_connections 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 --2- 172.21.15.1:0/3861843456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452410e4e0 0x7f45241108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 --2- 172.21.15.1:0/3861843456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45241012e0 0x7f452410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 --2- 172.21.15.1:0/3861843456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 0x7f4524100d10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 -- 172.21.15.1:0/3861843456 >> 172.21.15.1:0/3861843456 conn(0x7f45240fc7a0 msgr2=0x7f45240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 -- 172.21.15.1:0/3861843456 shutdown_connections 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 -- 172.21.15.1:0/3861843456 wait complete. 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 Processor -- start 2024-09-19T09:06:34.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.403+0000 7f4529575640 1 -- start start 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4529575640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 0x7f45241a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4529575640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45241012e0 0x7f45241a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4529575640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452410e4e0 0x7f452419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4529575640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4524114310 con 0x7f4524100930 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4529575640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4524114190 con 0x7f45241012e0 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4529575640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4524114490 con 0x7f452410e4e0 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 0x7f45241a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 0x7f45241a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37316/0 (socket says 172.21.15.1:37316) 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 -- 172.21.15.1:0/4107369051 learned_addr learned my addr 172.21.15.1:0/4107369051 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f45227fc640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45241012e0 0x7f45241a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f45237fe640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452410e4e0 0x7f452419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 -- 172.21.15.1:0/4107369051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452410e4e0 msgr2=0x7f452419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452410e4e0 0x7f452419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 -- 172.21.15.1:0/4107369051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45241012e0 msgr2=0x7f45241a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45241012e0 0x7f45241a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 -- 172.21.15.1:0/4107369051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452419acf0 con 0x7f4524100930 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.404+0000 7f4522ffd640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 0x7f45241a0400 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4514006010 tx=0x7f45140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.405+0000 7f450bfff640 1 -- 172.21.15.1:0/4107369051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451403f030 con 0x7f4524100930 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.405+0000 7f4529575640 1 -- 172.21.15.1:0/4107369051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452419af80 con 0x7f4524100930 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.405+0000 7f450bfff640 1 -- 172.21.15.1:0/4107369051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4514003d00 con 0x7f4524100930 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.405+0000 7f450bfff640 1 -- 172.21.15.1:0/4107369051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514035070 con 0x7f4524100930 2024-09-19T09:06:34.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.405+0000 7f4529575640 1 -- 172.21.15.1:0/4107369051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45241a72d0 con 0x7f4524100930 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.407+0000 7f450bfff640 1 -- 172.21.15.1:0/4107369051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f4514042030 con 0x7f4524100930 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.407+0000 7f452b94e740 1 Processor -- start 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.407+0000 7f452b94e740 1 -- start start 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.407+0000 7f452b94e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b3724a0 0x564c9b372880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.407+0000 7f452b94e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b372dc0 0x564c9b37d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.407+0000 7f452b94e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b37fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f452b94e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564c9b2d82e0 con 0x564c9b37d680 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f452b94e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564c9b27fce0 con 0x564c9b3724a0 2024-09-19T09:06:34.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f452b94e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564c9b2d42a0 con 0x564c9b372dc0 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b37fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b37fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37322/0 (socket says 172.21.15.1:37322) 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 -- 172.21.15.1:0/1015470992 learned_addr learned my addr 172.21.15.1:0/1015470992 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45237fe640 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b3724a0 0x564c9b372880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f4522ffd640 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b372dc0 0x564c9b37d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 -- 172.21.15.1:0/1015470992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b372dc0 msgr2=0x564c9b37d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f450bfff640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f450c0a3240 0x7f450c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b372dc0 0x564c9b37d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 -- 172.21.15.1:0/1015470992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b3724a0 msgr2=0x564c9b372880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b3724a0 0x564c9b372880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 -- 172.21.15.1:0/1015470992 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c9b264440 con 0x564c9b37d680 2024-09-19T09:06:34.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f4522ffd640 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b372dc0 0x564c9b37d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45237fe640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f450c0a3240 0x7f450c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f450bfff640 1 -- 172.21.15.1:0/4107369051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f45140eff00 con 0x7f4524100930 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45227fc640 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b37fa70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f451800abb0 tx=0x7f451800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfec66daf2fa9e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.408+0000 7f45097fa640 1 -- 172.21.15.1:0/1015470992 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451801d070 con 0x564c9b37d680 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f45097fa640 1 -- 172.21.15.1:0/1015470992 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4518018b40 con 0x564c9b37d680 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f45097fa640 1 -- 172.21.15.1:0/1015470992 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518010be0 con 0x564c9b37d680 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 -- 172.21.15.1:0/1015470992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 msgr2=0x564c9b37fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f45237fe640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f450c0a3240 0x7f450c0a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4524102b10 tx=0x7f451c00c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b37fa70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f451800abb0 tx=0x7f451800f790 comp rx=0 tx=0).stop 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 -- 172.21.15.1:0/1015470992 shutdown_connections 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b37fa70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b372dc0 0x564c9b37d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 --2- 172.21.15.1:0/1015470992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b3724a0 0x564c9b372880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 -- 172.21.15.1:0/1015470992 >> 172.21.15.1:0/1015470992 conn(0x564c9b36ea30 msgr2=0x564c9b36ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 -- 172.21.15.1:0/1015470992 shutdown_connections 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.409+0000 7f452b94e740 1 -- 172.21.15.1:0/1015470992 wait complete. 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 1 -- start start 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 1 Processor -- start 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b37cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b37a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 0x564c9b37a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564c9b3802a0 con 0x564c9b3724a0 2024-09-19T09:06:34.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564c9b293050 con 0x564c9b372dc0 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564c9b380420 con 0x564c9b37d680 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f452b94e740 10 client.0 _ll_register_callbacks cb 0x564c9b2d3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f4522ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b37cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f4522ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b37cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37332/0 (socket says 172.21.15.1:37332) 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f4522ffd640 1 -- 172.21.15.1:0/573379909 learned_addr learned my addr 172.21.15.1:0/573379909 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f45227fc640 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b37a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f45237fe640 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 0x564c9b37a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.410+0000 7f4522ffd640 1 -- 172.21.15.1:0/573379909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 msgr2=0x564c9b37a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4522ffd640 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 0x564c9b37a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4522ffd640 1 -- 172.21.15.1:0/573379909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 msgr2=0x564c9b37a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4522ffd640 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b37a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4522ffd640 1 -- 172.21.15.1:0/573379909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c9b0493c0 con 0x564c9b3724a0 2024-09-19T09:06:34.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4522ffd640 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b37cfa0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4514005ab0 tx=0x7f4514003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b6a2a71409e0e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4506ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4506ff5640 1 -- 172.21.15.1:0/573379909 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514049030 con 0x564c9b3724a0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4506ff5640 1 -- 172.21.15.1:0/573379909 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f451403b4f0 con 0x564c9b3724a0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f452b94e740 1 -- 172.21.15.1:0/573379909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4518018b40 con 0x564c9b3724a0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4506ff5640 1 -- 172.21.15.1:0/573379909 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45140bbe60 con 0x564c9b3724a0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f452b94e740 10 client.16224 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f452b94e740 1 -- 172.21.15.1:0/573379909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564c9b38bb90 con 0x564c9b3724a0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.411+0000 7f4506ff5640 1 -- 172.21.15.1:0/573379909 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4518018b40 con 0x564c9b3724a0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f4506ff5640 1 -- 172.21.15.1:0/573379909 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45140e8110 con 0x564c9b3724a0 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f452b94e740 10 client.16224 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f452b94e740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f452b94e740 20 client.16224 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f452b94e740 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564c9b38cf80 0x564c9b38f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f452b94e740 4 client.16224 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:34.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f452b94e740 1 -- 172.21.15.1:0/573379909 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c9b2e5850 con 0x564c9b38cf80 2024-09-19T09:06:34.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f45227fc640 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564c9b38cf80 0x564c9b38f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f45227fc640 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564c9b38cf80 0x564c9b38f390 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=378a41d6cda8c96b server_cookie=5ee4f2659639ab6c in_seq=0 out_seq=0 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.412+0000 7f4506ff5640 10 client.16224 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f4506ff5640 1 -- 172.21.15.1:0/573379909 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c9b2e5850 con 0x564c9b38cf80 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f4506ff5640 10 client.16224 handle_command_reply: tid=0 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 client.16224 shutdown 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 -- 172.21.15.1:0/573379909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 msgr2=0x564c9b37cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b37cfa0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4514005ab0 tx=0x7f4514003f80 comp rx=0 tx=0).stop 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 -- 172.21.15.1:0/573379909 shutdown_connections 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564c9b38cf80 0x564c9b38f390 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 0x564c9b37a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b37a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 --2- 172.21.15.1:0/573379909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b37cfa0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f4506ff5640 0 client.16224 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:34.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 -- 172.21.15.1:0/573379909 >> 172.21.15.1:0/573379909 conn(0x564c9b36ea30 msgr2=0x564c9b374710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:34.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 -- 172.21.15.1:0/573379909 shutdown_connections 2024-09-19T09:06:34.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.413+0000 7f452b94e740 1 -- 172.21.15.1:0/573379909 wait complete. 2024-09-19T09:06:34.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.414+0000 7f452b94e740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f452b94e740 1 Processor -- start 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f452b94e740 1 -- start start 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f452b94e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b389500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f452b94e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3757f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f452b94e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 0x564c9b394ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f452b94e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f45241b2200 con 0x564c9b3724a0 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f452b94e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f45241afad0 con 0x564c9b372dc0 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f452b94e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f45241ad920 con 0x564c9b37d680 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b389500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b389500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37334/0 (socket says 172.21.15.1:37334) 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 -- 172.21.15.1:0/3536539774 learned_addr learned my addr 172.21.15.1:0/3536539774 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f45227fc640 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 -- 172.21.15.1:0/3536539774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 msgr2=0x564c9b394ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 0x564c9b394ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 -- 172.21.15.1:0/3536539774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 msgr2=0x564c9b3757f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3757f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 -- 172.21.15.1:0/3536539774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c9b3722d0 con 0x564c9b3724a0 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f45227fc640 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.431+0000 7f4522ffd640 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b389500 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f45140bc490 tx=0x7f45140baa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b28bcf55279b3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f4508ff9640 1 -- 172.21.15.1:0/3536539774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514049070 con 0x564c9b3724a0 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f4508ff9640 1 -- 172.21.15.1:0/3536539774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f451403be30 con 0x564c9b3724a0 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f4508ff9640 1 -- 172.21.15.1:0/3536539774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451403b6c0 con 0x564c9b3724a0 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 -- 172.21.15.1:0/3536539774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 msgr2=0x564c9b389500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b389500 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f45140bc490 tx=0x7f45140baa10 comp rx=0 tx=0).stop 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 -- 172.21.15.1:0/3536539774 shutdown_connections 2024-09-19T09:06:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b37d680 0x564c9b394ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 --2- 172.21.15.1:0/3536539774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b3724a0 0x564c9b389500 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 -- 172.21.15.1:0/3536539774 >> 172.21.15.1:0/3536539774 conn(0x564c9b36ea30 msgr2=0x564c9b3750e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:34.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 -- 172.21.15.1:0/3536539774 shutdown_connections 2024-09-19T09:06:34.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.432+0000 7f452b94e740 1 -- 172.21.15.1:0/3536539774 wait complete. 2024-09-19T09:06:34.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 1 -- start start 2024-09-19T09:06:34.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 1 Processor -- start 2024-09-19T09:06:34.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b3724a0 0x564c9b380db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3812f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b3efc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f45241adf90 con 0x564c9b37d680 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f45241af400 con 0x564c9b372dc0 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f45241ae660 con 0x564c9b3724a0 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f452b94e740 10 client.0 _ll_register_callbacks cb 0x7f4514046fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f45237fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b3efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f45237fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b3efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37350/0 (socket says 172.21.15.1:37350) 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f45237fe640 1 -- 172.21.15.1:0/165702951 learned_addr learned my addr 172.21.15.1:0/165702951 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f45227fc640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3812f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.433+0000 7f4522ffd640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b3724a0 0x564c9b380db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f45237fe640 1 -- 172.21.15.1:0/165702951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b3724a0 msgr2=0x564c9b380db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f45237fe640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b3724a0 0x564c9b380db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f45237fe640 1 -- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 msgr2=0x564c9b3812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f45237fe640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3812f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f45237fe640 1 -- 172.21.15.1:0/165702951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c9b3f02a0 con 0x564c9b37d680 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f4522ffd640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b3724a0 0x564c9b380db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f45227fc640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f45237fe640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b3efc30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f451c019de0 tx=0x7f451c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a91d310ed63dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f4506ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f4506ff5640 1 -- 172.21.15.1:0/165702951 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c009390 con 0x564c9b37d680 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f4506ff5640 1 -- 172.21.15.1:0/165702951 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f451c016c90 con 0x564c9b37d680 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f452b94e740 1 -- 172.21.15.1:0/165702951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f451403be30 con 0x564c9b37d680 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f4506ff5640 1 -- 172.21.15.1:0/165702951 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f451c022400 con 0x564c9b37d680 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f452b94e740 10 client.16230 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.434+0000 7f452b94e740 1 -- 172.21.15.1:0/165702951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564c9b3f7610 con 0x564c9b37d680 2024-09-19T09:06:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f4506ff5640 1 -- 172.21.15.1:0/165702951 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f451403be30 con 0x564c9b37d680 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f4506ff5640 1 -- 172.21.15.1:0/165702951 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f451c02d810 con 0x564c9b37d680 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f452b94e740 10 client.16230 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f452b94e740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f452b94e740 20 client.16230 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f452b94e740 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564c9b3f7d90 0x564c9b3fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f452b94e740 4 client.16230 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f452b94e740 1 -- 172.21.15.1:0/165702951 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c9b2dfd60 con 0x564c9b3f7d90 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f4522ffd640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564c9b3f7d90 0x564c9b3fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f4506ff5640 10 client.16230 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.435+0000 7f4522ffd640 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564c9b3f7d90 0x564c9b3fa1b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a634a750fcf1a31 server_cookie=92fb3b690c0849a9 in_seq=0 out_seq=0 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f4506ff5640 1 -- 172.21.15.1:0/165702951 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564c9b2dfd60 con 0x564c9b3f7d90 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f4506ff5640 10 client.16230 handle_command_reply: tid=0 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 client.16230 shutdown 2024-09-19T09:06:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 -- 172.21.15.1:0/165702951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 msgr2=0x564c9b3efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b3efc30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f451c019de0 tx=0x7f451c004b50 comp rx=0 tx=0).stop 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 -- 172.21.15.1:0/165702951 shutdown_connections 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564c9b3f7d90 0x564c9b3fa1b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564c9b37d680 0x564c9b3efc30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c9b372dc0 0x564c9b3812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 --2- 172.21.15.1:0/165702951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564c9b3724a0 0x564c9b380db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 -- 172.21.15.1:0/165702951 >> 172.21.15.1:0/165702951 conn(0x564c9b36ea30 msgr2=0x564c9b374710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f4506ff5640 0 client.16230 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 -- 172.21.15.1:0/165702951 shutdown_connections 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 1 -- 172.21.15.1:0/165702951 wait complete. 2024-09-19T09:06:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.436+0000 7f452b94e740 20 client.16230 trim_cache size 0 max 16384 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout: "add21bfc-3055-4afe-8627-66bf2e757d34": { 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "add21bfc-3055-4afe-8627-66bf2e757d34", 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:06:34.444 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:06:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 -- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f450c0a3240 msgr2=0x7f450c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f450c0a3240 0x7f450c0a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4524102b10 tx=0x7f451c00c040 comp rx=0 tx=0).stop 2024-09-19T09:06:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 -- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 msgr2=0x7f45241a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 0x7f45241a0400 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4514006010 tx=0x7f45140042f0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 -- 172.21.15.1:0/4107369051 shutdown_connections 2024-09-19T09:06:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f450c0a3240 0x7f450c0a5700 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f452410e4e0 0x7f452419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45241012e0 0x7f45241a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 --2- 172.21.15.1:0/4107369051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4524100930 0x7f45241a0400 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 -- 172.21.15.1:0/4107369051 >> 172.21.15.1:0/4107369051 conn(0x7f45240fc7a0 msgr2=0x7f45240feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 -- 172.21.15.1:0/4107369051 shutdown_connections 2024-09-19T09:06:34.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:06:34.437+0000 7f4529575640 1 -- 172.21.15.1:0/4107369051 wait complete. 2024-09-19T09:06:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:34 smithi001 ceph-mon[30939]: scrub queued for path: / 2024-09-19T09:06:34.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:34 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:34.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:34 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:06:34.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:34 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:34 smithi064 ceph-mon[35179]: scrub queued for path: / 2024-09-19T09:06:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:34 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:34 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:06:34.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:34 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:34.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:34 smithi022 ceph-mon[35107]: scrub queued for path: / 2024-09-19T09:06:34.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:34 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:34.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:34 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:06:34.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:34 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:06:35.190 INFO:tasks.cephfs.filesystem:scrub status for tag:add21bfc-3055-4afe-8627-66bf2e757d34 - {'path': '/', 'tag': 'add21bfc-3055-4afe-8627-66bf2e757d34', 'options': 'recursive,force'} 2024-09-19T09:06:35.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:35 smithi064 ceph-mon[35179]: pgmap v412: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-09-19T09:06:35.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:35 smithi022 ceph-mon[35107]: pgmap v412: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-09-19T09:06:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:35 smithi001 ceph-mon[30939]: pgmap v412: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-09-19T09:06:37.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:37 smithi064 ceph-mon[35179]: pgmap v413: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-09-19T09:06:37.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:37 smithi022 ceph-mon[35107]: pgmap v413: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-09-19T09:06:38.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:37 smithi001 ceph-mon[30939]: pgmap v413: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2024-09-19T09:06:38.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:38 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:06:38.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:38 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:06:39.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:38 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:06:39.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:39 smithi064 ceph-mon[35179]: pgmap v414: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-09-19T09:06:39.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:39 smithi022 ceph-mon[35107]: pgmap v414: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-09-19T09:06:40.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:39 smithi001 ceph-mon[30939]: pgmap v414: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.4 MiB/s wr, 9 op/s 2024-09-19T09:06:41.770 INFO:tasks.workunit.client.0.smithi001.stderr:+ mkdir untar_tar 2024-09-19T09:06:41.773 INFO:tasks.workunit.client.0.smithi001.stderr:+ cd untar_tar 2024-09-19T09:06:41.775 INFO:tasks.workunit.client.0.smithi001.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-19T09:06:41.805 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ 2024-09-19T09:06:41.807 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-19T09:06:41.808 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-19T09:06:41.809 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-19T09:06:41.810 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-19T09:06:41.811 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-19T09:06:41.812 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-19T09:06:41.813 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-19T09:06:41.814 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-19T09:06:41.816 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-19T09:06:41.817 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-19T09:06:41.818 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-19T09:06:41.819 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-19T09:06:41.820 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-19T09:06:41.821 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-19T09:06:41.822 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-19T09:06:41.822 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-19T09:06:41.823 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-19T09:06:41.825 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-19T09:06:41.826 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-19T09:06:41.827 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-19T09:06:41.828 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-19T09:06:41.829 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-19T09:06:41.830 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-19T09:06:41.831 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-19T09:06:41.832 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-19T09:06:41.833 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-19T09:06:41.834 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-19T09:06:41.835 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-19T09:06:41.836 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-19T09:06:41.837 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-19T09:06:41.839 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-19T09:06:41.839 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-19T09:06:41.840 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-19T09:06:41.841 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-19T09:06:41.843 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-19T09:06:41.844 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-19T09:06:41.845 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-19T09:06:41.846 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-19T09:06:41.847 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-19T09:06:41.848 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-19T09:06:41.849 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-19T09:06:41.850 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-19T09:06:41.850 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-19T09:06:41.851 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-19T09:06:41.852 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-19T09:06:41.853 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-19T09:06:41.854 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-19T09:06:41.855 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-19T09:06:41.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:41 smithi064 ceph-mon[35179]: pgmap v415: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-19T09:06:41.856 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-19T09:06:41.857 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-19T09:06:41.858 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-19T09:06:41.859 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-19T09:06:41.860 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-19T09:06:41.862 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-19T09:06:41.863 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-19T09:06:41.864 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-19T09:06:41.865 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-19T09:06:41.866 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-19T09:06:41.867 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-19T09:06:41.868 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-19T09:06:41.869 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-19T09:06:41.870 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-19T09:06:41.872 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-19T09:06:41.872 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-19T09:06:41.873 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-19T09:06:41.874 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-19T09:06:41.874 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-19T09:06:41.875 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-19T09:06:41.876 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-19T09:06:41.877 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-19T09:06:41.878 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-19T09:06:41.879 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-19T09:06:41.881 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-19T09:06:41.882 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-19T09:06:41.883 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-19T09:06:41.884 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-19T09:06:41.885 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-19T09:06:41.885 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-19T09:06:41.886 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-19T09:06:41.887 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-19T09:06:41.888 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-19T09:06:41.889 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-19T09:06:41.891 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-19T09:06:41.892 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-19T09:06:41.893 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-19T09:06:41.893 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-19T09:06:41.894 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-19T09:06:41.896 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-19T09:06:41.897 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-19T09:06:41.898 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-19T09:06:41.899 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-19T09:06:41.900 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-19T09:06:41.901 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-19T09:06:41.902 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-19T09:06:41.902 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-19T09:06:41.903 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-19T09:06:41.904 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-19T09:06:41.905 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-19T09:06:41.906 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-19T09:06:41.907 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-19T09:06:41.908 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-19T09:06:41.909 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-19T09:06:41.910 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-19T09:06:41.911 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-19T09:06:41.912 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-19T09:06:41.913 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-19T09:06:41.914 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-19T09:06:41.915 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-19T09:06:41.916 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-19T09:06:41.917 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-19T09:06:41.918 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-19T09:06:41.919 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-19T09:06:41.920 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-19T09:06:41.921 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-19T09:06:41.923 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-19T09:06:41.924 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-19T09:06:41.925 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-19T09:06:41.926 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-19T09:06:41.927 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-19T09:06:41.928 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-19T09:06:41.929 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-19T09:06:41.929 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-19T09:06:41.930 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-19T09:06:41.931 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-19T09:06:41.932 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-19T09:06:41.933 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-19T09:06:41.934 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-19T09:06:41.935 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-19T09:06:41.936 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-19T09:06:41.937 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-19T09:06:41.938 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-19T09:06:41.939 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-19T09:06:41.940 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-19T09:06:41.941 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-19T09:06:41.943 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-19T09:06:41.943 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-19T09:06:41.944 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-19T09:06:41.945 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-19T09:06:41.946 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-19T09:06:41.947 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-19T09:06:41.948 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-19T09:06:41.949 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-19T09:06:41.949 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-19T09:06:41.950 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-19T09:06:41.951 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-19T09:06:41.952 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-19T09:06:41.953 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-19T09:06:41.954 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-19T09:06:41.955 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-19T09:06:41.956 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-19T09:06:41.957 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-19T09:06:41.958 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-19T09:06:41.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:41 smithi022 ceph-mon[35107]: pgmap v415: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-19T09:06:41.959 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-19T09:06:41.960 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-19T09:06:41.961 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-19T09:06:41.962 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-19T09:06:41.963 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-19T09:06:41.964 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-19T09:06:41.965 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-19T09:06:41.965 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-19T09:06:41.966 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-19T09:06:41.967 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-19T09:06:41.968 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-19T09:06:41.969 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-19T09:06:41.970 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-19T09:06:41.971 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-19T09:06:41.972 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-19T09:06:41.973 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-19T09:06:41.975 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-19T09:06:41.976 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-19T09:06:41.977 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-19T09:06:41.978 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-19T09:06:41.979 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-19T09:06:41.980 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-19T09:06:41.981 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-19T09:06:41.982 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-19T09:06:41.983 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-19T09:06:41.984 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-19T09:06:41.985 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-19T09:06:41.986 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-19T09:06:41.987 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-19T09:06:41.988 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-19T09:06:41.988 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-19T09:06:41.989 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-19T09:06:41.990 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-19T09:06:41.991 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-19T09:06:41.992 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-19T09:06:41.993 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-19T09:06:41.994 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-19T09:06:41.995 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-19T09:06:41.996 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-19T09:06:41.997 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-19T09:06:41.998 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-19T09:06:41.999 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-19T09:06:42.000 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-19T09:06:42.001 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-19T09:06:42.002 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-19T09:06:42.002 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-19T09:06:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:41 smithi001 ceph-mon[30939]: pgmap v415: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 MiB/s wr, 11 op/s 2024-09-19T09:06:42.683 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-19T09:06:42.684 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-19T09:06:42.686 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-19T09:06:42.687 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-19T09:06:42.689 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-19T09:06:42.690 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-19T09:06:42.692 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-19T09:06:42.693 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-19T09:06:42.696 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-19T09:06:42.696 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-19T09:06:42.698 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-19T09:06:42.699 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-19T09:06:42.700 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-19T09:06:42.702 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-19T09:06:42.703 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-19T09:06:42.705 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-19T09:06:42.706 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-19T09:06:42.708 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-19T09:06:42.709 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-19T09:06:42.711 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-19T09:06:42.712 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-19T09:06:42.714 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-19T09:06:42.715 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-19T09:06:42.717 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-19T09:06:42.718 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-19T09:06:42.720 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-19T09:06:42.721 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-19T09:06:42.723 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-19T09:06:42.724 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-19T09:06:42.726 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-19T09:06:42.727 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-19T09:06:42.729 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-19T09:06:42.730 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-19T09:06:42.732 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-19T09:06:42.733 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-19T09:06:42.735 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-19T09:06:42.736 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-19T09:06:42.738 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-19T09:06:42.739 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-19T09:06:42.741 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-19T09:06:42.742 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-19T09:06:42.744 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-19T09:06:42.745 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-19T09:06:42.747 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-19T09:06:42.748 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-19T09:06:42.750 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-19T09:06:42.751 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-19T09:06:42.753 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-19T09:06:42.754 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-19T09:06:42.756 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-19T09:06:42.757 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-19T09:06:42.759 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-19T09:06:42.760 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-19T09:06:42.762 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-19T09:06:42.763 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-19T09:06:42.765 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-19T09:06:42.766 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-19T09:06:42.768 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-19T09:06:42.769 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-19T09:06:42.771 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-19T09:06:42.772 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-19T09:06:42.774 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-19T09:06:42.775 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-19T09:06:42.777 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/Changes 2024-09-19T09:06:42.778 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-19T09:06:42.780 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-19T09:06:42.781 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-19T09:06:42.783 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-19T09:06:42.784 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-19T09:06:42.786 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-19T09:06:42.787 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-19T09:06:42.789 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-19T09:06:42.790 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-19T09:06:42.791 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-19T09:06:42.793 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-19T09:06:42.794 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-19T09:06:42.795 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-19T09:06:42.797 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-19T09:06:42.798 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-19T09:06:42.800 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-19T09:06:42.802 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-19T09:06:42.803 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-19T09:06:42.805 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-19T09:06:42.806 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-19T09:06:42.807 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-19T09:06:42.809 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-19T09:06:42.810 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-19T09:06:42.811 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-19T09:06:42.812 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-19T09:06:42.813 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-19T09:06:42.814 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-19T09:06:42.814 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-19T09:06:42.815 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-19T09:06:42.816 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-19T09:06:42.817 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-19T09:06:42.818 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-19T09:06:42.819 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-19T09:06:42.820 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-19T09:06:42.821 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-19T09:06:42.822 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-19T09:06:42.823 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-19T09:06:42.824 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-19T09:06:42.824 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-19T09:06:42.825 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-19T09:06:42.826 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-19T09:06:42.827 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-19T09:06:42.830 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-19T09:06:42.830 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-19T09:06:42.830 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-19T09:06:42.831 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-19T09:06:42.833 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-19T09:06:42.834 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-19T09:06:42.836 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-19T09:06:42.837 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-19T09:06:42.837 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-19T09:06:42.838 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-19T09:06:42.839 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-19T09:06:42.840 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-19T09:06:42.841 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-19T09:06:42.842 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-19T09:06:42.843 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-19T09:06:42.844 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-19T09:06:42.845 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-19T09:06:42.848 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-19T09:06:42.848 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-19T09:06:42.850 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-19T09:06:42.850 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-19T09:06:42.851 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-19T09:06:42.852 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-19T09:06:42.853 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-19T09:06:42.854 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-19T09:06:42.855 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-19T09:06:42.856 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-19T09:06:42.857 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-19T09:06:42.858 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-19T09:06:42.859 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-19T09:06:42.860 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-19T09:06:42.861 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-19T09:06:42.862 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-19T09:06:42.863 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-19T09:06:42.864 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-19T09:06:42.865 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-19T09:06:42.866 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-19T09:06:42.867 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-19T09:06:42.868 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-19T09:06:42.869 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-19T09:06:42.870 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-19T09:06:42.870 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-19T09:06:42.871 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-19T09:06:42.872 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-19T09:06:42.873 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-19T09:06:42.874 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-19T09:06:42.875 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-19T09:06:42.876 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-19T09:06:42.877 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-19T09:06:42.878 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-19T09:06:42.879 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-19T09:06:42.880 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-19T09:06:42.881 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-19T09:06:42.882 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-19T09:06:42.883 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-19T09:06:42.884 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-19T09:06:42.885 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-19T09:06:42.886 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-19T09:06:42.888 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-19T09:06:42.889 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-19T09:06:42.890 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-19T09:06:42.891 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-19T09:06:42.892 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-19T09:06:42.892 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-19T09:06:42.893 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-19T09:06:42.894 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-19T09:06:42.895 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-19T09:06:42.896 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-19T09:06:42.897 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-19T09:06:42.900 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-19T09:06:42.901 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-19T09:06:42.901 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-19T09:06:42.902 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-19T09:06:42.903 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-19T09:06:42.904 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-19T09:06:42.905 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-19T09:06:42.906 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-19T09:06:42.906 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-19T09:06:42.907 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-19T09:06:42.909 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-19T09:06:42.909 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-19T09:06:42.910 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-19T09:06:42.911 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-19T09:06:42.912 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-19T09:06:42.913 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-19T09:06:42.914 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-19T09:06:42.914 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-19T09:06:42.916 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-19T09:06:42.917 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-19T09:06:42.918 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-19T09:06:42.919 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-19T09:06:42.919 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-19T09:06:42.921 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-19T09:06:42.922 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-19T09:06:42.923 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-19T09:06:42.924 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-19T09:06:42.925 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-19T09:06:42.926 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-19T09:06:42.927 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-19T09:06:42.928 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-19T09:06:42.929 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-19T09:06:42.930 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-19T09:06:42.930 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-19T09:06:42.931 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-19T09:06:42.932 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-19T09:06:42.933 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-19T09:06:42.935 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-19T09:06:42.936 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-19T09:06:42.936 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-19T09:06:42.937 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-19T09:06:42.938 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-19T09:06:42.940 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-19T09:06:42.941 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-19T09:06:42.941 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-19T09:06:42.942 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-19T09:06:42.943 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-19T09:06:42.944 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-19T09:06:42.944 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-19T09:06:42.945 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-19T09:06:42.946 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-19T09:06:42.947 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-19T09:06:42.948 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-19T09:06:42.949 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-19T09:06:42.950 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-19T09:06:42.951 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-19T09:06:42.952 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-19T09:06:42.953 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-19T09:06:42.954 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-19T09:06:42.955 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-19T09:06:42.956 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-19T09:06:42.957 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-19T09:06:42.958 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-19T09:06:42.959 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-19T09:06:42.960 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-19T09:06:42.961 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-19T09:06:42.962 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-19T09:06:42.963 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-19T09:06:42.964 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-19T09:06:42.965 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-19T09:06:42.966 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-19T09:06:42.967 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-19T09:06:42.967 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-19T09:06:42.968 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-19T09:06:42.969 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-19T09:06:42.970 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-19T09:06:42.971 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-19T09:06:42.972 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-19T09:06:42.973 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-19T09:06:42.974 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-19T09:06:42.975 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-19T09:06:42.975 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-19T09:06:42.976 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-19T09:06:42.977 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-19T09:06:42.978 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-19T09:06:42.979 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-19T09:06:42.980 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-19T09:06:42.981 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-19T09:06:42.982 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-19T09:06:42.984 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-19T09:06:42.984 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-19T09:06:42.985 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-19T09:06:42.986 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-19T09:06:42.987 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-19T09:06:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/3909193880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 msgr2=0x7f4fd0109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/3909193880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 0x7f4fd0109fb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009ca0 tx=0x7f4fc802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/3909193880 shutdown_connections 2024-09-19T09:06:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/3909193880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 0x7f4fd0109fb0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/3909193880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fd0102d60 0x7f4fd01031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/3909193880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fd0101b70 0x7f4fd0101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/3909193880 >> 172.21.15.1:0/3909193880 conn(0x7f4fd00fd2f0 msgr2=0x7f4fd00ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/3909193880 shutdown_connections 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.105+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/3909193880 wait complete. 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd6fcf640 1 Processor -- start 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd6fcf640 1 -- start start 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd6fcf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fd0101b70 0x7f4fd0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd6fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fd0102d60 0x7f4fd0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd6fcf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 0x7f4fd019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd6fcf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010d910 con 0x7f4fd0103720 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd6fcf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010d790 con 0x7f4fd0102d60 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd6fcf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010da90 con 0x7f4fd0101b70 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd556c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 0x7f4fd019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd556c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 0x7f4fd019f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42194/0 (socket says 172.21.15.1:42194) 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd556c640 1 -- 172.21.15.1:0/487024160 learned_addr learned my addr 172.21.15.1:0/487024160 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fcffff640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fd0102d60 0x7f4fd0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.106+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fd0101b70 0x7f4fd0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fd556c640 1 -- 172.21.15.1:0/487024160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fd0101b70 msgr2=0x7f4fd0197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.110 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fd556c640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fd0101b70 0x7f4fd0197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fd556c640 1 -- 172.21.15.1:0/487024160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fd0102d60 msgr2=0x7f4fd0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fd556c640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fd0102d60 0x7f4fd0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fd556c640 1 -- 172.21.15.1:0/487024160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd019fb20 con 0x7f4fd0103720 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fd556c640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 0x7f4fd019f4b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4fc802f540 tx=0x7f4fc8009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fcdffb640 1 -- 172.21.15.1:0/487024160 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc802fae0 con 0x7f4fd0103720 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fcdffb640 1 -- 172.21.15.1:0/487024160 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fc802fc80 con 0x7f4fd0103720 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/487024160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd019fdb0 con 0x7f4fd0103720 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fcdffb640 1 -- 172.21.15.1:0/487024160 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80468c0 con 0x7f4fd0103720 2024-09-19T09:06:43.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.107+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/487024160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd01a02d0 con 0x7f4fd0103720 2024-09-19T09:06:43.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.110+0000 7f4fcdffb640 1 -- 172.21.15.1:0/487024160 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f4fc8030bc0 con 0x7f4fd0103720 2024-09-19T09:06:43.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.110+0000 7f4fd9e46740 1 Processor -- start 2024-09-19T09:06:43.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.110+0000 7f4fd9e46740 1 -- start start 2024-09-19T09:06:43.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 0x562cc4b571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b576f0 0x562cc4b5c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 0x562cc4b5ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cc4ab62f0 con 0x562cc4b576f0 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562cc4a5e270 con 0x562cc4b5c780 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cc4ab22b0 con 0x562cc4b56db0 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b576f0 0x562cc4b5c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b576f0 0x562cc4b5c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42200/0 (socket says 172.21.15.1:42200) 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 -- 172.21.15.1:0/1421089360 learned_addr learned my addr 172.21.15.1:0/1421089360 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fcffff640 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 0x562cc4b571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fcffff640 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 0x562cc4b5ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fcdffb640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4fbc0a32c0 0x7f4fbc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 -- 172.21.15.1:0/1421089360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 msgr2=0x562cc4b571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 0x562cc4b571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 -- 172.21.15.1:0/1421089360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 msgr2=0x562cc4b5ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 0x562cc4b5ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 -- 172.21.15.1:0/1421089360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc4a5d340 con 0x562cc4b576f0 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd556c640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4fbc0a32c0 0x7f4fbc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b576f0 0x562cc4b5c1b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009ca0 tx=0x7f4fb8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e95f72934d52687 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.111+0000 7f4fcdffb640 1 -- 172.21.15.1:0/487024160 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4fc80f0d70 con 0x7f4fd0103720 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fc6ffd640 1 -- 172.21.15.1:0/1421089360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8009e50 con 0x562cc4b576f0 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fc6ffd640 1 -- 172.21.15.1:0/1421089360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fb80035f0 con 0x562cc4b576f0 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fc6ffd640 1 -- 172.21.15.1:0/1421089360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8019670 con 0x562cc4b576f0 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1421089360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b576f0 msgr2=0x562cc4b5c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b576f0 0x562cc4b5c1b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009ca0 tx=0x7f4fb8011810 comp rx=0 tx=0).stop 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fd556c640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4fbc0a32c0 0x7f4fbc0a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b9ce0 tx=0x7f4fc80af040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1421089360 shutdown_connections 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 0x562cc4b5ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b576f0 0x562cc4b5c1b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1421089360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 0x562cc4b571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.112+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1421089360 >> 172.21.15.1:0/1421089360 conn(0x562cc4b4e010 msgr2=0x562cc4b4e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1421089360 shutdown_connections 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1421089360 wait complete. 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 -- start start 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 Processor -- start 2024-09-19T09:06:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 0x562cc4b60fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b576f0 0x562cc4b614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b68520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562cc4b5f750 con 0x562cc4b5c780 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562cc4a3f290 con 0x562cc4b576f0 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562cc4b5f8d0 con 0x562cc4b56db0 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fd9e46740 10 client.0 _ll_register_callbacks cb 0x562cc4a70140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.113+0000 7f4fcffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b68520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b68520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42212/0 (socket says 172.21.15.1:42212) 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 -- 172.21.15.1:0/1997773258 learned_addr learned my addr 172.21.15.1:0/1997773258 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 0x562cc4b60fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b576f0 0x562cc4b614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 -- 172.21.15.1:0/1997773258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 msgr2=0x562cc4b60fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 0x562cc4b60fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 -- 172.21.15.1:0/1997773258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b576f0 msgr2=0x562cc4b614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b576f0 0x562cc4b614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 -- 172.21.15.1:0/1997773258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc47c9210 con 0x562cc4b5c780 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fcffff640 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b68520 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0013be0 tx=0x7f4fc000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8695a46d7a67628 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4faffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4faffff640 1 -- 172.21.15.1:0/1997773258 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0011c70 con 0x562cc4b5c780 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4faffff640 1 -- 172.21.15.1:0/1997773258 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4fc0011e10 con 0x562cc4b5c780 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1997773258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fb80035f0 con 0x562cc4b5c780 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4faffff640 1 -- 172.21.15.1:0/1997773258 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fc0027070 con 0x562cc4b5c780 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fd9e46740 10 client.16242 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.114+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1997773258 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562cc4895620 con 0x562cc4b5c780 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4faffff640 1 -- 172.21.15.1:0/1997773258 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fb80035f0 con 0x562cc4b5c780 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4faffff640 1 -- 172.21.15.1:0/1997773258 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4fc0003890 con 0x562cc4b5c780 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4fd9e46740 10 client.16242 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4fd9e46740 10 client.16242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4fd9e46740 20 client.16242 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562cc4b6cca0 0x562cc4b6f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4fd9e46740 4 client.16242 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1997773258 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cc4ac3a20 con 0x562cc4b6cca0 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562cc4b6cca0 0x562cc4b6f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4faffff640 10 client.16242 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.115+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562cc4b6cca0 0x562cc4b6f130 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c73bec45413cf7cc server_cookie=7c811b308e3db71f in_seq=0 out_seq=0 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4faffff640 1 -- 172.21.15.1:0/1997773258 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562cc4ac3a20 con 0x562cc4b6cca0 2024-09-19T09:06:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4faffff640 10 client.16242 handle_command_reply: tid=0 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 client.16242 shutdown 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1997773258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 msgr2=0x562cc4b68520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b68520 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0013be0 tx=0x7f4fc000bbb0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1997773258 shutdown_connections 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562cc4b6cca0 0x562cc4b6f130 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b68520 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4faffff640 0 client.16242 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b576f0 0x562cc4b614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/1997773258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b56db0 0x562cc4b60fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1997773258 >> 172.21.15.1:0/1997773258 conn(0x562cc4b4e010 msgr2=0x562cc4b4f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1997773258 shutdown_connections 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 1 -- 172.21.15.1:0/1997773258 wait complete. 2024-09-19T09:06:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.116+0000 7f4fd9e46740 20 client.16242 trim_cache size 0 max 16384 2024-09-19T09:06:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fd9e46740 1 Processor -- start 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fd9e46740 1 -- start start 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b56db0 0x562cc4b4eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 0x562cc4b68440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b4f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01a97d0 con 0x562cc4b5c780 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01a70a0 con 0x562cc4b56db0 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01a4ef0 con 0x562cc4b576f0 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fcffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b4f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fcffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b4f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42228/0 (socket says 172.21.15.1:42228) 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fcffff640 1 -- 172.21.15.1:0/4283100282 learned_addr learned my addr 172.21.15.1:0/4283100282 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.131+0000 7f4fcffff640 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b56db0 0x562cc4b4eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 0x562cc4b68440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fcffff640 1 -- 172.21.15.1:0/4283100282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 msgr2=0x562cc4b68440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fcffff640 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 0x562cc4b68440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fcffff640 1 -- 172.21.15.1:0/4283100282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b56db0 msgr2=0x562cc4b4eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fcffff640 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b56db0 0x562cc4b4eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fcffff640 1 -- 172.21.15.1:0/4283100282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cc4b57bd0 con 0x562cc4b5c780 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fcffff640 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b4f400 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0005fd0 tx=0x7f4fc0013760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b71fc88a32f3389 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fc67fc640 1 -- 172.21.15.1:0/4283100282 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000b410 con 0x562cc4b5c780 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fc67fc640 1 -- 172.21.15.1:0/4283100282 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fc0011c40 con 0x562cc4b5c780 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.132+0000 7f4fc67fc640 1 -- 172.21.15.1:0/4283100282 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0005030 con 0x562cc4b5c780 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- 172.21.15.1:0/4283100282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 msgr2=0x562cc4b4f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b4f400 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0005fd0 tx=0x7f4fc0013760 comp rx=0 tx=0).stop 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- 172.21.15.1:0/4283100282 shutdown_connections 2024-09-19T09:06:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b5c780 0x562cc4b4f400 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 0x562cc4b68440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/4283100282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b56db0 0x562cc4b4eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- 172.21.15.1:0/4283100282 >> 172.21.15.1:0/4283100282 conn(0x562cc4b4e010 msgr2=0x562cc4b60fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- 172.21.15.1:0/4283100282 shutdown_connections 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- 172.21.15.1:0/4283100282 wait complete. 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- start start 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 Processor -- start 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b56db0 0x562cc4b65b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 0x562cc4b660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 0x562cc4b670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01a5560 con 0x562cc4b56db0 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01a69d0 con 0x562cc4b5c780 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01a5c30 con 0x562cc4b576f0 2024-09-19T09:06:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fd9e46740 10 client.0 _ll_register_callbacks cb 0x7f4fc000be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fcffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b56db0 0x562cc4b65b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fcffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b56db0 0x562cc4b65b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42230/0 (socket says 172.21.15.1:42230) 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.133+0000 7f4fcffff640 1 -- 172.21.15.1:0/3236223086 learned_addr learned my addr 172.21.15.1:0/3236223086 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 0x562cc4b660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fcffff640 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 0x562cc4b670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fcffff640 1 -- 172.21.15.1:0/3236223086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 msgr2=0x562cc4b660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fcffff640 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 0x562cc4b660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fcffff640 1 -- 172.21.15.1:0/3236223086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 msgr2=0x562cc4b670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fcffff640 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 0x562cc4b670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fcffff640 1 -- 172.21.15.1:0/3236223086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cc4b676f0 con 0x562cc4b56db0 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fcffff640 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b56db0 0x562cc4b65b90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00059f0 tx=0x7f4fc0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9becec49cf6896e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4faffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4faffff640 1 -- 172.21.15.1:0/3236223086 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00035f0 con 0x562cc4b56db0 2024-09-19T09:06:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4faffff640 1 -- 172.21.15.1:0/3236223086 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4fc0003790 con 0x562cc4b56db0 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fd9e46740 1 -- 172.21.15.1:0/3236223086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fc0011c40 con 0x562cc4b56db0 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4faffff640 1 -- 172.21.15.1:0/3236223086 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fc0040050 con 0x562cc4b56db0 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fd9e46740 10 client.16248 fetch_fsmap learned FSMap version 24 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4fd9e46740 1 -- 172.21.15.1:0/3236223086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562cc4bd7a90 con 0x562cc4b56db0 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.134+0000 7f4faffff640 1 -- 172.21.15.1:0/3236223086 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fc0011c40 con 0x562cc4b56db0 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4faffff640 1 -- 172.21.15.1:0/3236223086 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4fc0004990 con 0x562cc4b56db0 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4fd9e46740 10 client.16248 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4fd9e46740 10 client.16248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4fd9e46740 20 client.16248 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562cc4bd8270 0x562cc4bda660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4fd9e46740 4 client.16248 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4fd9e46740 1 -- 172.21.15.1:0/3236223086 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562cc4abdd70 con 0x562cc4bd8270 2024-09-19T09:06:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562cc4bd8270 0x562cc4bda660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4fd4d6b640 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562cc4bd8270 0x562cc4bda660 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b6364d587562d06 server_cookie=a93213010835bc08 in_seq=0 out_seq=0 2024-09-19T09:06:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.135+0000 7f4faffff640 10 client.16248 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:43.308 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-19T09:06:43.314 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-19T09:06:43.317 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-19T09:06:43.321 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-19T09:06:43.324 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-19T09:06:43.325 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-19T09:06:43.327 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-19T09:06:43.328 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-19T09:06:43.330 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-19T09:06:43.333 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-19T09:06:43.334 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-19T09:06:43.335 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-19T09:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4faffff640 1 -- 172.21.15.1:0/3236223086 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562cc4abdd70 con 0x562cc4bd8270 2024-09-19T09:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4faffff640 10 client.16248 handle_command_reply: tid=0 2024-09-19T09:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 client.16248 shutdown 2024-09-19T09:06:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 -- 172.21.15.1:0/3236223086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b56db0 msgr2=0x562cc4b65b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b56db0 0x562cc4b65b90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00059f0 tx=0x7f4fc0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 -- 172.21.15.1:0/3236223086 shutdown_connections 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562cc4bd8270 0x562cc4bda660 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562cc4b5c780 0x562cc4b670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4faffff640 0 client.16248 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562cc4b576f0 0x562cc4b660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 --2- 172.21.15.1:0/3236223086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562cc4b56db0 0x562cc4b65b90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.335+0000 7f4fd9e46740 1 -- 172.21.15.1:0/3236223086 >> 172.21.15.1:0/3236223086 conn(0x562cc4b4e010 msgr2=0x562cc4b4c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd9e46740 1 -- 172.21.15.1:0/3236223086 shutdown_connections 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd9e46740 1 -- 172.21.15.1:0/3236223086 wait complete. 2024-09-19T09:06:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd9e46740 20 client.16248 trim_cache size 0 max 16384 2024-09-19T09:06:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:06:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:06:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:06:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:06:43.338 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-19T09:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4fbc0a32c0 msgr2=0x7f4fbc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4fbc0a32c0 0x7f4fbc0a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b9ce0 tx=0x7f4fc80af040 comp rx=0 tx=0).stop 2024-09-19T09:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 msgr2=0x7f4fd019f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 0x7f4fd019f4b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4fc802f540 tx=0x7f4fc8009890 comp rx=0 tx=0).stop 2024-09-19T09:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/487024160 shutdown_connections 2024-09-19T09:06:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fd0103720 0x7f4fd019f4b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fd0102d60 0x7f4fd0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4fbc0a32c0 0x7f4fbc0a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 --2- 172.21.15.1:0/487024160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fd0101b70 0x7f4fd0197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/487024160 >> 172.21.15.1:0/487024160 conn(0x7f4fd00fd2f0 msgr2=0x7f4fd01060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/487024160 shutdown_connections 2024-09-19T09:06:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:43.336+0000 7f4fd6fcf640 1 -- 172.21.15.1:0/487024160 wait complete. 2024-09-19T09:06:43.340 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-19T09:06:43.340 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-19T09:06:43.341 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-19T09:06:43.341 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-19T09:06:43.342 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-19T09:06:43.344 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-19T09:06:43.345 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-19T09:06:43.346 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-19T09:06:43.348 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-19T09:06:43.349 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-19T09:06:43.350 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-19T09:06:43.352 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-19T09:06:43.353 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-19T09:06:43.355 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-19T09:06:43.356 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-19T09:06:43.358 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-19T09:06:43.359 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-19T09:06:43.360 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-19T09:06:43.363 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-19T09:06:43.365 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-19T09:06:43.366 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-19T09:06:43.367 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-19T09:06:43.368 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-19T09:06:43.369 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-19T09:06:43.370 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-19T09:06:43.370 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-19T09:06:43.371 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-19T09:06:43.372 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-19T09:06:43.373 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-19T09:06:43.374 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-19T09:06:43.374 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-19T09:06:43.375 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-19T09:06:43.376 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-19T09:06:43.377 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-19T09:06:43.378 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-19T09:06:43.379 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-19T09:06:43.380 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-19T09:06:43.381 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-19T09:06:43.382 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/Makefile 2024-09-19T09:06:43.383 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-19T09:06:43.384 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-19T09:06:43.385 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-19T09:06:43.386 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-19T09:06:43.386 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-19T09:06:43.387 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-19T09:06:43.388 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-19T09:06:43.389 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-19T09:06:43.390 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-19T09:06:43.391 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-19T09:06:43.392 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-19T09:06:43.393 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-19T09:06:43.394 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-19T09:06:43.395 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-19T09:06:43.395 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-19T09:06:43.396 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-19T09:06:43.397 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-19T09:06:43.398 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-19T09:06:43.399 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-19T09:06:43.400 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-19T09:06:43.401 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-19T09:06:43.402 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-19T09:06:43.402 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-19T09:06:43.403 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-19T09:06:43.405 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-19T09:06:43.405 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-19T09:06:43.406 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-19T09:06:43.407 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-19T09:06:43.407 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-19T09:06:43.408 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-19T09:06:43.409 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-19T09:06:43.410 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-19T09:06:43.411 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-19T09:06:43.412 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-19T09:06:43.413 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-19T09:06:43.414 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-19T09:06:43.414 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-19T09:06:43.415 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-19T09:06:43.416 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-19T09:06:43.417 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-19T09:06:43.417 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-19T09:06:43.418 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-19T09:06:43.419 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-19T09:06:43.420 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-19T09:06:43.421 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-19T09:06:43.421 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-19T09:06:43.422 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-19T09:06:43.423 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-19T09:06:43.424 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-19T09:06:43.425 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-19T09:06:43.426 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-19T09:06:43.427 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-19T09:06:43.428 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-19T09:06:43.429 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-19T09:06:43.429 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-19T09:06:43.430 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-19T09:06:43.431 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-19T09:06:43.431 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-19T09:06:43.432 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-19T09:06:43.433 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-19T09:06:43.434 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-19T09:06:43.435 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-19T09:06:43.436 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-19T09:06:43.436 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-19T09:06:43.437 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-19T09:06:43.438 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/ 2024-09-19T09:06:43.439 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-19T09:06:43.440 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-19T09:06:43.441 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-19T09:06:43.441 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-19T09:06:43.442 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-19T09:06:43.443 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-19T09:06:43.444 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-19T09:06:43.445 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-19T09:06:43.446 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-19T09:06:43.446 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-19T09:06:43.447 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-19T09:06:43.448 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-19T09:06:43.449 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-19T09:06:43.450 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-19T09:06:43.451 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-19T09:06:43.451 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/README 2024-09-19T09:06:43.452 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-19T09:06:43.453 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-19T09:06:43.454 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-19T09:06:43.455 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-19T09:06:43.455 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-19T09:06:43.456 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-19T09:06:43.457 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-19T09:06:43.458 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-19T09:06:43.459 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-19T09:06:43.460 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-19T09:06:43.460 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-19T09:06:43.461 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-19T09:06:43.462 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-19T09:06:43.463 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-19T09:06:43.464 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-19T09:06:43.464 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-19T09:06:43.465 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-19T09:06:43.466 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-19T09:06:43.467 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-19T09:06:43.468 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-19T09:06:43.468 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-19T09:06:43.469 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-19T09:06:43.470 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-19T09:06:43.471 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-19T09:06:43.471 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-19T09:06:43.472 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-19T09:06:43.473 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-19T09:06:43.474 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-19T09:06:43.474 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-19T09:06:43.475 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-19T09:06:43.476 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-19T09:06:43.477 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-19T09:06:43.478 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-19T09:06:43.479 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-19T09:06:43.480 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-19T09:06:43.481 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-19T09:06:43.481 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-19T09:06:43.482 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-19T09:06:43.483 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-19T09:06:43.484 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-19T09:06:43.485 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-19T09:06:43.485 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-19T09:06:43.486 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-19T09:06:43.487 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-19T09:06:43.488 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-19T09:06:43.489 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-19T09:06:43.489 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-19T09:06:43.490 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-19T09:06:43.491 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-19T09:06:43.492 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-19T09:06:43.493 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-19T09:06:43.493 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-19T09:06:43.494 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-19T09:06:43.495 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-19T09:06:43.496 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-19T09:06:43.497 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-19T09:06:43.497 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-19T09:06:43.498 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-19T09:06:43.499 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-19T09:06:43.500 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-19T09:06:43.501 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-19T09:06:43.502 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-19T09:06:43.502 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-19T09:06:43.503 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-19T09:06:43.504 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-19T09:06:43.505 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-19T09:06:43.506 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-19T09:06:43.507 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-19T09:06:43.508 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-19T09:06:43.509 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-19T09:06:43.510 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-19T09:06:43.511 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-19T09:06:43.511 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-19T09:06:43.512 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-19T09:06:43.513 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-19T09:06:43.516 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-19T09:06:43.516 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-19T09:06:43.516 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-19T09:06:43.517 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-19T09:06:43.517 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-19T09:06:43.518 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-19T09:06:43.519 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-19T09:06:43.520 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-19T09:06:43.521 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-19T09:06:43.522 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-19T09:06:43.522 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-19T09:06:43.523 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-19T09:06:43.524 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-19T09:06:43.525 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-19T09:06:43.526 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-19T09:06:43.527 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-19T09:06:43.528 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-19T09:06:43.529 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-19T09:06:43.530 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-19T09:06:43.531 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-19T09:06:43.531 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-19T09:06:43.532 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-19T09:06:43.533 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-19T09:06:43.534 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-19T09:06:43.535 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/ 2024-09-19T09:06:43.536 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-19T09:06:43.536 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-19T09:06:43.537 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-19T09:06:43.538 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-19T09:06:43.539 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-19T09:06:43.540 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-19T09:06:43.541 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-19T09:06:43.541 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-19T09:06:43.542 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-19T09:06:43.543 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-19T09:06:43.544 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-19T09:06:43.544 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-19T09:06:43.545 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-19T09:06:43.546 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-19T09:06:43.547 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-19T09:06:43.548 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-19T09:06:43.549 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-19T09:06:43.549 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-19T09:06:43.550 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-19T09:06:43.551 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-19T09:06:43.552 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-19T09:06:43.553 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-19T09:06:43.554 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-19T09:06:43.555 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-19T09:06:43.555 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-19T09:06:43.556 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-19T09:06:43.557 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-19T09:06:43.558 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-19T09:06:43.559 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-19T09:06:43.559 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-19T09:06:43.561 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-19T09:06:43.561 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-19T09:06:43.562 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-19T09:06:43.562 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-19T09:06:43.563 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-19T09:06:43.564 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-19T09:06:43.565 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-19T09:06:43.565 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-19T09:06:43.566 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-19T09:06:43.567 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-19T09:06:43.568 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-19T09:06:43.569 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-19T09:06:43.570 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-19T09:06:43.570 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-19T09:06:43.571 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-19T09:06:43.572 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-19T09:06:43.573 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-19T09:06:43.574 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-19T09:06:43.574 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-19T09:06:43.575 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-19T09:06:43.576 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-19T09:06:43.577 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-19T09:06:43.577 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-19T09:06:43.578 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-19T09:06:43.579 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-19T09:06:43.580 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-19T09:06:43.580 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-19T09:06:43.581 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-19T09:06:43.582 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-19T09:06:43.584 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-19T09:06:43.585 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-19T09:06:43.586 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-19T09:06:43.586 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-19T09:06:43.587 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-19T09:06:43.588 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-19T09:06:43.589 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/connector/ 2024-09-19T09:06:43.590 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-19T09:06:43.591 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-19T09:06:43.592 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-19T09:06:43.592 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-19T09:06:43.593 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-19T09:06:43.594 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/console/ 2024-09-19T09:06:43.595 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-19T09:06:43.596 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-19T09:06:43.596 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-19T09:06:43.597 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-19T09:06:43.598 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-19T09:06:43.599 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-19T09:06:43.600 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-19T09:06:43.601 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-19T09:06:43.602 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-19T09:06:43.603 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-19T09:06:43.604 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-19T09:06:43.604 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-19T09:06:43.605 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-19T09:06:43.606 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-19T09:06:43.607 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-19T09:06:43.608 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-19T09:06:43.608 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-19T09:06:43.609 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-19T09:06:43.610 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-19T09:06:43.611 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-19T09:06:43.612 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-19T09:06:43.613 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-19T09:06:43.613 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cris/ 2024-09-19T09:06:43.614 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/cris/README 2024-09-19T09:06:43.615 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-19T09:06:43.616 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-19T09:06:43.616 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-19T09:06:43.618 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-19T09:06:43.618 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-19T09:06:43.619 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-19T09:06:43.621 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-19T09:06:43.622 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-19T09:06:43.623 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-19T09:06:43.624 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-19T09:06:43.625 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-19T09:06:43.625 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-19T09:06:43.626 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-19T09:06:43.628 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-19T09:06:43.628 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-19T09:06:43.629 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-19T09:06:43.630 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-19T09:06:43.630 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-19T09:06:43.631 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-19T09:06:43.632 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-19T09:06:43.633 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-19T09:06:43.634 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-19T09:06:43.634 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-19T09:06:43.635 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-19T09:06:43.636 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-19T09:06:43.637 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-19T09:06:43.638 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-19T09:06:43.638 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-19T09:06:43.639 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-19T09:06:43.640 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-19T09:06:43.641 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-19T09:06:43.642 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-19T09:06:43.643 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-19T09:06:43.643 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-19T09:06:43.644 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-19T09:06:43.645 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-19T09:06:43.646 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-19T09:06:43.647 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-19T09:06:43.648 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-19T09:06:43.649 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-19T09:06:43.650 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-19T09:06:43.651 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-19T09:06:43.652 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-19T09:06:43.654 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-19T09:06:43.655 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-19T09:06:43.656 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-19T09:06:43.656 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-19T09:06:43.657 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-19T09:06:43.658 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-19T09:06:43.659 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-19T09:06:43.659 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-19T09:06:43.660 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-19T09:06:43.661 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-19T09:06:43.662 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-19T09:06:43.663 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-19T09:06:43.664 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-19T09:06:43.665 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-19T09:06:43.665 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-19T09:06:43.666 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-19T09:06:43.667 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-19T09:06:43.668 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-19T09:06:43.669 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-19T09:06:43.670 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-19T09:06:43.671 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-19T09:06:43.672 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-19T09:06:43.673 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-19T09:06:43.674 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-19T09:06:43.675 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-19T09:06:43.676 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-19T09:06:43.676 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-19T09:06:43.677 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-19T09:06:43.678 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-19T09:06:43.679 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-19T09:06:43.679 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-19T09:06:43.680 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-19T09:06:43.681 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-19T09:06:43.682 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-19T09:06:43.683 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-19T09:06:43.684 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-19T09:06:43.685 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-19T09:06:43.686 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-19T09:06:43.686 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-19T09:06:43.688 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-19T09:06:43.688 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-19T09:06:43.689 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-19T09:06:43.690 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-19T09:06:43.691 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-19T09:06:43.692 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-19T09:06:43.693 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-19T09:06:43.694 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-19T09:06:43.695 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-19T09:06:43.695 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-19T09:06:43.697 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-19T09:06:43.697 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-19T09:06:43.698 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-19T09:06:43.699 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-19T09:06:43.700 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-19T09:06:43.701 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-19T09:06:43.702 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-19T09:06:43.703 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-19T09:06:43.703 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-19T09:06:43.704 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-19T09:06:43.705 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-19T09:06:43.706 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-19T09:06:43.707 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-19T09:06:43.708 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-19T09:06:43.709 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-19T09:06:43.709 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-19T09:06:43.710 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-19T09:06:43.711 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-19T09:06:43.712 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-19T09:06:43.713 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-19T09:06:43.713 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-19T09:06:43.716 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-19T09:06:43.716 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-19T09:06:43.716 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-19T09:06:43.717 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-19T09:06:43.718 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-19T09:06:43.718 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-19T09:06:43.719 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-19T09:06:43.720 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-19T09:06:43.722 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-19T09:06:43.723 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-19T09:06:43.723 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-19T09:06:43.724 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-19T09:06:43.725 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-19T09:06:43.726 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-19T09:06:43.727 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-19T09:06:43.728 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-19T09:06:43.729 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-19T09:06:43.730 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-19T09:06:43.730 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-19T09:06:43.731 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-19T09:06:43.732 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-19T09:06:43.733 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-19T09:06:43.733 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-19T09:06:43.734 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-19T09:06:43.735 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-19T09:06:43.736 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-19T09:06:43.737 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-19T09:06:43.738 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-19T09:06:43.738 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-19T09:06:43.739 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-19T09:06:43.740 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-19T09:06:43.741 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-19T09:06:43.742 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-19T09:06:43.743 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-19T09:06:43.744 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-19T09:06:43.745 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-19T09:06:43.746 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-19T09:06:43.746 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-19T09:06:43.747 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-19T09:06:43.748 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-19T09:06:43.749 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-19T09:06:43.750 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-19T09:06:43.751 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-19T09:06:43.751 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-19T09:06:43.752 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-19T09:06:43.753 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-19T09:06:43.754 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-19T09:06:43.754 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-19T09:06:43.755 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-19T09:06:43.756 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-19T09:06:43.757 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-19T09:06:43.758 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-19T09:06:43.759 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-19T09:06:43.760 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-19T09:06:43.760 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-19T09:06:43.761 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-19T09:06:43.762 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-19T09:06:43.763 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-19T09:06:43.764 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-19T09:06:43.765 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-19T09:06:43.765 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-19T09:06:43.766 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-19T09:06:43.767 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-19T09:06:43.768 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-19T09:06:43.769 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-19T09:06:43.769 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-19T09:06:43.770 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-19T09:06:43.771 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-19T09:06:43.772 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-19T09:06:43.772 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-19T09:06:43.773 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-19T09:06:43.774 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-19T09:06:43.775 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-19T09:06:43.776 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-19T09:06:43.777 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-19T09:06:43.777 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-19T09:06:43.778 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-19T09:06:43.779 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-19T09:06:43.780 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-19T09:06:43.781 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-19T09:06:43.782 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-19T09:06:43.783 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-19T09:06:43.784 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-19T09:06:43.784 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-19T09:06:43.786 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-19T09:06:43.786 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-19T09:06:43.787 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-19T09:06:43.789 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-19T09:06:43.790 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-19T09:06:43.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:43 smithi064 ceph-mon[35179]: pgmap v416: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T09:06:43.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:43 smithi022 ceph-mon[35107]: pgmap v416: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T09:06:43.974 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-19T09:06:43.975 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-19T09:06:43.976 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-19T09:06:43.977 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-19T09:06:43.978 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-19T09:06:43.979 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-19T09:06:43.980 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-19T09:06:43.981 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-19T09:06:43.982 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-19T09:06:43.982 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-19T09:06:43.983 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-19T09:06:43.984 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-19T09:06:43.985 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-19T09:06:43.986 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-19T09:06:43.987 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-19T09:06:43.987 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-19T09:06:43.988 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-19T09:06:43.989 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-19T09:06:43.990 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-19T09:06:43.991 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-19T09:06:43.991 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-19T09:06:43.992 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-19T09:06:43.993 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-19T09:06:43.994 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-19T09:06:43.995 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-19T09:06:43.996 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-19T09:06:43.997 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-19T09:06:43.998 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-19T09:06:43.998 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-19T09:06:43.999 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-19T09:06:44.000 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-19T09:06:44.001 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-19T09:06:44.002 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-19T09:06:44.003 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-19T09:06:44.004 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-19T09:06:44.005 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-19T09:06:44.006 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-19T09:06:44.006 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-19T09:06:44.008 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-19T09:06:44.008 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-19T09:06:44.009 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-19T09:06:44.010 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-19T09:06:44.011 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-19T09:06:44.012 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-19T09:06:44.013 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-19T09:06:44.013 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-19T09:06:44.014 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-19T09:06:44.015 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-19T09:06:44.016 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-19T09:06:44.017 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-19T09:06:44.018 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-19T09:06:44.019 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-19T09:06:44.020 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-19T09:06:44.021 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-19T09:06:44.021 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-19T09:06:44.022 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-19T09:06:44.023 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-19T09:06:44.024 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-19T09:06:44.025 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-19T09:06:44.026 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-19T09:06:44.026 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-19T09:06:44.027 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-19T09:06:44.028 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-19T09:06:44.029 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-19T09:06:44.029 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-19T09:06:44.030 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-19T09:06:44.032 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-19T09:06:44.033 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-19T09:06:44.033 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-19T09:06:44.034 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-19T09:06:44.035 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-19T09:06:44.036 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-19T09:06:44.037 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-19T09:06:44.038 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-19T09:06:44.039 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-19T09:06:44.039 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-19T09:06:44.040 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-19T09:06:44.041 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-19T09:06:44.042 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-19T09:06:44.042 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-19T09:06:44.043 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-19T09:06:44.044 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-19T09:06:44.045 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-19T09:06:44.045 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-19T09:06:44.047 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-19T09:06:44.047 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-19T09:06:44.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:43 smithi001 ceph-mon[30939]: pgmap v416: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T09:06:44.048 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-19T09:06:44.049 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-19T09:06:44.050 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-19T09:06:44.050 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-19T09:06:44.051 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-19T09:06:44.052 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-19T09:06:44.053 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-19T09:06:44.054 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-19T09:06:44.055 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-19T09:06:44.056 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-19T09:06:44.056 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-19T09:06:44.057 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-19T09:06:44.058 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-19T09:06:44.059 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-19T09:06:44.060 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-19T09:06:44.061 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-19T09:06:44.061 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-19T09:06:44.062 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-19T09:06:44.063 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-19T09:06:44.064 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-19T09:06:44.065 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-19T09:06:44.066 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-19T09:06:44.067 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-19T09:06:44.068 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-19T09:06:44.069 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-19T09:06:44.069 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-19T09:06:44.070 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-19T09:06:44.071 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-19T09:06:44.072 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-19T09:06:44.073 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-19T09:06:44.074 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-19T09:06:44.075 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-19T09:06:44.076 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-19T09:06:44.077 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-19T09:06:44.077 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-19T09:06:44.078 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-19T09:06:44.079 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-19T09:06:44.080 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-19T09:06:44.080 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-19T09:06:44.081 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-19T09:06:44.082 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-19T09:06:44.083 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-19T09:06:44.084 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-19T09:06:44.085 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-19T09:06:44.085 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-19T09:06:44.086 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-19T09:06:44.087 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-19T09:06:44.088 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-19T09:06:44.089 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-19T09:06:44.090 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-19T09:06:44.091 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-19T09:06:44.091 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-19T09:06:44.092 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-19T09:06:44.093 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-19T09:06:44.094 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-19T09:06:44.095 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-19T09:06:44.096 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-19T09:06:44.097 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-19T09:06:44.097 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-19T09:06:44.098 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-19T09:06:44.100 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-19T09:06:44.100 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-19T09:06:44.101 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-19T09:06:44.102 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-19T09:06:44.103 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-19T09:06:44.104 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-19T09:06:44.105 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-19T09:06:44.106 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-19T09:06:44.106 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-19T09:06:44.107 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-19T09:06:44.108 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-19T09:06:44.109 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-19T09:06:44.110 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-19T09:06:44.111 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-19T09:06:44.112 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-19T09:06:44.112 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-19T09:06:44.113 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-19T09:06:44.114 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-19T09:06:44.115 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-19T09:06:44.116 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-19T09:06:44.117 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-19T09:06:44.118 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-19T09:06:44.118 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-19T09:06:44.119 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-19T09:06:44.120 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-19T09:06:44.121 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-19T09:06:44.122 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-19T09:06:44.124 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-19T09:06:44.124 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-19T09:06:44.124 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-19T09:06:44.125 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-19T09:06:44.126 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-19T09:06:44.127 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-19T09:06:44.127 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-19T09:06:44.128 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-19T09:06:44.129 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-19T09:06:44.130 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-19T09:06:44.131 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-19T09:06:44.132 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-19T09:06:44.132 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-19T09:06:44.133 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-19T09:06:44.134 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-19T09:06:44.135 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-19T09:06:44.135 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-19T09:06:44.136 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-19T09:06:44.137 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-19T09:06:44.138 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-19T09:06:44.139 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-19T09:06:44.140 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-19T09:06:44.141 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-19T09:06:44.142 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-19T09:06:44.142 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-19T09:06:44.144 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-19T09:06:44.145 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-19T09:06:44.145 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-19T09:06:44.146 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-19T09:06:44.147 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-19T09:06:44.148 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-19T09:06:44.148 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-19T09:06:44.149 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-19T09:06:44.150 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-19T09:06:44.151 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-19T09:06:44.152 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-19T09:06:44.153 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-19T09:06:44.154 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-19T09:06:44.155 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-19T09:06:44.155 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-19T09:06:44.156 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-19T09:06:44.157 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-19T09:06:44.157 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-19T09:06:44.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-19T09:06:44.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-19T09:06:44.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-19T09:06:44.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-19T09:06:44.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-19T09:06:44.162 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-19T09:06:44.163 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-19T09:06:44.164 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-19T09:06:44.165 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-19T09:06:44.165 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-19T09:06:44.166 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-19T09:06:44.167 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-19T09:06:44.168 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-19T09:06:44.169 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-19T09:06:44.170 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-19T09:06:44.170 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-19T09:06:44.171 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-19T09:06:44.172 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-19T09:06:44.173 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-19T09:06:44.174 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-19T09:06:44.175 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-19T09:06:44.175 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-19T09:06:44.176 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-19T09:06:44.177 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-19T09:06:44.178 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-19T09:06:44.179 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-19T09:06:44.179 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-19T09:06:44.180 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-19T09:06:44.181 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-19T09:06:44.182 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-19T09:06:44.183 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-19T09:06:44.183 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-19T09:06:44.184 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-19T09:06:44.185 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-19T09:06:44.186 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-19T09:06:44.187 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-19T09:06:44.188 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-19T09:06:44.189 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-19T09:06:44.190 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-19T09:06:44.190 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-19T09:06:44.191 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-19T09:06:44.192 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-19T09:06:44.193 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-19T09:06:44.194 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-19T09:06:44.195 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-19T09:06:44.196 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-19T09:06:44.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-19T09:06:44.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-19T09:06:44.198 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-19T09:06:44.199 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-19T09:06:44.200 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-19T09:06:44.201 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-19T09:06:44.202 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-19T09:06:44.203 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-19T09:06:44.203 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-19T09:06:44.204 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-19T09:06:44.205 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-19T09:06:44.206 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-19T09:06:44.207 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-19T09:06:44.208 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-19T09:06:44.209 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-19T09:06:44.210 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-19T09:06:44.210 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-19T09:06:44.211 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-19T09:06:44.212 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-19T09:06:44.213 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-19T09:06:44.214 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-19T09:06:44.214 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-19T09:06:44.215 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-19T09:06:44.216 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-19T09:06:44.217 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-19T09:06:44.217 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-19T09:06:44.218 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-19T09:06:44.219 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-19T09:06:44.220 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-19T09:06:44.220 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-19T09:06:44.221 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-19T09:06:44.222 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-19T09:06:44.223 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-19T09:06:44.224 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-19T09:06:44.225 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-19T09:06:44.226 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-19T09:06:44.226 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-19T09:06:44.227 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-19T09:06:44.228 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-19T09:06:44.229 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-19T09:06:44.230 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-19T09:06:44.231 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-19T09:06:44.232 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-19T09:06:44.233 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-19T09:06:44.233 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-19T09:06:44.234 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-19T09:06:44.235 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-19T09:06:44.236 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-19T09:06:44.237 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-19T09:06:44.237 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-19T09:06:44.238 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-19T09:06:44.239 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-19T09:06:44.240 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-19T09:06:44.241 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-19T09:06:44.242 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-19T09:06:44.243 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-19T09:06:44.243 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-19T09:06:44.244 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-19T09:06:44.245 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-19T09:06:44.246 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-19T09:06:44.247 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-19T09:06:44.248 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-19T09:06:44.249 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-19T09:06:44.250 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-19T09:06:44.250 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-19T09:06:44.251 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-19T09:06:44.252 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-19T09:06:44.253 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-19T09:06:44.254 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-19T09:06:44.254 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-19T09:06:44.255 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-19T09:06:44.256 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-19T09:06:44.257 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-19T09:06:44.258 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-19T09:06:44.258 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-19T09:06:44.259 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-19T09:06:44.260 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-19T09:06:44.261 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-19T09:06:44.262 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-19T09:06:44.263 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-19T09:06:44.264 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-19T09:06:44.265 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-19T09:06:44.266 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-19T09:06:44.266 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-19T09:06:44.267 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-19T09:06:44.268 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-19T09:06:44.269 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-19T09:06:44.270 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-19T09:06:44.271 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-19T09:06:44.272 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-19T09:06:44.273 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-19T09:06:44.273 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-19T09:06:44.274 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-19T09:06:44.275 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-19T09:06:44.276 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-19T09:06:44.277 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-19T09:06:44.278 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-19T09:06:44.279 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-19T09:06:44.280 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-19T09:06:44.281 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-19T09:06:44.282 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-19T09:06:44.282 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-19T09:06:44.283 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-19T09:06:44.284 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-19T09:06:44.285 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-19T09:06:44.286 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-19T09:06:44.286 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-19T09:06:44.287 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-19T09:06:44.288 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-19T09:06:44.289 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-19T09:06:44.290 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-19T09:06:44.291 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-19T09:06:44.291 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-19T09:06:44.292 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-19T09:06:44.293 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-19T09:06:44.294 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-19T09:06:44.294 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-19T09:06:44.295 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-19T09:06:44.296 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-19T09:06:44.297 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-19T09:06:44.298 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-19T09:06:44.299 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-19T09:06:44.299 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-19T09:06:44.300 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-19T09:06:44.301 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-19T09:06:44.302 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-19T09:06:44.303 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-19T09:06:44.304 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-19T09:06:44.305 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-19T09:06:44.306 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-19T09:06:44.306 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-19T09:06:44.307 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-19T09:06:44.308 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-19T09:06:44.309 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-19T09:06:44.310 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-19T09:06:44.310 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-19T09:06:44.311 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-19T09:06:44.312 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-19T09:06:44.313 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-19T09:06:44.314 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-19T09:06:44.314 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-19T09:06:44.315 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-19T09:06:44.317 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-19T09:06:44.317 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-19T09:06:44.318 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-19T09:06:44.319 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-19T09:06:44.320 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-19T09:06:44.321 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-19T09:06:44.321 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-19T09:06:44.323 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-19T09:06:44.323 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-19T09:06:44.324 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-19T09:06:44.325 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-19T09:06:44.326 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-19T09:06:44.327 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-19T09:06:44.328 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-19T09:06:44.328 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-19T09:06:44.329 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-19T09:06:44.330 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-19T09:06:44.331 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-19T09:06:44.332 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-19T09:06:44.333 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-19T09:06:44.334 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-19T09:06:44.334 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-19T09:06:44.335 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-19T09:06:44.336 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-19T09:06:44.337 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-19T09:06:44.338 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-19T09:06:44.339 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-19T09:06:44.340 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-19T09:06:44.341 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-19T09:06:44.341 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-19T09:06:44.342 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-19T09:06:44.343 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-19T09:06:44.344 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-19T09:06:44.345 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-19T09:06:44.346 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-19T09:06:44.347 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-19T09:06:44.348 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-19T09:06:44.349 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-19T09:06:44.349 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-19T09:06:44.350 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-19T09:06:44.351 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-19T09:06:44.352 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-19T09:06:44.353 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-19T09:06:44.354 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-19T09:06:44.355 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-19T09:06:44.356 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-19T09:06:44.357 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-19T09:06:44.357 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-19T09:06:44.358 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-19T09:06:44.359 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-19T09:06:44.360 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-19T09:06:44.361 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-19T09:06:44.362 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-19T09:06:44.363 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-19T09:06:44.364 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-19T09:06:44.365 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-19T09:06:44.366 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-19T09:06:44.367 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-19T09:06:44.368 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-19T09:06:44.369 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-19T09:06:44.370 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-19T09:06:44.370 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-19T09:06:44.372 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-19T09:06:44.373 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-19T09:06:44.373 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-19T09:06:44.374 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-19T09:06:44.376 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-19T09:06:44.377 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-19T09:06:44.377 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-19T09:06:44.378 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-19T09:06:44.380 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-19T09:06:44.380 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-19T09:06:44.381 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-19T09:06:44.382 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-19T09:06:44.383 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-19T09:06:44.384 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-19T09:06:44.385 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-19T09:06:44.386 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-19T09:06:44.387 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-19T09:06:44.388 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-19T09:06:44.389 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-19T09:06:44.390 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-19T09:06:44.391 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-19T09:06:44.392 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-19T09:06:44.393 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-19T09:06:44.394 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-19T09:06:44.394 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-19T09:06:44.395 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-19T09:06:44.396 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-19T09:06:44.397 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-19T09:06:44.398 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-19T09:06:44.399 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-19T09:06:44.400 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-19T09:06:44.401 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-19T09:06:44.401 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-19T09:06:44.402 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-19T09:06:44.403 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-19T09:06:44.404 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-19T09:06:44.585 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-19T09:06:44.585 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-19T09:06:44.586 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-19T09:06:44.587 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-19T09:06:44.588 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-19T09:06:44.589 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-19T09:06:44.590 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-19T09:06:44.591 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-19T09:06:44.592 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-19T09:06:44.593 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-19T09:06:44.594 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-19T09:06:44.595 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-19T09:06:44.596 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-19T09:06:44.597 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-19T09:06:44.598 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-19T09:06:44.598 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-19T09:06:44.599 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-19T09:06:44.600 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-19T09:06:44.601 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-19T09:06:44.602 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-19T09:06:44.603 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-19T09:06:44.604 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-19T09:06:44.605 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-19T09:06:44.606 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-19T09:06:44.606 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-19T09:06:44.607 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-19T09:06:44.608 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-19T09:06:44.609 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-19T09:06:44.610 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-19T09:06:44.611 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-19T09:06:44.612 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-19T09:06:44.613 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-19T09:06:44.613 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-19T09:06:44.614 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-19T09:06:44.615 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-19T09:06:44.616 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-19T09:06:44.617 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-19T09:06:44.618 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-19T09:06:44.618 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-19T09:06:44.619 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-19T09:06:44.620 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-19T09:06:44.621 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-19T09:06:44.622 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-19T09:06:44.623 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-19T09:06:44.624 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-19T09:06:44.624 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-19T09:06:44.625 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-19T09:06:44.626 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-19T09:06:44.627 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-19T09:06:44.628 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-19T09:06:44.629 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-19T09:06:44.630 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-19T09:06:44.630 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-19T09:06:44.631 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-19T09:06:44.632 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-19T09:06:44.633 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-19T09:06:44.634 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-19T09:06:44.635 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-19T09:06:44.636 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-19T09:06:44.637 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-19T09:06:44.637 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-19T09:06:44.638 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-19T09:06:44.639 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-19T09:06:44.640 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-19T09:06:44.641 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-19T09:06:44.642 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-19T09:06:44.643 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-19T09:06:44.644 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-19T09:06:44.645 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-19T09:06:44.645 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-19T09:06:44.646 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-19T09:06:44.647 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-19T09:06:44.649 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-19T09:06:44.650 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-19T09:06:44.651 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-19T09:06:44.652 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-19T09:06:44.652 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-19T09:06:44.653 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-19T09:06:44.654 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-19T09:06:44.655 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-19T09:06:44.656 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-19T09:06:44.657 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-19T09:06:44.657 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-19T09:06:44.658 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-19T09:06:44.659 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-19T09:06:44.660 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-19T09:06:44.661 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-19T09:06:44.662 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-19T09:06:44.663 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-19T09:06:44.664 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-19T09:06:44.665 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-19T09:06:44.665 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-19T09:06:44.666 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-19T09:06:44.667 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-19T09:06:44.668 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-19T09:06:44.669 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-19T09:06:44.670 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-19T09:06:44.671 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-19T09:06:44.672 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-19T09:06:44.672 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-19T09:06:44.673 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-19T09:06:44.674 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-19T09:06:44.675 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-19T09:06:44.676 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-19T09:06:44.677 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-19T09:06:44.677 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-19T09:06:44.678 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-19T09:06:44.679 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-19T09:06:44.680 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-19T09:06:44.682 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-19T09:06:44.683 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-19T09:06:44.684 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-19T09:06:44.685 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-19T09:06:44.686 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-19T09:06:44.686 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-19T09:06:44.687 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-19T09:06:44.688 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-19T09:06:44.690 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-19T09:06:44.690 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-19T09:06:44.692 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-19T09:06:44.692 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-19T09:06:44.693 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-19T09:06:44.694 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-19T09:06:44.695 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-19T09:06:44.696 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-19T09:06:44.697 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-19T09:06:44.697 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-19T09:06:44.698 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-19T09:06:44.699 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-19T09:06:44.700 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-19T09:06:44.701 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-19T09:06:44.703 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-19T09:06:44.704 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-19T09:06:44.705 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-19T09:06:44.705 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-19T09:06:44.706 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-19T09:06:44.707 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-19T09:06:44.708 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-19T09:06:44.709 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-19T09:06:44.710 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-19T09:06:44.710 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-19T09:06:44.711 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-19T09:06:44.712 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-19T09:06:44.713 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-19T09:06:44.714 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-19T09:06:44.715 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-19T09:06:44.716 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-19T09:06:44.717 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-19T09:06:44.718 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-19T09:06:44.719 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-19T09:06:44.720 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-19T09:06:44.721 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-19T09:06:44.722 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-19T09:06:44.723 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-19T09:06:44.724 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-19T09:06:44.725 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-19T09:06:44.726 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-19T09:06:44.726 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-19T09:06:44.727 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-19T09:06:44.728 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-19T09:06:44.729 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-19T09:06:44.731 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-19T09:06:44.732 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-19T09:06:44.733 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-19T09:06:44.734 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-19T09:06:44.735 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-19T09:06:44.736 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-19T09:06:44.737 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-19T09:06:44.738 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-19T09:06:44.739 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-19T09:06:44.740 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-19T09:06:44.740 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-19T09:06:44.741 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-19T09:06:44.742 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-19T09:06:44.743 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-19T09:06:44.744 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-19T09:06:44.745 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-19T09:06:44.746 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-19T09:06:44.747 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-19T09:06:44.748 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-19T09:06:44.749 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-19T09:06:44.750 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-19T09:06:44.751 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-19T09:06:44.752 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-19T09:06:44.753 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-19T09:06:44.753 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-19T09:06:44.754 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-19T09:06:44.755 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-19T09:06:44.756 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-19T09:06:44.757 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-19T09:06:44.757 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-19T09:06:44.758 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-19T09:06:44.759 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-19T09:06:44.761 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-19T09:06:44.761 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-19T09:06:44.762 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-19T09:06:44.763 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-19T09:06:44.765 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-19T09:06:44.765 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-19T09:06:44.766 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-19T09:06:44.768 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-19T09:06:44.769 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-19T09:06:44.770 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-19T09:06:44.771 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-19T09:06:44.772 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-19T09:06:44.773 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-19T09:06:44.774 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-19T09:06:44.775 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-19T09:06:44.775 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-19T09:06:44.776 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-19T09:06:44.777 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-19T09:06:44.778 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-19T09:06:44.779 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-19T09:06:44.780 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-19T09:06:44.781 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-19T09:06:44.782 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-19T09:06:44.783 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-19T09:06:44.784 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-19T09:06:44.785 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-19T09:06:44.786 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-19T09:06:44.787 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-19T09:06:44.788 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-19T09:06:44.789 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-19T09:06:44.790 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-19T09:06:44.790 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-19T09:06:44.791 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-19T09:06:44.792 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-19T09:06:44.793 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-19T09:06:44.794 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-19T09:06:44.794 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-19T09:06:44.795 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-19T09:06:44.796 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-19T09:06:44.797 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-19T09:06:44.800 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-19T09:06:44.801 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-19T09:06:44.801 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-19T09:06:44.801 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-19T09:06:44.802 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-19T09:06:44.803 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-19T09:06:44.804 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-19T09:06:44.805 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-19T09:06:44.806 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-19T09:06:44.807 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-19T09:06:44.808 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-19T09:06:44.809 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-19T09:06:44.810 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-19T09:06:44.811 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-19T09:06:44.812 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-19T09:06:44.813 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-19T09:06:44.814 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-19T09:06:44.815 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-19T09:06:44.816 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-19T09:06:44.817 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-19T09:06:44.818 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-19T09:06:44.819 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-19T09:06:44.819 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-19T09:06:44.820 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-19T09:06:44.821 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-19T09:06:44.822 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-19T09:06:44.823 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-19T09:06:44.824 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-19T09:06:44.825 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-19T09:06:44.826 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-19T09:06:44.827 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-19T09:06:44.828 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-19T09:06:44.828 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-19T09:06:44.829 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-19T09:06:44.830 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-19T09:06:44.831 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-19T09:06:44.832 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-19T09:06:44.833 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-19T09:06:44.834 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-19T09:06:44.835 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-19T09:06:44.836 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-19T09:06:44.837 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-19T09:06:44.838 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-19T09:06:44.839 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-19T09:06:44.840 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-19T09:06:44.841 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-19T09:06:44.842 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-19T09:06:44.843 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-19T09:06:44.844 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-19T09:06:44.844 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-19T09:06:44.845 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-19T09:06:44.846 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-19T09:06:44.847 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-19T09:06:44.848 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-19T09:06:44.850 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-19T09:06:44.851 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-19T09:06:44.851 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-19T09:06:44.853 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-19T09:06:44.853 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-19T09:06:44.854 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-19T09:06:44.855 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-19T09:06:44.856 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-19T09:06:44.857 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-19T09:06:44.858 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-19T09:06:44.859 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-19T09:06:44.861 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-19T09:06:44.861 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-19T09:06:44.862 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-19T09:06:44.863 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-19T09:06:44.864 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-19T09:06:44.865 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-19T09:06:44.866 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-19T09:06:44.867 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-19T09:06:44.868 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-19T09:06:44.869 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-19T09:06:44.869 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-19T09:06:44.870 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-19T09:06:44.871 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-19T09:06:44.872 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-19T09:06:44.873 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-19T09:06:44.874 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-19T09:06:44.875 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-19T09:06:44.876 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-19T09:06:44.877 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-19T09:06:44.878 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-19T09:06:44.879 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-19T09:06:44.880 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-19T09:06:44.881 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-19T09:06:44.882 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-19T09:06:44.883 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-19T09:06:44.884 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-19T09:06:44.885 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-19T09:06:44.886 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-19T09:06:44.887 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-19T09:06:44.887 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-19T09:06:44.888 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-19T09:06:44.889 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-19T09:06:44.890 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-19T09:06:44.891 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-19T09:06:44.892 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-19T09:06:44.893 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-19T09:06:44.894 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-19T09:06:44.894 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-19T09:06:44.895 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-19T09:06:44.896 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-19T09:06:44.897 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-19T09:06:44.898 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-19T09:06:44.899 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-19T09:06:44.900 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-19T09:06:44.901 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-19T09:06:44.902 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-19T09:06:44.903 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-19T09:06:44.904 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-19T09:06:44.905 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-19T09:06:44.906 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-19T09:06:44.906 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-19T09:06:44.907 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-19T09:06:44.908 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-19T09:06:44.909 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-19T09:06:44.910 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-19T09:06:44.912 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-19T09:06:44.912 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-19T09:06:44.913 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-19T09:06:44.914 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-19T09:06:44.915 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-19T09:06:44.916 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-19T09:06:44.917 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-19T09:06:44.918 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-19T09:06:44.919 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-19T09:06:44.920 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-19T09:06:44.920 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-19T09:06:44.921 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-19T09:06:44.922 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-19T09:06:44.923 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-19T09:06:44.924 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-19T09:06:44.925 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-19T09:06:44.925 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-19T09:06:44.927 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-19T09:06:44.928 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-19T09:06:44.929 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-19T09:06:44.930 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-19T09:06:44.931 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-19T09:06:44.932 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-19T09:06:44.933 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-19T09:06:44.934 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-19T09:06:44.935 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-19T09:06:44.937 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-19T09:06:44.938 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-19T09:06:44.940 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-19T09:06:44.940 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-19T09:06:44.943 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-19T09:06:44.943 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-19T09:06:44.943 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-19T09:06:44.944 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-19T09:06:44.945 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-19T09:06:44.946 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-19T09:06:44.947 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-19T09:06:44.949 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-19T09:06:44.950 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-19T09:06:44.951 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-19T09:06:44.952 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-19T09:06:44.953 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-19T09:06:44.954 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-19T09:06:44.955 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-19T09:06:44.956 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-19T09:06:44.957 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-19T09:06:44.958 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-19T09:06:44.960 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-19T09:06:44.961 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-19T09:06:44.962 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-19T09:06:44.963 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-19T09:06:44.964 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-19T09:06:44.965 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-19T09:06:44.966 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-19T09:06:44.967 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-19T09:06:44.968 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-19T09:06:44.969 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-19T09:06:44.970 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-19T09:06:44.971 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-19T09:06:44.972 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-19T09:06:44.973 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-19T09:06:44.974 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-19T09:06:44.976 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-19T09:06:44.977 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-19T09:06:44.978 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-19T09:06:44.979 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-19T09:06:44.980 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-19T09:06:44.981 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-19T09:06:44.982 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-19T09:06:44.983 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-19T09:06:44.984 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-19T09:06:44.985 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-19T09:06:44.986 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-19T09:06:44.987 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-19T09:06:44.989 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-19T09:06:44.989 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-19T09:06:44.991 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-19T09:06:44.992 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-19T09:06:44.993 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-19T09:06:44.994 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-19T09:06:44.995 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-19T09:06:44.996 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-19T09:06:44.997 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-19T09:06:44.998 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-19T09:06:45.000 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-19T09:06:45.001 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-19T09:06:45.002 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-19T09:06:45.003 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-19T09:06:45.004 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-19T09:06:45.005 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-19T09:06:45.006 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-19T09:06:45.007 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-19T09:06:45.008 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-19T09:06:45.009 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-19T09:06:45.010 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-19T09:06:45.012 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-19T09:06:45.013 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-19T09:06:45.013 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-19T09:06:45.015 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-19T09:06:45.016 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-19T09:06:45.017 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-19T09:06:45.018 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-19T09:06:45.019 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-19T09:06:45.020 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-19T09:06:45.021 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-19T09:06:45.022 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-19T09:06:45.023 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-19T09:06:45.024 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-19T09:06:45.026 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-19T09:06:45.026 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-19T09:06:45.028 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-19T09:06:45.029 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-19T09:06:45.030 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-19T09:06:45.031 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-19T09:06:45.032 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-19T09:06:45.033 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-19T09:06:45.034 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-19T09:06:45.035 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-19T09:06:45.036 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-19T09:06:45.037 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-19T09:06:45.038 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-19T09:06:45.040 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-19T09:06:45.040 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-19T09:06:45.042 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-19T09:06:45.043 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-19T09:06:45.044 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-19T09:06:45.045 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-19T09:06:45.046 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-19T09:06:45.047 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-19T09:06:45.048 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-19T09:06:45.049 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-19T09:06:45.050 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-19T09:06:45.051 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-19T09:06:45.052 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-19T09:06:45.053 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-19T09:06:45.055 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-19T09:06:45.056 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-19T09:06:45.057 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-19T09:06:45.058 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-19T09:06:45.059 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-19T09:06:45.060 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-19T09:06:45.061 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-19T09:06:45.062 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-19T09:06:45.063 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-19T09:06:45.064 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-19T09:06:45.065 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-19T09:06:45.066 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-19T09:06:45.067 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-19T09:06:45.068 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-19T09:06:45.069 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-19T09:06:45.070 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-19T09:06:45.071 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-19T09:06:45.073 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-19T09:06:45.074 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-19T09:06:45.075 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-19T09:06:45.076 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-19T09:06:45.077 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-19T09:06:45.078 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-19T09:06:45.079 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-19T09:06:45.080 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-19T09:06:45.081 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-19T09:06:45.082 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-19T09:06:45.083 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-19T09:06:45.084 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-19T09:06:45.085 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-19T09:06:45.086 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-19T09:06:45.087 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-19T09:06:45.088 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-19T09:06:45.089 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-19T09:06:45.090 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-19T09:06:45.091 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-19T09:06:45.092 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-19T09:06:45.093 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-19T09:06:45.094 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-19T09:06:45.095 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-19T09:06:45.096 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-19T09:06:45.097 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-19T09:06:45.098 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-19T09:06:45.099 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-19T09:06:45.100 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-19T09:06:45.101 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-19T09:06:45.102 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-19T09:06:45.103 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-19T09:06:45.104 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-19T09:06:45.105 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-19T09:06:45.107 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-19T09:06:45.107 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-19T09:06:45.108 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-19T09:06:45.109 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-19T09:06:45.110 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-19T09:06:45.112 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-19T09:06:45.113 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-19T09:06:45.114 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-19T09:06:45.115 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-19T09:06:45.116 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-19T09:06:45.117 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-19T09:06:45.118 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-19T09:06:45.119 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-19T09:06:45.120 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-19T09:06:45.121 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-19T09:06:45.122 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-19T09:06:45.123 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-19T09:06:45.124 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-19T09:06:45.125 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-19T09:06:45.126 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-19T09:06:45.127 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-19T09:06:45.128 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-19T09:06:45.129 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-19T09:06:45.130 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-19T09:06:45.131 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-19T09:06:45.132 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-19T09:06:45.133 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-19T09:06:45.134 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-19T09:06:45.135 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-19T09:06:45.136 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-19T09:06:45.137 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-19T09:06:45.138 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-19T09:06:45.140 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-19T09:06:45.141 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-19T09:06:45.144 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-19T09:06:45.144 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-19T09:06:45.144 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-19T09:06:45.145 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-19T09:06:45.146 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-19T09:06:45.147 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-19T09:06:45.148 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-19T09:06:45.149 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-19T09:06:45.150 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-19T09:06:45.151 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-19T09:06:45.152 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-19T09:06:45.153 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-19T09:06:45.154 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-19T09:06:45.155 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-19T09:06:45.156 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-19T09:06:45.157 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-19T09:06:45.158 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-19T09:06:45.159 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-19T09:06:45.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-19T09:06:45.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-19T09:06:45.162 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-19T09:06:45.164 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-19T09:06:45.164 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-19T09:06:45.166 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-19T09:06:45.167 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-19T09:06:45.168 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-19T09:06:45.169 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-19T09:06:45.170 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-19T09:06:45.171 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-19T09:06:45.172 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-19T09:06:45.173 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-19T09:06:45.174 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-19T09:06:45.175 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-19T09:06:45.176 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-19T09:06:45.177 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-19T09:06:45.178 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-19T09:06:45.179 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-19T09:06:45.180 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-19T09:06:45.181 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-19T09:06:45.182 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-19T09:06:45.183 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-19T09:06:45.184 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-19T09:06:45.185 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-19T09:06:45.186 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-19T09:06:45.187 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-19T09:06:45.188 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-19T09:06:45.189 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-19T09:06:45.190 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-19T09:06:45.192 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-19T09:06:45.192 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-19T09:06:45.194 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-19T09:06:45.195 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-19T09:06:45.196 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-19T09:06:45.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-19T09:06:45.198 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-19T09:06:45.199 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-19T09:06:45.200 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-19T09:06:45.201 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-19T09:06:45.202 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-19T09:06:45.203 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-19T09:06:45.204 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-19T09:06:45.205 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-19T09:06:45.206 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-19T09:06:45.208 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-19T09:06:45.209 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-19T09:06:45.209 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-19T09:06:45.211 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-19T09:06:45.212 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-19T09:06:45.213 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-19T09:06:45.214 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-19T09:06:45.215 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-19T09:06:45.216 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-19T09:06:45.217 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-19T09:06:45.218 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-19T09:06:45.219 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-19T09:06:45.220 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-19T09:06:45.221 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-19T09:06:45.222 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-19T09:06:45.223 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-19T09:06:45.224 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-19T09:06:45.225 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-19T09:06:45.226 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-19T09:06:45.228 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-19T09:06:45.229 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-19T09:06:45.230 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-19T09:06:45.231 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-19T09:06:45.232 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-19T09:06:45.234 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-19T09:06:45.234 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-19T09:06:45.236 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-19T09:06:45.237 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-19T09:06:45.238 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-19T09:06:45.239 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-19T09:06:45.240 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-19T09:06:45.242 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-19T09:06:45.243 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-19T09:06:45.244 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-19T09:06:45.245 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-19T09:06:45.246 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-19T09:06:45.247 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-19T09:06:45.248 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-19T09:06:45.249 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-19T09:06:45.251 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-19T09:06:45.251 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-19T09:06:45.253 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-19T09:06:45.253 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-19T09:06:45.255 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-19T09:06:45.256 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-19T09:06:45.257 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-19T09:06:45.258 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-19T09:06:45.259 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-19T09:06:45.260 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-19T09:06:45.261 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-19T09:06:45.262 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-19T09:06:45.263 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-19T09:06:45.264 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-19T09:06:45.266 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-19T09:06:45.267 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-19T09:06:45.268 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-19T09:06:45.269 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-19T09:06:45.270 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-19T09:06:45.271 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-19T09:06:45.272 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-19T09:06:45.273 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-19T09:06:45.274 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-19T09:06:45.275 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-19T09:06:45.276 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-19T09:06:45.277 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-19T09:06:45.278 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-19T09:06:45.279 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-19T09:06:45.280 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-19T09:06:45.282 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-19T09:06:45.283 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-19T09:06:45.284 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-19T09:06:45.285 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-19T09:06:45.286 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-19T09:06:45.287 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-19T09:06:45.288 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-19T09:06:45.289 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-19T09:06:45.290 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-19T09:06:45.291 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-19T09:06:45.292 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-19T09:06:45.293 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-19T09:06:45.295 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-19T09:06:45.296 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-19T09:06:45.297 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-19T09:06:45.298 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-19T09:06:45.299 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-19T09:06:45.300 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-19T09:06:45.301 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-19T09:06:45.302 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-19T09:06:45.303 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-19T09:06:45.304 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-19T09:06:45.305 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-19T09:06:45.306 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-19T09:06:45.307 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-19T09:06:45.308 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-19T09:06:45.309 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-19T09:06:45.310 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-19T09:06:45.311 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-19T09:06:45.312 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-19T09:06:45.313 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-19T09:06:45.314 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-19T09:06:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-19T09:06:45.315 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-19T09:06:45.316 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-19T09:06:45.317 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-19T09:06:45.318 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-19T09:06:45.319 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-19T09:06:45.319 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-19T09:06:45.320 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-19T09:06:45.321 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-19T09:06:45.322 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-19T09:06:45.323 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-19T09:06:45.324 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-19T09:06:45.325 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-19T09:06:45.326 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-19T09:06:45.326 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-19T09:06:45.327 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-19T09:06:45.328 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-19T09:06:45.329 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-19T09:06:45.330 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-19T09:06:45.331 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-19T09:06:45.332 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-19T09:06:45.332 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-19T09:06:45.333 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-19T09:06:45.334 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-19T09:06:45.335 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-19T09:06:45.336 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-19T09:06:45.337 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-19T09:06:45.337 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-19T09:06:45.338 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-19T09:06:45.339 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-19T09:06:45.340 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-19T09:06:45.341 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-19T09:06:45.342 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-19T09:06:45.342 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-19T09:06:45.343 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-19T09:06:45.344 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-19T09:06:45.345 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-19T09:06:45.345 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-19T09:06:45.348 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-19T09:06:45.348 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-19T09:06:45.348 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-19T09:06:45.349 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-19T09:06:45.350 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-19T09:06:45.351 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-19T09:06:45.352 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-19T09:06:45.353 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-19T09:06:45.354 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-19T09:06:45.355 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-19T09:06:45.356 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-19T09:06:45.357 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-19T09:06:45.357 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-19T09:06:45.358 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-19T09:06:45.359 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-19T09:06:45.360 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-19T09:06:45.361 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-19T09:06:45.362 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-19T09:06:45.363 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-19T09:06:45.363 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-19T09:06:45.364 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-19T09:06:45.365 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-19T09:06:45.366 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-19T09:06:45.367 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-19T09:06:45.368 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-19T09:06:45.369 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-19T09:06:45.370 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-19T09:06:45.371 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-19T09:06:45.372 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-19T09:06:45.373 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-19T09:06:45.374 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-19T09:06:45.375 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-19T09:06:45.376 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-19T09:06:45.377 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-19T09:06:45.377 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-19T09:06:45.378 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-19T09:06:45.379 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-19T09:06:45.380 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-19T09:06:45.381 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-19T09:06:45.382 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-19T09:06:45.383 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-19T09:06:45.384 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-19T09:06:45.385 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-19T09:06:45.386 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-19T09:06:45.387 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-19T09:06:45.389 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-19T09:06:45.390 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-19T09:06:45.391 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-19T09:06:45.391 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-19T09:06:45.392 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-19T09:06:45.393 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-19T09:06:45.394 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-19T09:06:45.395 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-19T09:06:45.396 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-19T09:06:45.397 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-19T09:06:45.398 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-19T09:06:45.399 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-19T09:06:45.400 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-19T09:06:45.401 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-19T09:06:45.402 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-19T09:06:45.403 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-19T09:06:45.403 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-19T09:06:45.404 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-19T09:06:45.405 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-19T09:06:45.406 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-19T09:06:45.407 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-19T09:06:45.408 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-19T09:06:45.409 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-19T09:06:45.410 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-19T09:06:45.411 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-19T09:06:45.412 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-19T09:06:45.413 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-19T09:06:45.414 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-19T09:06:45.415 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-19T09:06:45.415 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-19T09:06:45.416 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-19T09:06:45.417 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-19T09:06:45.418 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-19T09:06:45.419 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-19T09:06:45.420 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-19T09:06:45.421 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-19T09:06:45.422 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-19T09:06:45.423 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-19T09:06:45.424 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-19T09:06:45.425 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-19T09:06:45.426 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-19T09:06:45.427 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-19T09:06:45.428 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-19T09:06:45.428 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-19T09:06:45.429 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-19T09:06:45.430 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-19T09:06:45.431 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-19T09:06:45.432 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-19T09:06:45.433 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-19T09:06:45.434 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-19T09:06:45.435 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-19T09:06:45.436 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-19T09:06:45.437 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-19T09:06:45.438 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-19T09:06:45.439 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-19T09:06:45.440 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-19T09:06:45.440 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-19T09:06:45.441 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-19T09:06:45.442 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-19T09:06:45.443 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-19T09:06:45.443 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-19T09:06:45.445 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-19T09:06:45.445 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-19T09:06:45.446 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-19T09:06:45.447 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-19T09:06:45.448 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-19T09:06:45.449 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-19T09:06:45.450 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-19T09:06:45.452 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-19T09:06:45.452 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-19T09:06:45.454 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-19T09:06:45.454 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-19T09:06:45.455 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-19T09:06:45.455 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-19T09:06:45.456 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-19T09:06:45.457 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-19T09:06:45.458 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-19T09:06:45.459 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-19T09:06:45.460 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-19T09:06:45.461 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-19T09:06:45.462 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-19T09:06:45.462 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-19T09:06:45.463 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-19T09:06:45.464 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-19T09:06:45.465 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-19T09:06:45.466 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-19T09:06:45.467 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-19T09:06:45.469 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-19T09:06:45.469 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-19T09:06:45.470 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-19T09:06:45.471 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-19T09:06:45.472 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-19T09:06:45.473 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-19T09:06:45.474 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-19T09:06:45.475 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-19T09:06:45.477 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-19T09:06:45.478 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-19T09:06:45.479 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-19T09:06:45.479 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-19T09:06:45.481 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-19T09:06:45.481 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-19T09:06:45.482 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-19T09:06:45.483 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-19T09:06:45.484 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-19T09:06:45.485 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-19T09:06:45.486 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-19T09:06:45.487 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-19T09:06:45.488 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-19T09:06:45.489 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-19T09:06:45.490 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-19T09:06:45.491 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-19T09:06:45.492 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-19T09:06:45.492 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-19T09:06:45.493 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-19T09:06:45.494 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-19T09:06:45.495 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-19T09:06:45.496 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-19T09:06:45.497 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-19T09:06:45.498 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-19T09:06:45.499 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-19T09:06:45.500 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-19T09:06:45.501 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-19T09:06:45.502 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-19T09:06:45.503 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-19T09:06:45.504 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-19T09:06:45.505 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-19T09:06:45.506 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-19T09:06:45.507 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-19T09:06:45.508 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-19T09:06:45.508 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-19T09:06:45.509 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-19T09:06:45.510 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-19T09:06:45.511 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-19T09:06:45.512 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-19T09:06:45.513 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-19T09:06:45.513 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-19T09:06:45.514 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-19T09:06:45.515 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-19T09:06:45.516 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-19T09:06:45.517 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-19T09:06:45.518 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-19T09:06:45.519 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-19T09:06:45.519 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-19T09:06:45.520 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-19T09:06:45.521 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-19T09:06:45.522 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-19T09:06:45.523 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-19T09:06:45.524 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-19T09:06:45.525 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-19T09:06:45.526 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-19T09:06:45.527 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-19T09:06:45.528 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-19T09:06:45.529 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-19T09:06:45.530 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-19T09:06:45.531 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-19T09:06:45.532 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-19T09:06:45.533 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-19T09:06:45.534 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-19T09:06:45.535 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-19T09:06:45.536 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-19T09:06:45.537 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-19T09:06:45.538 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-19T09:06:45.539 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-19T09:06:45.540 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-19T09:06:45.540 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-19T09:06:45.541 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-19T09:06:45.542 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-19T09:06:45.543 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-19T09:06:45.543 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-19T09:06:45.544 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-19T09:06:45.545 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-19T09:06:45.546 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-19T09:06:45.547 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-19T09:06:45.547 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-19T09:06:45.548 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-19T09:06:45.549 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-19T09:06:45.550 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-19T09:06:45.552 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-19T09:06:45.552 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-19T09:06:45.552 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-19T09:06:45.553 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-19T09:06:45.554 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-19T09:06:45.555 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-19T09:06:45.556 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-19T09:06:45.556 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-19T09:06:45.800 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-19T09:06:45.800 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-19T09:06:45.802 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-19T09:06:45.803 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-19T09:06:45.804 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-19T09:06:45.805 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-19T09:06:45.805 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-19T09:06:45.806 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-19T09:06:45.807 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-19T09:06:45.808 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-19T09:06:45.809 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-19T09:06:45.810 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-19T09:06:45.812 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-19T09:06:45.813 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-19T09:06:45.813 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-19T09:06:45.814 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-19T09:06:45.815 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-19T09:06:45.816 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-19T09:06:45.817 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-19T09:06:45.818 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-19T09:06:45.820 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-19T09:06:45.820 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-19T09:06:45.821 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-19T09:06:45.823 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-19T09:06:45.824 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-19T09:06:45.825 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-19T09:06:45.826 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-19T09:06:45.827 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-19T09:06:45.828 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-19T09:06:45.829 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-19T09:06:45.830 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-19T09:06:45.831 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-19T09:06:45.832 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-19T09:06:45.833 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-19T09:06:45.834 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-19T09:06:45.834 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-19T09:06:45.835 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-19T09:06:45.836 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-19T09:06:45.837 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-19T09:06:45.838 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-19T09:06:45.839 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-19T09:06:45.840 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-19T09:06:45.841 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-19T09:06:45.842 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-19T09:06:45.843 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-19T09:06:45.844 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-19T09:06:45.845 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-19T09:06:45.846 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-19T09:06:45.847 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-19T09:06:45.847 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-19T09:06:45.848 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-19T09:06:45.849 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-19T09:06:45.851 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-19T09:06:45.852 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-19T09:06:45.853 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-19T09:06:45.854 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-19T09:06:45.855 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-19T09:06:45.855 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:45 smithi064 ceph-mon[35179]: pgmap v417: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7.6 KiB/s wr, 49 op/s 2024-09-19T09:06:45.856 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-19T09:06:45.856 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-19T09:06:45.857 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-19T09:06:45.858 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-19T09:06:45.859 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-19T09:06:45.860 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-19T09:06:45.861 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-19T09:06:45.862 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-19T09:06:45.863 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-19T09:06:45.864 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-19T09:06:45.865 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-19T09:06:45.866 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-19T09:06:45.867 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-19T09:06:45.868 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-19T09:06:45.869 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-19T09:06:45.870 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-19T09:06:45.871 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-19T09:06:45.872 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-19T09:06:45.872 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-19T09:06:45.873 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-19T09:06:45.874 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-19T09:06:45.875 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-19T09:06:45.876 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-19T09:06:45.877 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-19T09:06:45.878 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-19T09:06:45.879 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-19T09:06:45.880 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-19T09:06:45.881 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-19T09:06:45.881 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-19T09:06:45.882 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-19T09:06:45.883 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-19T09:06:45.884 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-19T09:06:45.885 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-19T09:06:45.886 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-19T09:06:45.887 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-19T09:06:45.888 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-19T09:06:45.889 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-19T09:06:45.890 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-19T09:06:45.891 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-19T09:06:45.891 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-19T09:06:45.892 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-19T09:06:45.893 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-19T09:06:45.894 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-19T09:06:45.895 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-19T09:06:45.896 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-19T09:06:45.897 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-19T09:06:45.898 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-19T09:06:45.899 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-19T09:06:45.900 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-19T09:06:45.901 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-19T09:06:45.901 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-19T09:06:45.902 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-19T09:06:45.903 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-19T09:06:45.905 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-19T09:06:45.906 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-19T09:06:45.907 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-19T09:06:45.907 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-19T09:06:45.908 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-19T09:06:45.909 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-19T09:06:45.910 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-19T09:06:45.911 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-19T09:06:45.912 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/ 2024-09-19T09:06:45.913 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-19T09:06:45.914 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-19T09:06:45.915 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-19T09:06:45.916 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-19T09:06:45.917 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-19T09:06:45.917 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-19T09:06:45.918 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-19T09:06:45.919 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-19T09:06:45.920 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-19T09:06:45.921 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-19T09:06:45.922 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-19T09:06:45.923 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-19T09:06:45.924 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-19T09:06:45.925 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-19T09:06:45.925 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-19T09:06:45.926 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-19T09:06:45.927 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-19T09:06:45.929 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-19T09:06:45.929 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-19T09:06:45.930 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-19T09:06:45.931 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-19T09:06:45.932 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-19T09:06:45.933 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-19T09:06:45.934 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-19T09:06:45.935 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-19T09:06:45.936 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-19T09:06:45.937 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-19T09:06:45.938 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-19T09:06:45.938 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-19T09:06:45.939 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-19T09:06:45.940 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-19T09:06:45.941 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-19T09:06:45.942 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-19T09:06:45.943 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-19T09:06:45.944 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-19T09:06:45.945 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-19T09:06:45.946 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-19T09:06:45.946 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-19T09:06:45.947 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-19T09:06:45.948 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-19T09:06:45.949 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-19T09:06:45.950 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-19T09:06:45.951 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-19T09:06:45.952 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-19T09:06:45.952 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-19T09:06:45.953 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-19T09:06:45.954 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-19T09:06:45.955 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-19T09:06:45.956 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-19T09:06:45.957 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-19T09:06:45.960 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-19T09:06:45.961 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-19T09:06:45.961 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-19T09:06:45.961 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-19T09:06:45.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:45 smithi022 ceph-mon[35107]: pgmap v417: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7.6 KiB/s wr, 49 op/s 2024-09-19T09:06:45.962 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-19T09:06:45.962 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-19T09:06:45.962 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-19T09:06:45.963 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-19T09:06:45.964 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-19T09:06:45.965 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-19T09:06:45.966 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-19T09:06:45.967 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-19T09:06:45.968 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-19T09:06:45.969 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-19T09:06:45.970 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-19T09:06:45.971 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-19T09:06:45.972 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-19T09:06:45.972 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-19T09:06:45.973 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-19T09:06:45.974 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-19T09:06:45.976 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-19T09:06:45.977 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-19T09:06:45.978 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-19T09:06:45.978 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-19T09:06:45.979 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-19T09:06:45.980 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-19T09:06:45.981 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-19T09:06:45.982 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-19T09:06:45.983 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-19T09:06:45.984 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-19T09:06:45.985 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-19T09:06:45.985 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-19T09:06:45.986 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-19T09:06:45.987 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-19T09:06:45.988 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-19T09:06:45.989 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-19T09:06:45.990 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-19T09:06:45.991 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-19T09:06:45.992 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-19T09:06:45.993 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-19T09:06:45.994 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-19T09:06:45.995 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-19T09:06:45.996 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-19T09:06:45.996 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-19T09:06:45.997 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-19T09:06:45.998 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-19T09:06:45.999 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-19T09:06:46.000 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-19T09:06:46.000 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-19T09:06:46.001 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-19T09:06:46.002 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-19T09:06:46.003 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-19T09:06:46.004 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-19T09:06:46.005 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-19T09:06:46.005 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-19T09:06:46.006 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-19T09:06:46.007 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-19T09:06:46.008 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-19T09:06:46.009 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-19T09:06:46.010 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-19T09:06:46.010 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-19T09:06:46.011 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-19T09:06:46.012 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-19T09:06:46.013 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-19T09:06:46.014 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-19T09:06:46.014 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-19T09:06:46.015 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-19T09:06:46.016 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-19T09:06:46.017 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-19T09:06:46.017 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-19T09:06:46.018 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-19T09:06:46.019 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-19T09:06:46.020 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-19T09:06:46.021 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-19T09:06:46.021 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-19T09:06:46.022 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-19T09:06:46.023 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-19T09:06:46.024 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-19T09:06:46.025 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-19T09:06:46.027 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-19T09:06:46.027 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-19T09:06:46.028 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-19T09:06:46.029 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-19T09:06:46.030 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-19T09:06:46.030 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-19T09:06:46.031 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-19T09:06:46.032 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-19T09:06:46.033 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-19T09:06:46.034 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-19T09:06:46.035 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-19T09:06:46.035 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-19T09:06:46.036 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-19T09:06:46.037 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-19T09:06:46.038 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-19T09:06:46.039 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-19T09:06:46.040 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-19T09:06:46.041 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-19T09:06:46.042 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-19T09:06:46.043 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-19T09:06:46.044 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-19T09:06:46.045 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-19T09:06:46.046 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-19T09:06:46.046 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-19T09:06:46.047 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-19T09:06:46.048 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-19T09:06:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:45 smithi001 ceph-mon[30939]: pgmap v417: 97 pgs: 97 active+clean; 65 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7.6 KiB/s wr, 49 op/s 2024-09-19T09:06:46.049 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-19T09:06:46.050 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-19T09:06:46.050 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-19T09:06:46.051 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-19T09:06:46.052 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-19T09:06:46.053 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-19T09:06:46.054 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-19T09:06:46.055 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-19T09:06:46.056 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-19T09:06:46.057 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-19T09:06:46.057 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-19T09:06:46.058 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-19T09:06:46.059 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/ 2024-09-19T09:06:46.060 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-19T09:06:46.061 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-19T09:06:46.062 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-19T09:06:46.062 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-19T09:06:46.063 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-19T09:06:46.064 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-19T09:06:46.065 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-19T09:06:46.066 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-19T09:06:46.068 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-19T09:06:46.068 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-19T09:06:46.069 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-19T09:06:46.070 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-19T09:06:46.071 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-19T09:06:46.073 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-19T09:06:46.073 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-19T09:06:46.075 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-19T09:06:46.075 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-19T09:06:46.076 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-19T09:06:46.077 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-19T09:06:46.078 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-19T09:06:46.078 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-19T09:06:46.079 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hid/ 2024-09-19T09:06:46.080 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-19T09:06:46.081 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-19T09:06:46.081 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-19T09:06:46.082 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-19T09:06:46.083 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-19T09:06:46.084 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-19T09:06:46.085 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-19T09:06:46.086 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-19T09:06:46.087 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-19T09:06:46.087 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-19T09:06:46.088 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-19T09:06:46.089 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-19T09:06:46.090 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-19T09:06:46.091 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-19T09:06:46.092 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-19T09:06:46.092 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-19T09:06:46.094 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-19T09:06:46.094 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-19T09:06:46.095 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-19T09:06:46.096 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-19T09:06:46.097 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-19T09:06:46.098 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-19T09:06:46.099 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-19T09:06:46.100 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-19T09:06:46.101 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-19T09:06:46.102 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-19T09:06:46.103 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-19T09:06:46.103 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-19T09:06:46.104 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-19T09:06:46.105 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-19T09:06:46.106 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-19T09:06:46.106 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-19T09:06:46.107 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-19T09:06:46.108 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-19T09:06:46.109 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-19T09:06:46.110 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-19T09:06:46.111 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-19T09:06:46.112 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-19T09:06:46.113 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-19T09:06:46.114 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-19T09:06:46.115 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-19T09:06:46.116 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-19T09:06:46.117 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-19T09:06:46.118 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-19T09:06:46.118 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-19T09:06:46.119 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-19T09:06:46.120 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-19T09:06:46.121 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-19T09:06:46.122 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-19T09:06:46.123 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-19T09:06:46.124 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-19T09:06:46.125 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-19T09:06:46.125 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-19T09:06:46.126 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-19T09:06:46.127 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-19T09:06:46.128 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-19T09:06:46.129 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-19T09:06:46.130 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-19T09:06:46.131 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-19T09:06:46.131 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-19T09:06:46.132 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-19T09:06:46.133 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-19T09:06:46.134 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-19T09:06:46.135 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-19T09:06:46.136 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-19T09:06:46.137 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-19T09:06:46.138 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-19T09:06:46.139 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-19T09:06:46.139 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-19T09:06:46.140 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-19T09:06:46.141 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-19T09:06:46.142 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-19T09:06:46.143 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-19T09:06:46.144 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-19T09:06:46.145 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-19T09:06:46.145 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-19T09:06:46.146 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-19T09:06:46.147 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-19T09:06:46.148 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-19T09:06:46.149 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-19T09:06:46.150 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-19T09:06:46.151 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-19T09:06:46.152 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-19T09:06:46.153 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-19T09:06:46.154 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-19T09:06:46.154 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-19T09:06:46.156 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-19T09:06:46.157 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-19T09:06:46.157 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-19T09:06:46.157 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-19T09:06:46.158 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-19T09:06:46.159 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-19T09:06:46.160 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-19T09:06:46.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-19T09:06:46.162 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-19T09:06:46.162 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-19T09:06:46.163 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-19T09:06:46.164 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-19T09:06:46.168 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-19T09:06:46.168 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-19T09:06:46.168 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-19T09:06:46.169 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-19T09:06:46.169 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-19T09:06:46.169 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-19T09:06:46.171 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-19T09:06:46.172 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-19T09:06:46.172 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-19T09:06:46.174 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-19T09:06:46.174 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-19T09:06:46.175 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-19T09:06:46.175 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-19T09:06:46.176 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-19T09:06:46.177 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-19T09:06:46.178 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-19T09:06:46.179 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-19T09:06:46.180 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-19T09:06:46.181 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-19T09:06:46.182 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-19T09:06:46.183 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-19T09:06:46.183 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-19T09:06:46.184 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-19T09:06:46.185 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-19T09:06:46.186 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-19T09:06:46.187 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-19T09:06:46.188 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-19T09:06:46.189 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-19T09:06:46.190 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-19T09:06:46.191 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-19T09:06:46.191 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-19T09:06:46.192 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-19T09:06:46.193 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-19T09:06:46.194 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-19T09:06:46.195 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-19T09:06:46.196 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-19T09:06:46.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-19T09:06:46.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-19T09:06:46.199 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-19T09:06:46.200 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-19T09:06:46.201 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-19T09:06:46.202 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-19T09:06:46.203 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-19T09:06:46.204 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-19T09:06:46.205 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-19T09:06:46.205 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-19T09:06:46.206 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-19T09:06:46.207 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-19T09:06:46.208 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-19T09:06:46.209 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-19T09:06:46.209 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-19T09:06:46.211 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-19T09:06:46.211 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-19T09:06:46.212 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-19T09:06:46.213 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-19T09:06:46.214 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-19T09:06:46.215 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-19T09:06:46.216 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-19T09:06:46.217 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-19T09:06:46.218 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-19T09:06:46.219 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-19T09:06:46.220 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-19T09:06:46.221 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-19T09:06:46.221 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-19T09:06:46.222 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-19T09:06:46.223 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-19T09:06:46.224 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-19T09:06:46.225 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-19T09:06:46.226 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-19T09:06:46.227 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-19T09:06:46.228 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-19T09:06:46.229 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-19T09:06:46.230 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-19T09:06:46.231 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-19T09:06:46.232 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-19T09:06:46.233 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-19T09:06:46.234 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-19T09:06:46.235 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-19T09:06:46.236 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-19T09:06:46.236 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-19T09:06:46.237 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-19T09:06:46.238 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-19T09:06:46.239 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-19T09:06:46.240 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-19T09:06:46.241 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-19T09:06:46.242 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-19T09:06:46.243 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-19T09:06:46.244 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-19T09:06:46.244 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-19T09:06:46.245 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-19T09:06:46.246 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-19T09:06:46.247 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-19T09:06:46.248 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-19T09:06:46.249 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-19T09:06:46.250 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-19T09:06:46.434 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-19T09:06:46.435 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-19T09:06:46.435 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-19T09:06:46.436 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-19T09:06:46.437 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-19T09:06:46.438 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-19T09:06:46.438 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ide/ 2024-09-19T09:06:46.439 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-19T09:06:46.440 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-19T09:06:46.441 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-19T09:06:46.441 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-19T09:06:46.442 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-19T09:06:46.443 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-19T09:06:46.444 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-19T09:06:46.445 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-19T09:06:46.445 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-19T09:06:46.446 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-19T09:06:46.447 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-19T09:06:46.447 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-19T09:06:46.448 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-19T09:06:46.449 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/init.txt 2024-09-19T09:06:46.450 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-19T09:06:46.450 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/ 2024-09-19T09:06:46.451 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-19T09:06:46.452 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-19T09:06:46.453 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-19T09:06:46.453 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-19T09:06:46.454 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-19T09:06:46.455 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-19T09:06:46.455 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-19T09:06:46.456 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-19T09:06:46.457 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-19T09:06:46.458 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-19T09:06:46.458 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-19T09:06:46.459 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-19T09:06:46.460 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-19T09:06:46.460 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-19T09:06:46.461 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-19T09:06:46.462 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-19T09:06:46.463 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-19T09:06:46.463 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-19T09:06:46.464 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-19T09:06:46.465 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-19T09:06:46.465 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-19T09:06:46.466 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-19T09:06:46.467 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-19T09:06:46.468 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-19T09:06:46.468 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-19T09:06:46.469 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-19T09:06:46.470 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-19T09:06:46.470 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-19T09:06:46.471 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-19T09:06:46.472 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-19T09:06:46.473 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-19T09:06:46.473 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-19T09:06:46.474 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-19T09:06:46.475 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-19T09:06:46.476 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-19T09:06:46.477 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-19T09:06:46.478 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-19T09:06:46.479 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-19T09:06:46.480 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-19T09:06:46.481 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-19T09:06:46.481 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-19T09:06:46.482 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-19T09:06:46.483 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-19T09:06:46.484 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-19T09:06:46.485 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-19T09:06:46.485 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-19T09:06:46.486 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-19T09:06:46.487 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-19T09:06:46.487 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-19T09:06:46.488 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-19T09:06:46.489 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-19T09:06:46.489 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-19T09:06:46.490 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-19T09:06:46.491 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-19T09:06:46.492 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-19T09:06:46.492 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-19T09:06:46.493 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-19T09:06:46.494 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-19T09:06:46.494 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-19T09:06:46.495 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-19T09:06:46.496 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-19T09:06:46.497 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-19T09:06:46.497 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-19T09:06:46.498 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-19T09:06:46.499 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-19T09:06:46.499 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-19T09:06:46.500 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-19T09:06:46.501 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-19T09:06:46.502 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-19T09:06:46.502 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-19T09:06:46.503 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-19T09:06:46.504 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-19T09:06:46.504 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-19T09:06:46.505 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-19T09:06:46.506 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-19T09:06:46.507 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-19T09:06:46.507 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/java.txt 2024-09-19T09:06:46.508 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-19T09:06:46.509 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-19T09:06:46.510 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-19T09:06:46.510 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-19T09:06:46.511 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-19T09:06:46.512 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-19T09:06:46.513 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-19T09:06:46.514 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-19T09:06:46.515 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-19T09:06:46.516 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-19T09:06:46.516 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-19T09:06:46.517 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-19T09:06:46.518 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-19T09:06:46.519 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-19T09:06:46.519 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-19T09:06:46.521 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-19T09:06:46.523 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-19T09:06:46.524 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-19T09:06:46.525 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-19T09:06:46.526 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-19T09:06:46.526 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-19T09:06:46.527 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-19T09:06:46.529 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-19T09:06:46.530 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-19T09:06:46.530 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-19T09:06:46.531 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-19T09:06:46.532 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-19T09:06:46.533 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-19T09:06:46.533 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-19T09:06:46.534 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-19T09:06:46.535 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-19T09:06:46.536 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-19T09:06:46.537 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-19T09:06:46.538 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-19T09:06:46.539 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-19T09:06:46.540 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-19T09:06:46.540 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-19T09:06:46.541 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-19T09:06:46.542 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-19T09:06:46.543 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/ 2024-09-19T09:06:46.544 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-19T09:06:46.544 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-19T09:06:46.545 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-19T09:06:46.546 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-19T09:06:46.547 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-19T09:06:46.548 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-19T09:06:46.549 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-19T09:06:46.549 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-19T09:06:46.550 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-19T09:06:46.551 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-19T09:06:46.552 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-19T09:06:46.552 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-19T09:06:46.553 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/ 2024-09-19T09:06:46.554 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-19T09:06:46.555 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-19T09:06:46.555 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-19T09:06:46.556 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-19T09:06:46.557 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-19T09:06:46.558 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-19T09:06:46.559 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-19T09:06:46.560 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-19T09:06:46.560 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-19T09:06:46.561 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-19T09:06:46.562 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-19T09:06:46.563 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-19T09:06:46.564 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-19T09:06:46.565 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-19T09:06:46.566 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-19T09:06:46.567 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-19T09:06:46.568 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-19T09:06:46.569 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-19T09:06:46.570 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-19T09:06:46.571 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-19T09:06:46.572 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/md.txt 2024-09-19T09:06:46.573 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-19T09:06:46.573 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-19T09:06:46.666 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-19T09:06:46.667 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-19T09:06:46.668 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-19T09:06:46.668 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/metag/ 2024-09-19T09:06:46.669 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-19T09:06:46.670 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-19T09:06:46.670 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/ 2024-09-19T09:06:46.671 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-19T09:06:46.672 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-19T09:06:46.673 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-19T09:06:46.673 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-19T09:06:46.674 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-19T09:06:46.675 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-19T09:06:46.675 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-19T09:06:46.676 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-19T09:06:46.677 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-19T09:06:46.678 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-19T09:06:46.679 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mips/ 2024-09-19T09:06:46.680 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-19T09:06:46.680 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-19T09:06:46.681 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-19T09:06:46.682 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-19T09:06:46.683 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-19T09:06:46.684 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-19T09:06:46.685 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-19T09:06:46.685 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-19T09:06:46.686 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-19T09:06:46.687 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-19T09:06:46.688 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-19T09:06:46.689 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-19T09:06:46.689 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-19T09:06:46.690 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-19T09:06:46.690 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-19T09:06:46.691 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-19T09:06:46.692 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-19T09:06:46.693 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-19T09:06:46.694 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-19T09:06:46.694 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-19T09:06:46.695 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-19T09:06:46.696 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-19T09:06:46.697 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-19T09:06:46.698 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-19T09:06:46.700 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-19T09:06:46.700 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-19T09:06:46.701 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-19T09:06:46.702 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-19T09:06:46.703 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-19T09:06:46.703 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-19T09:06:46.704 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-19T09:06:46.706 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-19T09:06:46.707 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-19T09:06:46.707 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-19T09:06:46.708 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-19T09:06:46.709 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-19T09:06:46.710 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-19T09:06:46.710 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-19T09:06:46.711 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-19T09:06:46.712 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-19T09:06:46.712 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-19T09:06:46.713 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-19T09:06:46.714 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-19T09:06:46.715 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-19T09:06:46.716 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-19T09:06:46.717 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ 2024-09-19T09:06:46.718 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-19T09:06:46.718 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-19T09:06:46.719 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-19T09:06:46.720 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-19T09:06:46.721 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-19T09:06:46.722 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-19T09:06:46.723 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-19T09:06:46.724 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-19T09:06:46.725 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-19T09:06:46.725 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-19T09:06:46.726 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-19T09:06:46.727 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-19T09:06:46.728 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-19T09:06:46.729 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-19T09:06:46.730 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-19T09:06:46.731 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-19T09:06:46.731 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-19T09:06:46.732 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-19T09:06:46.733 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-19T09:06:46.734 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-19T09:06:46.736 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-19T09:06:46.737 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-19T09:06:46.737 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-19T09:06:46.738 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-19T09:06:46.739 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-19T09:06:46.740 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-19T09:06:46.741 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-19T09:06:46.742 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-19T09:06:46.743 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-19T09:06:46.744 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-19T09:06:46.744 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-19T09:06:46.745 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-19T09:06:46.746 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-19T09:06:46.747 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-19T09:06:46.747 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-19T09:06:46.748 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-19T09:06:46.749 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-19T09:06:46.750 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-19T09:06:46.751 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-19T09:06:46.752 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-19T09:06:46.752 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-19T09:06:46.753 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-19T09:06:46.754 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-19T09:06:46.755 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-19T09:06:46.755 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-19T09:06:46.756 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-19T09:06:46.757 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-19T09:06:46.758 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-19T09:06:46.758 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-19T09:06:46.760 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-19T09:06:46.761 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-19T09:06:46.761 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-19T09:06:46.762 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-19T09:06:46.763 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-19T09:06:46.764 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-19T09:06:46.765 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-19T09:06:46.766 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-19T09:06:46.766 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-19T09:06:46.767 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-19T09:06:46.768 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-19T09:06:46.769 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-19T09:06:46.770 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-19T09:06:46.770 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-19T09:06:46.771 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-19T09:06:46.772 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-19T09:06:46.773 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-19T09:06:46.774 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-19T09:06:46.775 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-19T09:06:46.776 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-19T09:06:46.777 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-19T09:06:46.778 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-19T09:06:46.779 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-19T09:06:46.780 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-19T09:06:46.781 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-19T09:06:46.784 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-19T09:06:46.784 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-19T09:06:46.784 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-19T09:06:46.785 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-19T09:06:46.786 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-19T09:06:46.787 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-19T09:06:46.788 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-19T09:06:46.789 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-19T09:06:46.790 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-19T09:06:46.791 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-19T09:06:46.792 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-19T09:06:46.793 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-19T09:06:46.794 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-19T09:06:46.794 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-19T09:06:46.795 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-19T09:06:46.796 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-19T09:06:46.797 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-19T09:06:46.798 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-19T09:06:46.798 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-19T09:06:46.799 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-19T09:06:46.800 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-19T09:06:46.801 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-19T09:06:46.802 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-19T09:06:46.803 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-19T09:06:46.804 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-19T09:06:46.805 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-19T09:06:46.806 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-19T09:06:46.807 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-19T09:06:46.807 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-19T09:06:46.808 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-19T09:06:46.809 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-19T09:06:46.810 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-19T09:06:46.811 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-19T09:06:46.812 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-19T09:06:46.813 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-19T09:06:46.814 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-19T09:06:46.815 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-19T09:06:46.816 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-19T09:06:46.817 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-19T09:06:46.818 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-19T09:06:46.819 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-19T09:06:46.820 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-19T09:06:46.821 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-19T09:06:46.821 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-19T09:06:46.822 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-19T09:06:46.823 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-19T09:06:46.824 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-19T09:06:46.825 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-19T09:06:46.825 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-19T09:06:46.826 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-19T09:06:46.827 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-19T09:06:46.828 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-19T09:06:46.830 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-19T09:06:46.831 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-19T09:06:46.832 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-19T09:06:46.834 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-19T09:06:46.835 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-19T09:06:46.836 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-19T09:06:46.838 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-19T09:06:46.839 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-19T09:06:46.840 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-19T09:06:46.841 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-19T09:06:46.843 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-19T09:06:46.844 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-19T09:06:46.845 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-19T09:06:46.847 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-19T09:06:46.848 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-19T09:06:46.849 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-19T09:06:46.851 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-19T09:06:46.852 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-19T09:06:46.854 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-19T09:06:46.855 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-19T09:06:46.856 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-19T09:06:46.858 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-19T09:06:46.859 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-19T09:06:46.861 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-19T09:06:46.862 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-19T09:06:46.864 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-19T09:06:46.865 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-19T09:06:46.866 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-19T09:06:46.868 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-19T09:06:46.869 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-19T09:06:46.871 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-19T09:06:46.872 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-19T09:06:46.873 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-19T09:06:46.875 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-19T09:06:46.876 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/phy/ 2024-09-19T09:06:46.878 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-19T09:06:46.879 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-19T09:06:46.881 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-19T09:06:46.882 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/platform/ 2024-09-19T09:06:46.883 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-19T09:06:46.885 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-19T09:06:46.886 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/ 2024-09-19T09:06:46.888 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-19T09:06:46.889 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-19T09:06:46.890 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-19T09:06:46.891 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-19T09:06:46.893 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-19T09:06:46.894 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-19T09:06:46.895 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-19T09:06:46.897 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-19T09:06:46.898 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-19T09:06:46.900 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-19T09:06:46.901 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-19T09:06:46.902 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-19T09:06:46.904 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-19T09:06:46.905 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-19T09:06:46.906 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-19T09:06:46.908 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-19T09:06:46.909 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-19T09:06:46.910 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-19T09:06:46.911 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-19T09:06:46.913 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-19T09:06:46.914 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-19T09:06:46.916 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-19T09:06:46.917 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-19T09:06:46.919 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-19T09:06:46.920 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-19T09:06:46.921 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-19T09:06:46.923 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-19T09:06:46.924 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-19T09:06:46.926 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-19T09:06:46.927 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-19T09:06:46.928 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-19T09:06:46.930 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-19T09:06:46.931 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-19T09:06:46.932 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-19T09:06:46.934 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-19T09:06:46.935 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-19T09:06:46.936 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-19T09:06:46.937 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-19T09:06:46.939 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-19T09:06:46.940 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-19T09:06:46.941 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-19T09:06:46.943 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-19T09:06:46.944 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-19T09:06:46.945 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-19T09:06:46.947 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-19T09:06:46.948 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-19T09:06:46.949 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pps/ 2024-09-19T09:06:46.951 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-19T09:06:46.952 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-19T09:06:46.953 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-19T09:06:46.955 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-19T09:06:46.956 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-19T09:06:46.957 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-19T09:06:46.959 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-19T09:06:46.960 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-19T09:06:46.961 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-19T09:06:46.963 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-19T09:06:46.964 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-19T09:06:46.965 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pti/ 2024-09-19T09:06:46.966 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-19T09:06:46.967 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-19T09:06:46.967 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-19T09:06:46.968 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-19T09:06:46.969 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-19T09:06:46.970 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-19T09:06:46.971 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-19T09:06:46.972 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-19T09:06:46.973 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-19T09:06:46.974 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-19T09:06:46.975 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-19T09:06:46.976 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-19T09:06:46.977 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-19T09:06:46.978 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-19T09:06:46.979 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-19T09:06:46.979 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-19T09:06:46.980 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-19T09:06:46.981 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-19T09:06:46.982 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-19T09:06:46.983 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-19T09:06:46.983 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/ 2024-09-19T09:06:46.984 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-19T09:06:46.985 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-19T09:06:46.986 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-19T09:06:46.988 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-19T09:06:46.988 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-19T09:06:46.989 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-19T09:06:46.990 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-19T09:06:46.990 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-19T09:06:46.991 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-19T09:06:46.992 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-19T09:06:46.993 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-19T09:06:46.994 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-19T09:06:46.994 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-19T09:06:46.995 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-19T09:06:46.997 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-19T09:06:46.997 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-19T09:06:46.997 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-19T09:06:46.998 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-19T09:06:46.999 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-19T09:06:47.000 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-19T09:06:47.001 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-19T09:06:47.002 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-19T09:06:47.003 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-19T09:06:47.004 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-19T09:06:47.004 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-19T09:06:47.005 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-19T09:06:47.006 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-19T09:06:47.007 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-19T09:06:47.008 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-19T09:06:47.009 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-19T09:06:47.010 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-19T09:06:47.011 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-19T09:06:47.012 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-19T09:06:47.013 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-19T09:06:47.014 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-19T09:06:47.015 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-19T09:06:47.015 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-19T09:06:47.016 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-19T09:06:47.017 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-19T09:06:47.018 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-19T09:06:47.019 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-19T09:06:47.020 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-19T09:06:47.021 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-19T09:06:47.021 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-19T09:06:47.022 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-19T09:06:47.024 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-19T09:06:47.024 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-19T09:06:47.025 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-19T09:06:47.026 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-19T09:06:47.027 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-19T09:06:47.028 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-19T09:06:47.029 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-19T09:06:47.029 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-19T09:06:47.030 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-19T09:06:47.031 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-19T09:06:47.032 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-19T09:06:47.033 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-19T09:06:47.034 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-19T09:06:47.035 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-19T09:06:47.036 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-19T09:06:47.036 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-19T09:06:47.037 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-19T09:06:47.038 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-19T09:06:47.039 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-19T09:06:47.040 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-19T09:06:47.041 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-19T09:06:47.042 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-19T09:06:47.043 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-19T09:06:47.044 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-19T09:06:47.045 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-19T09:06:47.045 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-19T09:06:47.047 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-19T09:06:47.047 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-19T09:06:47.049 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-19T09:06:47.049 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-19T09:06:47.050 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-19T09:06:47.051 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-19T09:06:47.052 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-19T09:06:47.052 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-19T09:06:47.053 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-19T09:06:47.054 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-19T09:06:47.055 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-19T09:06:47.056 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-19T09:06:47.057 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-19T09:06:47.058 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-19T09:06:47.058 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/ 2024-09-19T09:06:47.059 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-19T09:06:47.060 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-19T09:06:47.061 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-19T09:06:47.062 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-19T09:06:47.063 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-19T09:06:47.064 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-19T09:06:47.065 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-19T09:06:47.065 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-19T09:06:47.066 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-19T09:06:47.067 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-19T09:06:47.068 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-19T09:06:47.068 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-19T09:06:47.069 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-19T09:06:47.070 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-19T09:06:47.071 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/ 2024-09-19T09:06:47.071 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-19T09:06:47.072 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-19T09:06:47.073 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-19T09:06:47.074 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-19T09:06:47.075 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-19T09:06:47.077 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-19T09:06:47.078 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-19T09:06:47.078 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-19T09:06:47.080 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-19T09:06:47.081 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sh/ 2024-09-19T09:06:47.081 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-19T09:06:47.082 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-19T09:06:47.083 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-19T09:06:47.084 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/ 2024-09-19T09:06:47.085 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-19T09:06:47.085 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-19T09:06:47.086 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-19T09:06:47.087 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-19T09:06:47.088 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-19T09:06:47.089 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-19T09:06:47.090 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-19T09:06:47.091 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-19T09:06:47.092 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-19T09:06:47.093 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-19T09:06:47.094 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-19T09:06:47.095 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-19T09:06:47.096 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-19T09:06:47.097 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-19T09:06:47.098 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-19T09:06:47.099 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-19T09:06:47.100 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-19T09:06:47.101 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-19T09:06:47.101 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-19T09:06:47.103 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-19T09:06:47.103 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-19T09:06:47.104 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-19T09:06:47.105 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-19T09:06:47.106 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-19T09:06:47.107 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-19T09:06:47.108 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-19T09:06:47.109 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-19T09:06:47.109 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-19T09:06:47.110 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-19T09:06:47.111 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-19T09:06:47.112 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-19T09:06:47.113 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-19T09:06:47.114 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-19T09:06:47.115 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-19T09:06:47.116 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-19T09:06:47.117 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-19T09:06:47.118 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-19T09:06:47.119 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-19T09:06:47.120 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-19T09:06:47.121 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-19T09:06:47.121 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-19T09:06:47.122 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-19T09:06:47.123 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-19T09:06:47.124 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-19T09:06:47.125 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-19T09:06:47.126 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-19T09:06:47.127 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-19T09:06:47.127 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-19T09:06:47.128 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-19T09:06:47.129 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-19T09:06:47.130 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-19T09:06:47.131 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-19T09:06:47.132 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-19T09:06:47.133 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-19T09:06:47.134 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-19T09:06:47.135 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-19T09:06:47.135 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-19T09:06:47.136 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-19T09:06:47.137 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-19T09:06:47.138 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-19T09:06:47.139 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-19T09:06:47.139 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-19T09:06:47.140 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-19T09:06:47.141 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/ 2024-09-19T09:06:47.142 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-19T09:06:47.143 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-19T09:06:47.144 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-19T09:06:47.145 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-19T09:06:47.146 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-19T09:06:47.147 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-19T09:06:47.148 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-19T09:06:47.148 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-19T09:06:47.149 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-19T09:06:47.150 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-19T09:06:47.150 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-19T09:06:47.151 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-19T09:06:47.152 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-19T09:06:47.154 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-19T09:06:47.155 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-19T09:06:47.156 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-19T09:06:47.157 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-19T09:06:47.158 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-19T09:06:47.158 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-19T09:06:47.159 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-19T09:06:47.160 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-19T09:06:47.161 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-19T09:06:47.163 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-19T09:06:47.163 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-19T09:06:47.164 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-19T09:06:47.165 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-19T09:06:47.166 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-19T09:06:47.168 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/target/ 2024-09-19T09:06:47.168 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-19T09:06:47.169 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-19T09:06:47.170 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-19T09:06:47.171 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-19T09:06:47.172 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-19T09:06:47.172 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-19T09:06:47.173 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-19T09:06:47.174 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-19T09:06:47.175 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-19T09:06:47.176 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-19T09:06:47.176 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-19T09:06:47.177 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-19T09:06:47.178 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/ 2024-09-19T09:06:47.179 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-19T09:06:47.180 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-19T09:06:47.181 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-19T09:06:47.182 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-19T09:06:47.183 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-19T09:06:47.183 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-19T09:06:47.184 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-19T09:06:47.185 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-19T09:06:47.186 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-19T09:06:47.187 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-19T09:06:47.188 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-19T09:06:47.189 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-19T09:06:47.190 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-19T09:06:47.191 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/ 2024-09-19T09:06:47.192 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-19T09:06:47.193 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-19T09:06:47.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-19T09:06:47.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-19T09:06:47.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-19T09:06:47.197 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-19T09:06:47.198 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-19T09:06:47.199 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-19T09:06:47.200 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-19T09:06:47.201 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-19T09:06:47.202 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-19T09:06:47.203 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-19T09:06:47.204 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-19T09:06:47.205 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-19T09:06:47.206 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-19T09:06:47.207 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-19T09:06:47.207 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-19T09:06:47.208 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-19T09:06:47.210 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-19T09:06:47.211 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-19T09:06:47.212 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/ 2024-09-19T09:06:47.213 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-19T09:06:47.213 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-19T09:06:47.214 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-19T09:06:47.215 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-19T09:06:47.216 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-19T09:06:47.217 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-19T09:06:47.218 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-19T09:06:47.219 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-19T09:06:47.220 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-19T09:06:47.221 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-19T09:06:47.222 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-19T09:06:47.223 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-19T09:06:47.223 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-19T09:06:47.224 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-19T09:06:47.226 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-19T09:06:47.226 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-19T09:06:47.227 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-19T09:06:47.228 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-19T09:06:47.229 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-19T09:06:47.230 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-19T09:06:47.231 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-19T09:06:47.232 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-19T09:06:47.232 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-19T09:06:47.233 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-19T09:06:47.234 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-19T09:06:47.234 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-19T09:06:47.235 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-19T09:06:47.236 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-19T09:06:47.237 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-19T09:06:47.238 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-19T09:06:47.239 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-19T09:06:47.240 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-19T09:06:47.240 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-19T09:06:47.241 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-19T09:06:47.242 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-19T09:06:47.243 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-19T09:06:47.243 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-19T09:06:47.244 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-19T09:06:47.245 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-19T09:06:47.246 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-19T09:06:47.247 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-19T09:06:47.247 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-19T09:06:47.248 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-19T09:06:47.249 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-19T09:06:47.250 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-19T09:06:47.250 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-19T09:06:47.251 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-19T09:06:47.252 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-19T09:06:47.253 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-19T09:06:47.254 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-19T09:06:47.254 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-19T09:06:47.255 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-19T09:06:47.256 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-19T09:06:47.257 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-19T09:06:47.258 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-19T09:06:47.258 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-19T09:06:47.259 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-19T09:06:47.260 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-19T09:06:47.261 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-19T09:06:47.262 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-19T09:06:47.263 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-19T09:06:47.263 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-19T09:06:47.264 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-19T09:06:47.265 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-19T09:06:47.266 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-19T09:06:47.267 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-19T09:06:47.268 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-19T09:06:47.268 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-19T09:06:47.269 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-19T09:06:47.270 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-19T09:06:47.271 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-19T09:06:47.272 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-19T09:06:47.274 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-19T09:06:47.274 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-19T09:06:47.275 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-19T09:06:47.277 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-19T09:06:47.277 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-19T09:06:47.277 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-19T09:06:47.278 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-19T09:06:47.279 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-19T09:06:47.280 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-19T09:06:47.281 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-19T09:06:47.282 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-19T09:06:47.283 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-19T09:06:47.284 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-19T09:06:47.284 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-19T09:06:47.285 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-19T09:06:47.286 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-19T09:06:47.287 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-19T09:06:47.288 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-19T09:06:47.289 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-19T09:06:47.290 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-19T09:06:47.290 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-19T09:06:47.291 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-19T09:06:47.293 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-19T09:06:47.293 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-19T09:06:47.294 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-19T09:06:47.295 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-19T09:06:47.296 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-19T09:06:47.296 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-19T09:06:47.297 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-19T09:06:47.298 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-19T09:06:47.299 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-19T09:06:47.300 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-19T09:06:47.302 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-19T09:06:47.303 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-19T09:06:47.304 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-19T09:06:47.305 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-19T09:06:47.307 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-19T09:06:47.308 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-19T09:06:47.309 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-19T09:06:47.310 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-19T09:06:47.311 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-19T09:06:47.313 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-19T09:06:47.313 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-19T09:06:47.315 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-19T09:06:47.316 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-19T09:06:47.317 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-19T09:06:47.318 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-19T09:06:47.319 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-19T09:06:47.320 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-19T09:06:47.321 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-19T09:06:47.322 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-19T09:06:47.323 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-19T09:06:47.324 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-19T09:06:47.326 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-19T09:06:47.327 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-19T09:06:47.328 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-19T09:06:47.329 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-19T09:06:47.330 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-19T09:06:47.331 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-19T09:06:47.332 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-19T09:06:47.333 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-19T09:06:47.334 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-19T09:06:47.335 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-19T09:06:47.337 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-19T09:06:47.338 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-19T09:06:47.339 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-19T09:06:47.340 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-19T09:06:47.341 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-19T09:06:47.342 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-19T09:06:47.343 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-19T09:06:47.344 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-19T09:06:47.345 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-19T09:06:47.346 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-19T09:06:47.347 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-19T09:06:47.348 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-19T09:06:47.349 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-19T09:06:47.350 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-19T09:06:47.351 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-19T09:06:47.352 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/ 2024-09-19T09:06:47.353 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-19T09:06:47.354 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-19T09:06:47.355 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-19T09:06:47.356 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-19T09:06:47.357 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-19T09:06:47.358 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-19T09:06:47.359 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-19T09:06:47.361 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-19T09:06:47.361 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-19T09:06:47.363 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-19T09:06:47.364 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-19T09:06:47.364 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-19T09:06:47.365 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-19T09:06:47.366 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-19T09:06:47.368 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-19T09:06:47.369 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-19T09:06:47.370 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-19T09:06:47.371 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-19T09:06:47.372 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-19T09:06:47.373 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-19T09:06:47.374 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-19T09:06:47.375 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-19T09:06:47.376 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-19T09:06:47.377 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-19T09:06:47.378 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-19T09:06:47.380 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/ 2024-09-19T09:06:47.381 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-19T09:06:47.382 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-19T09:06:47.383 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-19T09:06:47.384 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-19T09:06:47.385 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-19T09:06:47.386 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-19T09:06:47.387 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-19T09:06:47.388 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-19T09:06:47.389 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-19T09:06:47.390 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-19T09:06:47.391 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-19T09:06:47.392 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-19T09:06:47.393 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-19T09:06:47.394 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-19T09:06:47.395 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-19T09:06:47.396 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-19T09:06:47.397 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-19T09:06:47.400 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-19T09:06:47.400 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-19T09:06:47.400 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-19T09:06:47.401 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-19T09:06:47.402 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-19T09:06:47.403 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-19T09:06:47.404 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-19T09:06:47.405 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-19T09:06:47.406 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-19T09:06:47.407 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-19T09:06:47.408 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-19T09:06:47.409 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-19T09:06:47.410 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-19T09:06:47.411 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-19T09:06:47.412 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-19T09:06:47.413 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-19T09:06:47.415 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-19T09:06:47.415 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/ 2024-09-19T09:06:47.417 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-19T09:06:47.418 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-19T09:06:47.418 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-19T09:06:47.420 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-19T09:06:47.421 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-19T09:06:47.422 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-19T09:06:47.423 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-19T09:06:47.424 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-19T09:06:47.425 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-19T09:06:47.426 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-19T09:06:47.427 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-19T09:06:47.428 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-19T09:06:47.430 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-19T09:06:47.431 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-19T09:06:47.432 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-19T09:06:47.433 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-19T09:06:47.435 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-19T09:06:47.436 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-19T09:06:47.437 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-19T09:06:47.438 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-19T09:06:47.440 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-19T09:06:47.441 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-19T09:06:47.442 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-19T09:06:47.443 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-19T09:06:47.444 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-19T09:06:47.445 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-19T09:06:47.446 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-19T09:06:47.447 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-19T09:06:47.447 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-19T09:06:47.449 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-19T09:06:47.450 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-19T09:06:47.451 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-19T09:06:47.452 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-19T09:06:47.452 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-19T09:06:47.453 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-19T09:06:47.455 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-19T09:06:47.455 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-19T09:06:47.457 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-19T09:06:47.457 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-19T09:06:47.458 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-19T09:06:47.459 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-19T09:06:47.460 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-19T09:06:47.461 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-19T09:06:47.462 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-19T09:06:47.463 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-19T09:06:47.464 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-19T09:06:47.465 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-19T09:06:47.466 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-19T09:06:47.696 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-19T09:06:47.697 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-19T09:06:47.699 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-19T09:06:47.700 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-19T09:06:47.702 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-19T09:06:47.703 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-19T09:06:47.704 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-19T09:06:47.706 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-19T09:06:47.708 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-19T09:06:47.709 INFO:tasks.workunit.client.0.smithi001.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-19T09:06:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:47 smithi064 ceph-mon[35179]: pgmap v418: 97 pgs: 97 active+clean; 67 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 204 KiB/s wr, 80 op/s 2024-09-19T09:06:47.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:47 smithi022 ceph-mon[35107]: pgmap v418: 97 pgs: 97 active+clean; 67 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 204 KiB/s wr, 80 op/s 2024-09-19T09:06:48.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:47 smithi001 ceph-mon[30939]: pgmap v418: 97 pgs: 97 active+clean; 67 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 204 KiB/s wr, 80 op/s 2024-09-19T09:06:49.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:49 smithi064 ceph-mon[35179]: pgmap v419: 97 pgs: 97 active+clean; 67 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 205 KiB/s wr, 87 op/s 2024-09-19T09:06:49.860 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:49 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:06:49.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:49 smithi022 ceph-mon[35107]: pgmap v419: 97 pgs: 97 active+clean; 67 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 205 KiB/s wr, 87 op/s 2024-09-19T09:06:49.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:49 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:06:50.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:49 smithi001 ceph-mon[30939]: pgmap v419: 97 pgs: 97 active+clean; 67 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 205 KiB/s wr, 87 op/s 2024-09-19T09:06:50.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:49 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:06:51.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:51 smithi064 ceph-mon[35179]: pgmap v420: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 437 KiB/s wr, 100 op/s 2024-09-19T09:06:51.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:51 smithi022 ceph-mon[35107]: pgmap v420: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 437 KiB/s wr, 100 op/s 2024-09-19T09:06:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:51 smithi001 ceph-mon[30939]: pgmap v420: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 437 KiB/s wr, 100 op/s 2024-09-19T09:06:52.635 INFO:tasks.workunit.client.0.smithi001.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-19T09:06:53.564 INFO:tasks.workunit.client.0.smithi001.stderr:+ tar xf doc.tar 2024-09-19T09:06:53.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:53 smithi064 ceph-mon[35179]: pgmap v421: 97 pgs: 97 active+clean; 73 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 791 KiB/s wr, 100 op/s 2024-09-19T09:06:53.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:53 smithi022 ceph-mon[35107]: pgmap v421: 97 pgs: 97 active+clean; 73 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 791 KiB/s wr, 100 op/s 2024-09-19T09:06:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:53 smithi001 ceph-mon[30939]: pgmap v421: 97 pgs: 97 active+clean; 73 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 791 KiB/s wr, 100 op/s 2024-09-19T09:06:55.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:55 smithi064 ceph-mon[35179]: pgmap v422: 97 pgs: 97 active+clean; 74 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 895 KiB/s wr, 125 op/s 2024-09-19T09:06:55.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:55 smithi022 ceph-mon[35107]: pgmap v422: 97 pgs: 97 active+clean; 74 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 895 KiB/s wr, 125 op/s 2024-09-19T09:06:56.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:55 smithi001 ceph-mon[30939]: pgmap v422: 97 pgs: 97 active+clean; 74 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 895 KiB/s wr, 125 op/s 2024-09-19T09:06:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 -- 172.21.15.1:0/153263145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348102d50 msgr2=0x7f83481031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 --2- 172.21.15.1:0/153263145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348102d50 0x7f83481031d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f833c009900 tx=0x7f833c02a410 comp rx=0 tx=0).stop 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 -- 172.21.15.1:0/153263145 shutdown_connections 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 --2- 172.21.15.1:0/153263145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8348103710 0x7f8348109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 --2- 172.21.15.1:0/153263145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348102d50 0x7f83481031d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 --2- 172.21.15.1:0/153263145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8348101b60 0x7f8348101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 -- 172.21.15.1:0/153263145 >> 172.21.15.1:0/153263145 conn(0x7f83480fd2e0 msgr2=0x7f83480ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 -- 172.21.15.1:0/153263145 shutdown_connections 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.425+0000 7f834d552640 1 -- 172.21.15.1:0/153263145 wait complete. 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f834d552640 1 Processor -- start 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f834d552640 1 -- start start 2024-09-19T09:06:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f834d552640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348101b60 0x7f8348075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f834d552640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8348102d50 0x7f83480745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f834d552640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8348103710 0x7f8348074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f834d552640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f834810d940 con 0x7f8348101b60 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f834d552640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f834810d7c0 con 0x7f8348102d50 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f834d552640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f834810dac0 con 0x7f8348103710 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f8346ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348101b60 0x7f8348075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f8346ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348101b60 0x7f8348075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43828/0 (socket says 172.21.15.1:43828) 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f8346ffd640 1 -- 172.21.15.1:0/2653172904 learned_addr learned my addr 172.21.15.1:0/2653172904 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f83467fc640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8348102d50 0x7f83480745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f83477fe640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8348103710 0x7f8348074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f8346ffd640 1 -- 172.21.15.1:0/2653172904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8348103710 msgr2=0x7f8348074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f8346ffd640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8348103710 0x7f8348074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f8346ffd640 1 -- 172.21.15.1:0/2653172904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8348102d50 msgr2=0x7f83480745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f8346ffd640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8348102d50 0x7f83480745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.426+0000 7f8346ffd640 1 -- 172.21.15.1:0/2653172904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83480753b0 con 0x7f8348101b60 2024-09-19T09:06:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.427+0000 7f8346ffd640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348101b60 0x7f8348075fa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f833800e9c0 tx=0x7f833800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.427+0000 7f832ffff640 1 -- 172.21.15.1:0/2653172904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833800cde0 con 0x7f8348101b60 2024-09-19T09:06:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.427+0000 7f834d552640 1 -- 172.21.15.1:0/2653172904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83481a20b0 con 0x7f8348101b60 2024-09-19T09:06:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.427+0000 7f832ffff640 1 -- 172.21.15.1:0/2653172904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8338010930 con 0x7f8348101b60 2024-09-19T09:06:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.427+0000 7f832ffff640 1 -- 172.21.15.1:0/2653172904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8338018a20 con 0x7f8348101b60 2024-09-19T09:06:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.427+0000 7f834d552640 1 -- 172.21.15.1:0/2653172904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83481a2620 con 0x7f8348101b60 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f832ffff640 1 -- 172.21.15.1:0/2653172904 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f8338018c20 con 0x7f8348101b60 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f83503cb740 1 Processor -- start 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f83503cb740 1 -- start start 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f83503cb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3b69a0 0x56348a3b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f83503cb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 0x56348a3bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f83503cb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3bc370 0x56348a3be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f83503cb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56348a31a2f0 con 0x56348a3bc370 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f83503cb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56348a2c2270 con 0x56348a3b69a0 2024-09-19T09:06:56.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.429+0000 7f83503cb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56348a3162b0 con 0x56348a3b72e0 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3bc370 0x56348a3be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3bc370 0x56348a3be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43844/0 (socket says 172.21.15.1:43844) 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 -- 172.21.15.1:0/1943683038 learned_addr learned my addr 172.21.15.1:0/1943683038 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83477fe640 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3b69a0 0x56348a3b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f8346ffd640 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 0x56348a3bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 -- 172.21.15.1:0/1943683038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 msgr2=0x56348a3bbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 0x56348a3bbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 -- 172.21.15.1:0/1943683038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3b69a0 msgr2=0x56348a3b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3b69a0 0x56348a3b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 -- 172.21.15.1:0/1943683038 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348a2c1340 con 0x56348a3bc370 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83477fe640 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3b69a0 0x56348a3b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:06:56.438 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f832ffff640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f83300a3240 0x7f83300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83467fc640 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3bc370 0x56348a3be830 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f833c02a930 tx=0x7f833c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1318bd23adf02c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f83477fe640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f83300a3240 0x7f83300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f832ffff640 1 -- 172.21.15.1:0/2653172904 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f83380cff50 con 0x7f8348101b60 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f832d7fa640 1 -- 172.21.15.1:0/1943683038 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c040070 con 0x56348a3bc370 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f832d7fa640 1 -- 172.21.15.1:0/1943683038 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f833c005030 con 0x56348a3bc370 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.430+0000 7f832d7fa640 1 -- 172.21.15.1:0/1943683038 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c035040 con 0x56348a3bc370 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 -- 172.21.15.1:0/1943683038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3bc370 msgr2=0x56348a3be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3bc370 0x56348a3be830 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f833c02a930 tx=0x7f833c005c00 comp rx=0 tx=0).stop 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83477fe640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f83300a3240 0x7f83300a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8340009fd0 tx=0x7f83400097e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 -- 172.21.15.1:0/1943683038 shutdown_connections 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3bc370 0x56348a3be830 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 0x56348a3bbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 --2- 172.21.15.1:0/1943683038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3b69a0 0x56348a3b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 -- 172.21.15.1:0/1943683038 >> 172.21.15.1:0/1943683038 conn(0x56348a3b2010 msgr2=0x56348a3b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 -- 172.21.15.1:0/1943683038 shutdown_connections 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 -- 172.21.15.1:0/1943683038 wait complete. 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.431+0000 7f83503cb740 1 -- start start 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83503cb740 1 Processor -- start 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83503cb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83503cb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83503cb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83503cb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56348a3bf2e0 con 0x56348a3b72e0 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83503cb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56348a2a3290 con 0x56348a3bc370 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83503cb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56348a3bf460 con 0x56348a3b69a0 2024-09-19T09:06:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83503cb740 10 client.0 _ll_register_callbacks cb 0x56348a2d4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43852/0 (socket says 172.21.15.1:43852) 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 -- 172.21.15.1:0/2928198981 learned_addr learned my addr 172.21.15.1:0/2928198981 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83477fe640 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f8346ffd640 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 -- 172.21.15.1:0/2928198981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 msgr2=0x56348a3c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 -- 172.21.15.1:0/2928198981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 msgr2=0x56348a3c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 -- 172.21.15.1:0/2928198981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348a02d210 con 0x56348a3b72e0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f83467fc640 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c1010 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f833c006010 tx=0x7f833c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17dc9598c67b336 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.432+0000 7f832aff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f832aff5640 1 -- 172.21.15.1:0/2928198981 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c040070 con 0x56348a3b72e0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f832aff5640 1 -- 172.21.15.1:0/2928198981 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f833c031880 con 0x56348a3b72e0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 1 -- 172.21.15.1:0/2928198981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f833c005030 con 0x56348a3b72e0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f832aff5640 1 -- 172.21.15.1:0/2928198981 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f833c035050 con 0x56348a3b72e0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 10 client.16260 fetch_fsmap learned FSMap version 25 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 1 -- 172.21.15.1:0/2928198981 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56348a0f9620 con 0x56348a3b72e0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f832aff5640 1 -- 172.21.15.1:0/2928198981 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f833c005030 con 0x56348a3b72e0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f832aff5640 1 -- 172.21.15.1:0/2928198981 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f833c003660 con 0x56348a3b72e0 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 10 client.16260 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 10 client.16260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 20 client.16260 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56348a3cc350 0x56348a3ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 4 client.16260 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f83503cb740 1 -- 172.21.15.1:0/2928198981 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56348a327a20 con 0x56348a3cc350 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.433+0000 7f8346ffd640 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56348a3cc350 0x56348a3ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.434+0000 7f832aff5640 10 client.16260 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.434+0000 7f8346ffd640 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56348a3cc350 0x56348a3ce790 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=849e3dd3cf636d36 server_cookie=c8a4d38cd7e96a69 in_seq=0 out_seq=0 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f832aff5640 1 -- 172.21.15.1:0/2928198981 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8338081e80 con 0x56348a3cc350 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f832aff5640 10 client.16260 handle_command_reply: tid=0 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 client.16260 shutdown 2024-09-19T09:06:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 -- 172.21.15.1:0/2928198981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 msgr2=0x56348a3c1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c1010 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f833c006010 tx=0x7f833c004250 comp rx=0 tx=0).stop 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 -- 172.21.15.1:0/2928198981 shutdown_connections 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56348a3cc350 0x56348a3ce790 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c1010 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 --2- 172.21.15.1:0/2928198981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f832aff5640 0 client.16260 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 -- 172.21.15.1:0/2928198981 >> 172.21.15.1:0/2928198981 conn(0x56348a3b2010 msgr2=0x56348a3b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 -- 172.21.15.1:0/2928198981 shutdown_connections 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 1 -- 172.21.15.1:0/2928198981 wait complete. 2024-09-19T09:06:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.436+0000 7f83503cb740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T09:06:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.450+0000 7f83503cb740 1 Processor -- start 2024-09-19T09:06:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.450+0000 7f83503cb740 1 -- start start 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.450+0000 7f83503cb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.450+0000 7f83503cb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.450+0000 7f83503cb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.450+0000 7f83503cb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83481adc90 con 0x56348a3b72e0 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83503cb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f83481ab560 con 0x56348a3bc370 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83503cb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f83481a93b0 con 0x56348a3b69a0 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83467fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83477fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83477fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53218/0 (socket says 172.21.15.1:53218) 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83477fe640 1 -- 172.21.15.1:0/4232965860 learned_addr learned my addr 172.21.15.1:0/4232965860 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f8346ffd640 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83467fc640 1 -- 172.21.15.1:0/4232965860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 msgr2=0x56348a3b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83467fc640 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83467fc640 1 -- 172.21.15.1:0/4232965860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 msgr2=0x56348a3b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83467fc640 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83467fc640 1 -- 172.21.15.1:0/4232965860 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348a3b1e30 con 0x56348a3b72e0 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f8346ffd640 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f83467fc640 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c8010 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f833c003b80 tx=0x7f833c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4c19ffe94ff0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f832cff9640 1 -- 172.21.15.1:0/4232965860 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c040040 con 0x56348a3b72e0 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f832cff9640 1 -- 172.21.15.1:0/4232965860 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f833c05d070 con 0x56348a3b72e0 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.451+0000 7f832cff9640 1 -- 172.21.15.1:0/4232965860 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c0035f0 con 0x56348a3b72e0 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 -- 172.21.15.1:0/4232965860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 msgr2=0x56348a3c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c8010 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f833c003b80 tx=0x7f833c005bd0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 -- 172.21.15.1:0/4232965860 shutdown_connections 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b72e0 0x56348a3c8010 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 --2- 172.21.15.1:0/4232965860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b69a0 0x56348a3b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 -- 172.21.15.1:0/4232965860 >> 172.21.15.1:0/4232965860 conn(0x56348a3b2010 msgr2=0x56348a3b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 -- 172.21.15.1:0/4232965860 shutdown_connections 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 -- 172.21.15.1:0/4232965860 wait complete. 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 -- start start 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 Processor -- start 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.452+0000 7f83503cb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b69a0 0x56348a3c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83503cb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 0x56348a3c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83503cb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3c7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83503cb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83481a9a20 con 0x56348a3b69a0 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83503cb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f83481aae90 con 0x56348a3bc370 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83503cb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f83481aa0f0 con 0x56348a3b72e0 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83503cb740 10 client.0 _ll_register_callbacks cb 0x7f8340009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b69a0 0x56348a3c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83477fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b69a0 0x56348a3c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43872/0 (socket says 172.21.15.1:43872) 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 -- 172.21.15.1:0/3046446177 learned_addr learned my addr 172.21.15.1:0/3046446177 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83467fc640 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 0x56348a3c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 -- 172.21.15.1:0/3046446177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 msgr2=0x56348a3c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 0x56348a3c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 -- 172.21.15.1:0/3046446177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 msgr2=0x56348a3c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 -- 172.21.15.1:0/3046446177 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348a3c7b70 con 0x56348a3b69a0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f8346ffd640 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b69a0 0x56348a3c6010 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f83380cdda0 tx=0x7f83380cd900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05d1d8fa10ec2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f832aff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f832aff5640 1 -- 172.21.15.1:0/3046446177 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833809beb0 con 0x56348a3b69a0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f832aff5640 1 -- 172.21.15.1:0/3046446177 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8338098bc0 con 0x56348a3b69a0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.453+0000 7f83503cb740 1 -- 172.21.15.1:0/3046446177 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f833c05d070 con 0x56348a3b69a0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f832aff5640 1 -- 172.21.15.1:0/3046446177 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f833809cc50 con 0x56348a3b69a0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83503cb740 10 client.16266 fetch_fsmap learned FSMap version 25 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83503cb740 1 -- 172.21.15.1:0/3046446177 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56348a437a50 con 0x56348a3b69a0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f832aff5640 1 -- 172.21.15.1:0/3046446177 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f833c05d070 con 0x56348a3b69a0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f832aff5640 1 -- 172.21.15.1:0/3046446177 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f83380d20b0 con 0x56348a3b69a0 2024-09-19T09:06:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83503cb740 10 client.16266 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:06:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83503cb740 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:06:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83503cb740 20 client.16266 populate_metadata read hostname 'smithi001' 2024-09-19T09:06:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83503cb740 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56348a4383e0 0x56348a43a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:06:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83503cb740 4 client.16266 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:06:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83503cb740 1 -- 172.21.15.1:0/3046446177 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56348a321d70 con 0x56348a4383e0 2024-09-19T09:06:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83467fc640 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56348a4383e0 0x56348a43a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:06:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f83467fc640 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56348a4383e0 0x56348a43a800 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12215fd8d1b213fa server_cookie=367b219a41ca8158 in_seq=0 out_seq=0 2024-09-19T09:06:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:56.454+0000 7f832aff5640 10 client.16266 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f832aff5640 1 -- 172.21.15.1:0/3046446177 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56348a321d70 con 0x56348a4383e0 2024-09-19T09:06:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f832aff5640 10 client.16266 handle_command_reply: tid=0 2024-09-19T09:06:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 client.16266 shutdown 2024-09-19T09:06:57.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 -- 172.21.15.1:0/3046446177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b69a0 msgr2=0x56348a3c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b69a0 0x56348a3c6010 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f83380cdda0 tx=0x7f83380cd900 comp rx=0 tx=0).stop 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 -- 172.21.15.1:0/3046446177 shutdown_connections 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56348a4383e0 0x56348a43a800 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56348a3bc370 0x56348a3c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56348a3b72e0 0x56348a3c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 --2- 172.21.15.1:0/3046446177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56348a3b69a0 0x56348a3c6010 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f832aff5640 0 client.16266 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 -- 172.21.15.1:0/3046446177 >> 172.21.15.1:0/3046446177 conn(0x56348a3b2010 msgr2=0x56348a3b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 -- 172.21.15.1:0/3046446177 shutdown_connections 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.616+0000 7f83503cb740 1 -- 172.21.15.1:0/3046446177 wait complete. 2024-09-19T09:06:57.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f83503cb740 20 client.16266 trim_cache size 0 max 16384 2024-09-19T09:06:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:06:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:06:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:06:57.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 -- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f83300a3240 msgr2=0x7f83300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f83300a3240 0x7f83300a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8340009fd0 tx=0x7f83400097e0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 -- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348101b60 msgr2=0x7f8348075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348101b60 0x7f8348075fa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f833800e9c0 tx=0x7f833800ee80 comp rx=0 tx=0).stop 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 -- 172.21.15.1:0/2653172904 shutdown_connections 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f83300a3240 0x7f83300a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8348103710 0x7f8348074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8348102d50 0x7f83480745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 --2- 172.21.15.1:0/2653172904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8348101b60 0x7f8348075fa0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.617+0000 7f834d552640 1 -- 172.21.15.1:0/2653172904 >> 172.21.15.1:0/2653172904 conn(0x7f83480fd2e0 msgr2=0x7f8348106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.618+0000 7f834d552640 1 -- 172.21.15.1:0/2653172904 shutdown_connections 2024-09-19T09:06:57.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:06:57.618+0000 7f834d552640 1 -- 172.21.15.1:0/2653172904 wait complete. 2024-09-19T09:06:57.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:57 smithi064 ceph-mon[35179]: pgmap v423: 97 pgs: 97 active+clean; 74 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 916 KiB/s wr, 93 op/s 2024-09-19T09:06:57.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:57 smithi022 ceph-mon[35107]: pgmap v423: 97 pgs: 97 active+clean; 74 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 916 KiB/s wr, 93 op/s 2024-09-19T09:06:58.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:57 smithi001 ceph-mon[30939]: pgmap v423: 97 pgs: 97 active+clean; 74 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 916 KiB/s wr, 93 op/s 2024-09-19T09:06:59.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:06:59 smithi064 ceph-mon[35179]: pgmap v424: 97 pgs: 97 active+clean; 74 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 720 KiB/s wr, 60 op/s 2024-09-19T09:06:59.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:06:59 smithi022 ceph-mon[35107]: pgmap v424: 97 pgs: 97 active+clean; 74 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 720 KiB/s wr, 60 op/s 2024-09-19T09:07:00.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:06:59 smithi001 ceph-mon[30939]: pgmap v424: 97 pgs: 97 active+clean; 74 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 720 KiB/s wr, 60 op/s 2024-09-19T09:07:01.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:01 smithi022 ceph-mon[35107]: pgmap v425: 97 pgs: 97 active+clean; 122 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.7 MiB/s wr, 1.00k op/s 2024-09-19T09:07:02.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:01 smithi001 ceph-mon[30939]: pgmap v425: 97 pgs: 97 active+clean; 122 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.7 MiB/s wr, 1.00k op/s 2024-09-19T09:07:02.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:01 smithi064 ceph-mon[35179]: pgmap v425: 97 pgs: 97 active+clean; 122 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.7 MiB/s wr, 1.00k op/s 2024-09-19T09:07:03.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:03 smithi022 ceph-mon[35107]: pgmap v426: 97 pgs: 97 active+clean; 126 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.1 MiB/s wr, 1.07k op/s 2024-09-19T09:07:04.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:03 smithi001 ceph-mon[30939]: pgmap v426: 97 pgs: 97 active+clean; 126 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.1 MiB/s wr, 1.07k op/s 2024-09-19T09:07:04.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:03 smithi064 ceph-mon[35179]: pgmap v426: 97 pgs: 97 active+clean; 126 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.1 MiB/s wr, 1.07k op/s 2024-09-19T09:07:05.191 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:07:05.454 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:05.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:05 smithi001 ceph-mon[30939]: pgmap v427: 97 pgs: 97 active+clean; 140 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.1 MiB/s wr, 1.20k op/s 2024-09-19T09:07:05.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:05 smithi022 ceph-mon[35107]: pgmap v427: 97 pgs: 97 active+clean; 140 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.1 MiB/s wr, 1.20k op/s 2024-09-19T09:07:05.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.958+0000 7f6a15d26640 1 -- 172.21.15.1:0/3268341942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10101420 msgr2=0x7f6a1010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.958+0000 7f6a15d26640 1 --2- 172.21.15.1:0/3268341942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10101420 0x7f6a1010d950 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009cd0 tx=0x7f6a0802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.958+0000 7f6a15d26640 1 -- 172.21.15.1:0/3268341942 shutdown_connections 2024-09-19T09:07:05.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.958+0000 7f6a15d26640 1 --2- 172.21.15.1:0/3268341942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10101420 0x7f6a1010d950 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.958+0000 7f6a15d26640 1 --2- 172.21.15.1:0/3268341942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a10100a80 0x7f6a10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.958+0000 7f6a15d26640 1 --2- 172.21.15.1:0/3268341942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10106a80 0x7f6a10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.958+0000 7f6a15d26640 1 -- 172.21.15.1:0/3268341942 >> 172.21.15.1:0/3268341942 conn(0x7f6a100fc7a0 msgr2=0x7f6a100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:05.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.958+0000 7f6a15d26640 1 -- 172.21.15.1:0/3268341942 shutdown_connections 2024-09-19T09:07:05.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.959+0000 7f6a15d26640 1 -- 172.21.15.1:0/3268341942 wait complete. 2024-09-19T09:07:05.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.959+0000 7f6a15d26640 1 Processor -- start 2024-09-19T09:07:05.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.959+0000 7f6a15d26640 1 -- start start 2024-09-19T09:07:05.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a15d26640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10100a80 0x7f6a10197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a15d26640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a10101420 0x7f6a10197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a15d26640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10106a80 0x7f6a1019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a15d26640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10110fa0 con 0x7f6a10106a80 2024-09-19T09:07:05.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a15d26640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10110e20 con 0x7f6a10100a80 2024-09-19T09:07:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a15d26640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10111120 con 0x7f6a10101420 2024-09-19T09:07:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a0ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10106a80 0x7f6a1019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a10101420 0x7f6a10197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a0ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10106a80 0x7f6a1019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38162/0 (socket says 172.21.15.1:38162) 2024-09-19T09:07:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a10101420 0x7f6a10197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:40486/0 (socket says 172.21.15.1:40486) 2024-09-19T09:07:05.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a0ffff640 1 -- 172.21.15.1:0/1850346301 learned_addr learned my addr 172.21.15.1:0/1850346301 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10100a80 0x7f6a10197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a06ffd640 1 -- 172.21.15.1:0/1850346301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10100a80 msgr2=0x7f6a10197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10100a80 0x7f6a10197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a06ffd640 1 -- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10106a80 msgr2=0x7f6a1019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10106a80 0x7f6a1019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a06ffd640 1 -- 172.21.15.1:0/1850346301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1019c3f0 con 0x7f6a10101420 2024-09-19T09:07:05.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a10101420 0x7f6a10197980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69f800e9f0 tx=0x7f69f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.960+0000 7f6a0d7fa640 1 -- 172.21.15.1:0/1850346301 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f800ccc0 con 0x7f6a10101420 2024-09-19T09:07:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.961+0000 7f6a15d26640 1 -- 172.21.15.1:0/1850346301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1019c6e0 con 0x7f6a10101420 2024-09-19T09:07:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.961+0000 7f6a0d7fa640 1 -- 172.21.15.1:0/1850346301 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69f8005020 con 0x7f6a10101420 2024-09-19T09:07:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.961+0000 7f6a0d7fa640 1 -- 172.21.15.1:0/1850346301 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8004b40 con 0x7f6a10101420 2024-09-19T09:07:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.961+0000 7f6a15d26640 1 -- 172.21.15.1:0/1850346301 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a101a3fc0 con 0x7f6a10101420 2024-09-19T09:07:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a180ff740 1 Processor -- start 2024-09-19T09:07:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0d7fa640 1 -- 172.21.15.1:0/1850346301 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f69f8004ce0 con 0x7f6a10101420 2024-09-19T09:07:05.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a180ff740 1 -- start start 2024-09-19T09:07:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x55649847a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847ac40 0x556498487350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 0x556498489c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a180ff740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5564983e02e0 con 0x55649847a320 2024-09-19T09:07:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a180ff740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556498387ce0 con 0x55649847ac40 2024-09-19T09:07:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a180ff740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5564983dc2a0 con 0x556498487890 2024-09-19T09:07:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x55649847a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x55649847a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38174/0 (socket says 172.21.15.1:38174) 2024-09-19T09:07:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0ffff640 1 -- 172.21.15.1:0/1913383794 learned_addr learned my addr 172.21.15.1:0/1913383794 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 0x556498489c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/1913383794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847ac40 0x556498487350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0ffff640 1 -- 172.21.15.1:0/1913383794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 msgr2=0x556498489c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0ffff640 1 --2- 172.21.15.1:0/1913383794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 0x556498489c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0ffff640 1 -- 172.21.15.1:0/1913383794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847ac40 msgr2=0x556498487350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0ffff640 1 --2- 172.21.15.1:0/1913383794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847ac40 0x556498487350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.964+0000 7f6a0ffff640 1 -- 172.21.15.1:0/1913383794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649836c440 con 0x55649847a320 2024-09-19T09:07:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.965+0000 7f6a0d7fa640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f69fc0a32c0 0x7f69fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.965+0000 7f6a0ffff640 1 --2- 172.21.15.1:0/1913383794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x55649847a700 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6a080093c0 tx=0x7f6a080093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e6f519c62f8cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.965+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f69fc0a32c0 0x7f69fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.965+0000 7f6a0d7fa640 1 -- 172.21.15.1:0/1850346301 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f69f80cf860 con 0x7f6a10101420 2024-09-19T09:07:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.965+0000 7f6a05ffb640 1 -- 172.21.15.1:0/1913383794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08048070 con 0x55649847a320 2024-09-19T09:07:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.965+0000 7f6a05ffb640 1 -- 172.21.15.1:0/1913383794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a08036070 con 0x55649847a320 2024-09-19T09:07:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.965+0000 7f6a05ffb640 1 -- 172.21.15.1:0/1913383794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08004310 con 0x55649847a320 2024-09-19T09:07:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 -- 172.21.15.1:0/1913383794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 msgr2=0x55649847a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f69fc0a32c0 0x7f69fc0a5780 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55649847b3f0 tx=0x7f6a00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1913383794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x55649847a700 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6a080093c0 tx=0x7f6a080093f0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 -- 172.21.15.1:0/1913383794 shutdown_connections 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1913383794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 0x556498489c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1913383794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847ac40 0x556498487350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1913383794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x55649847a700 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 -- 172.21.15.1:0/1913383794 >> 172.21.15.1:0/1913383794 conn(0x556498476a30 msgr2=0x556498476e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 -- 172.21.15.1:0/1913383794 shutdown_connections 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 -- 172.21.15.1:0/1913383794 wait complete. 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 -- start start 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.966+0000 7f6a180ff740 1 Processor -- start 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498487250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x556498484500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556498487890 0x556498484af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a180ff740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55649848a460 con 0x556498487890 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a180ff740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55649839b050 con 0x55649847a320 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a180ff740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55649848a5e0 con 0x55649847ac40 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a180ff740 10 client.0 _ll_register_callbacks cb 0x5564983db160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556498487890 0x556498484af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x556498484500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498487250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556498487890 0x556498484af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38180/0 (socket says 172.21.15.1:38180) 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498487250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:40432/0 (socket says 172.21.15.1:40432) 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0ffff640 1 -- 172.21.15.1:0/1748148872 learned_addr learned my addr 172.21.15.1:0/1748148872 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x556498484500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:40496/0 (socket says 172.21.15.1:40496) 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0f7fe640 1 -- 172.21.15.1:0/1748148872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 msgr2=0x556498484500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x556498484500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0f7fe640 1 -- 172.21.15.1:0/1748148872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556498487890 msgr2=0x556498484af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556498487890 0x556498484af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0f7fe640 1 -- 172.21.15.1:0/1748148872 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564981513c0 con 0x55649847a320 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0ffff640 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556498487890 0x556498484af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498487250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a00012cb0 tx=0x7f6a00004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22512d6d75b68f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.967+0000 7f69eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f69eeffd640 1 -- 172.21.15.1:0/1748148872 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0001f640 con 0x55649847a320 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 1 -- 172.21.15.1:0/1748148872 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a08036070 con 0x55649847a320 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f69eeffd640 1 -- 172.21.15.1:0/1748148872 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6a0001f7e0 con 0x55649847a320 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f69eeffd640 1 -- 172.21.15.1:0/1748148872 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6a0001f9e0 con 0x55649847a320 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 10 client.25769 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 1 -- 172.21.15.1:0/1748148872 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556498495f70 con 0x55649847a320 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f69eeffd640 1 -- 172.21.15.1:0/1748148872 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a08036070 con 0x55649847a320 2024-09-19T09:07:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f69eeffd640 1 -- 172.21.15.1:0/1748148872 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6a00027070 con 0x55649847a320 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 10 client.25769 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 10 client.25769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 20 client.25769 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x556498497380 0x556498499790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 4 client.25769 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a180ff740 1 -- 172.21.15.1:0/1748148872 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564983ed850 con 0x556498497380 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.968+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x556498497380 0x556498499790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.969+0000 7f69eeffd640 10 client.25769 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.969+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x556498497380 0x556498499790 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=869ccf2227549b73 server_cookie=2846fd9ef84e5993 in_seq=0 out_seq=0 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.969+0000 7f69eeffd640 1 -- 172.21.15.1:0/1748148872 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564983ed850 con 0x556498497380 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.969+0000 7f69eeffd640 10 client.25769 handle_command_reply: tid=0 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.969+0000 7f6a180ff740 1 client.25769 shutdown 2024-09-19T09:07:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 -- 172.21.15.1:0/1748148872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 msgr2=0x556498487250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498487250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a00012cb0 tx=0x7f6a00004730 comp rx=0 tx=0).stop 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 -- 172.21.15.1:0/1748148872 shutdown_connections 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x556498497380 0x556498499790 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556498487890 0x556498484af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x556498484500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f69eeffd640 0 client.25769 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 --2- 172.21.15.1:0/1748148872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498487250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 -- 172.21.15.1:0/1748148872 >> 172.21.15.1:0/1748148872 conn(0x556498476a30 msgr2=0x55649847c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 -- 172.21.15.1:0/1748148872 shutdown_connections 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 1 -- 172.21.15.1:0/1748148872 wait complete. 2024-09-19T09:07:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.970+0000 7f6a180ff740 20 client.25769 trim_cache size 0 max 16384 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.987+0000 7f6a180ff740 1 Processor -- start 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.987+0000 7f6a180ff740 1 -- start start 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498493700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847ac40 0x55649849f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 0x55649849f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a180ff740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101addd0 con 0x55649847ac40 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a180ff740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101ab6a0 con 0x55649847a320 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a180ff740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101a94f0 con 0x556498487890 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847ac40 0x55649849f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847ac40 0x55649849f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38192/0 (socket says 172.21.15.1:38192) 2024-09-19T09:07:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 -- 172.21.15.1:0/822930012 learned_addr learned my addr 172.21.15.1:0/822930012 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498493700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a0ffff640 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 0x55649849f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 -- 172.21.15.1:0/822930012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 msgr2=0x55649849f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 0x55649849f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 -- 172.21.15.1:0/822930012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 msgr2=0x556498493700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498493700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 -- 172.21.15.1:0/822930012 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556498484e60 con 0x55649847ac40 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847ac40 0x55649849f060 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f69f80982c0 tx=0x7f69f80d5550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45424708ef83713e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.988+0000 7f6a057fa640 1 -- 172.21.15.1:0/822930012 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f801c040 con 0x55649847ac40 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a057fa640 1 -- 172.21.15.1:0/822930012 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69f80d2e50 con 0x55649847ac40 2024-09-19T09:07:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a057fa640 1 -- 172.21.15.1:0/822930012 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8099f90 con 0x55649847ac40 2024-09-19T09:07:05.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 -- 172.21.15.1:0/822930012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847ac40 msgr2=0x55649849f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847ac40 0x55649849f060 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f69f80982c0 tx=0x7f69f80d5550 comp rx=0 tx=0).stop 2024-09-19T09:07:05.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 -- 172.21.15.1:0/822930012 shutdown_connections 2024-09-19T09:07:05.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556498487890 0x55649849f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847ac40 0x55649849f060 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 --2- 172.21.15.1:0/822930012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55649847a320 0x556498493700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 -- 172.21.15.1:0/822930012 >> 172.21.15.1:0/822930012 conn(0x556498476a30 msgr2=0x55649847fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 -- 172.21.15.1:0/822930012 shutdown_connections 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.989+0000 7f6a180ff740 1 -- 172.21.15.1:0/822930012 wait complete. 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 1 -- start start 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 1 Processor -- start 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x556498490190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x55649848b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556498487890 0x55649848bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101a9b60 con 0x55649847a320 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101aafd0 con 0x556498487890 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101aa230 con 0x55649847ac40 2024-09-19T09:07:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a180ff740 10 client.0 _ll_register_callbacks cb 0x7f6a00009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a0f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x556498490190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a0f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x556498490190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38196/0 (socket says 172.21.15.1:38196) 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a0f7fe640 1 -- 172.21.15.1:0/2277996243 learned_addr learned my addr 172.21.15.1:0/2277996243 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a0ffff640 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556498487890 0x55649848bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.990+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x55649848b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a0f7fe640 1 -- 172.21.15.1:0/2277996243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 msgr2=0x55649848b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x55649848b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a0f7fe640 1 -- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556498487890 msgr2=0x55649848bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556498487890 0x55649848bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a0f7fe640 1 -- 172.21.15.1:0/2277996243 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556498501030 con 0x55649847a320 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a0ffff640 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556498487890 0x55649848bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a0f7fe640 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x556498490190 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6a00019040 tx=0x7f6a000336d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4fd315b2185a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f69eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f69eeffd640 1 -- 172.21.15.1:0/2277996243 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a000043e0 con 0x55649847a320 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a180ff740 1 -- 172.21.15.1:0/2277996243 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69f80d2e50 con 0x55649847a320 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f69eeffd640 1 -- 172.21.15.1:0/2277996243 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6a00033940 con 0x55649847a320 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f69eeffd640 1 -- 172.21.15.1:0/2277996243 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6a00003e50 con 0x55649847a320 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a180ff740 10 client.16284 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f6a180ff740 1 -- 172.21.15.1:0/2277996243 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556498502220 con 0x55649847a320 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.991+0000 7f69eeffd640 1 -- 172.21.15.1:0/2277996243 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69f80d2e50 con 0x55649847a320 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f69eeffd640 1 -- 172.21.15.1:0/2277996243 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6a00027040 con 0x55649847a320 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f6a180ff740 10 client.16284 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f6a180ff740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f6a180ff740 20 client.16284 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f6a180ff740 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5564985029d0 0x556498504df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f6a180ff740 4 client.16284 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:07:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f6a180ff740 1 -- 172.21.15.1:0/2277996243 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55649847b990 con 0x5564985029d0 2024-09-19T09:07:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5564985029d0 0x556498504df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f6a06ffd640 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5564985029d0 0x556498504df0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba1d559b4f4c1d8c server_cookie=26386ba1eb663de in_seq=0 out_seq=0 2024-09-19T09:07:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.992+0000 7f69eeffd640 10 client.16284 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f69eeffd640 1 -- 172.21.15.1:0/2277996243 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55649847b990 con 0x5564985029d0 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f69eeffd640 10 client.16284 handle_command_reply: tid=0 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 client.16284 shutdown 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 -- 172.21.15.1:0/2277996243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 msgr2=0x556498490190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x556498490190 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6a00019040 tx=0x7f6a000336d0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 -- 172.21.15.1:0/2277996243 shutdown_connections 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5564985029d0 0x556498504df0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556498487890 0x55649848bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55649847ac40 0x55649848b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 --2- 172.21.15.1:0/2277996243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55649847a320 0x556498490190 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:05.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 -- 172.21.15.1:0/2277996243 >> 172.21.15.1:0/2277996243 conn(0x556498476a30 msgr2=0x556498475350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:05.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f69eeffd640 0 client.16284 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:05.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 -- 172.21.15.1:0/2277996243 shutdown_connections 2024-09-19T09:07:05.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 1 -- 172.21.15.1:0/2277996243 wait complete. 2024-09-19T09:07:05.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.994+0000 7f6a180ff740 20 client.16284 trim_cache size 0 max 16384 2024-09-19T09:07:05.999 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:07:05.999 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:07:05.999 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:07:05.999 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 -- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f69fc0a32c0 msgr2=0x7f69fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f69fc0a32c0 0x7f69fc0a5780 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55649847b3f0 tx=0x7f6a00005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 -- 172.21.15.1:0/1850346301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a10101420 msgr2=0x7f6a10197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a10101420 0x7f6a10197980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69f800e9f0 tx=0x7f69f800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 -- 172.21.15.1:0/1850346301 shutdown_connections 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6a10106a80 0x7f6a1019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f69fc0a32c0 0x7f69fc0a5780 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6a10101420 0x7f6a10197980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:06.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 --2- 172.21.15.1:0/1850346301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a10100a80 0x7f6a10197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:06.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 -- 172.21.15.1:0/1850346301 >> 172.21.15.1:0/1850346301 conn(0x7f6a100fc7a0 msgr2=0x7f6a100fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:06.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 -- 172.21.15.1:0/1850346301 shutdown_connections 2024-09-19T09:07:06.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:05.995+0000 7f6a15d26640 1 -- 172.21.15.1:0/1850346301 wait complete. 2024-09-19T09:07:06.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:05 smithi064 ceph-mon[35179]: pgmap v427: 97 pgs: 97 active+clean; 140 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.1 MiB/s wr, 1.20k op/s 2024-09-19T09:07:07.011 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T09:07:07.012 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:07:07.173 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:07:07.173 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:07:07.318 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:07.726 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:07 smithi001 ceph-mon[30939]: pgmap v428: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 1.23k op/s 2024-09-19T09:07:07.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:07 smithi022 ceph-mon[35107]: pgmap v428: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 1.23k op/s 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 -- 172.21.15.1:0/3041521889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102570 msgr2=0x7f07941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 --2- 172.21.15.1:0/3041521889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102570 0x7f07941029b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0788009ca0 tx=0x7f078802a950 comp rx=0 tx=0).stop 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 -- 172.21.15.1:0/3041521889 shutdown_connections 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 --2- 172.21.15.1:0/3041521889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0794102ef0 0x7f079410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 --2- 172.21.15.1:0/3041521889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102570 0x7f07941029b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 --2- 172.21.15.1:0/3041521889 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0794100e20 0x7f0794101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 -- 172.21.15.1:0/3041521889 >> 172.21.15.1:0/3041521889 conn(0x7f07940fc7d0 msgr2=0x7f07940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 -- 172.21.15.1:0/3041521889 shutdown_connections 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.939+0000 7f079bba3640 1 -- 172.21.15.1:0/3041521889 wait complete. 2024-09-19T09:07:07.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079bba3640 1 Processor -- start 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079bba3640 1 -- start start 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079bba3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0794100e20 0x7f0794197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079bba3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0794102570 0x7f0794197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079bba3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102ef0 0x7f079419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079bba3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f07941110a0 con 0x7f0794102ef0 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079bba3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0794110f20 con 0x7f0794102570 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079bba3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0794111220 con 0x7f0794100e20 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079a140640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102ef0 0x7f079419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079a140640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102ef0 0x7f079419bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38204/0 (socket says 172.21.15.1:38204) 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079a140640 1 -- 172.21.15.1:0/1313946110 learned_addr learned my addr 172.21.15.1:0/1313946110 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079913e640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0794102570 0x7f0794197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.940+0000 7f079993f640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0794100e20 0x7f0794197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:07.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f079a140640 1 -- 172.21.15.1:0/1313946110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0794100e20 msgr2=0x7f0794197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f079a140640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0794100e20 0x7f0794197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f079a140640 1 -- 172.21.15.1:0/1313946110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0794102570 msgr2=0x7f0794197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f079a140640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0794102570 0x7f0794197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f079a140640 1 -- 172.21.15.1:0/1313946110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079419c4b0 con 0x7f0794102ef0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f079a140640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102ef0 0x7f079419bdd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f078400e9b0 tx=0x7f078400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f0792ffd640 1 -- 172.21.15.1:0/1313946110 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078400cd80 con 0x7f0794102ef0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079419c7a0 con 0x7f0794102ef0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f0792ffd640 1 -- 172.21.15.1:0/1313946110 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07840035f0 con 0x7f0794102ef0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f0792ffd640 1 -- 172.21.15.1:0/1313946110 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784010690 con 0x7f0794102ef0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.941+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07941a4080 con 0x7f0794102ef0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.942+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0794101200 con 0x7f0794102ef0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.944+0000 7f0792ffd640 1 -- 172.21.15.1:0/1313946110 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f07840037a0 con 0x7f0794102ef0 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.944+0000 7f0792ffd640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f077c0a3240 0x7f077c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:07.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.944+0000 7f079993f640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f077c0a3240 0x7f077c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:07.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.944+0000 7f0792ffd640 1 -- 172.21.15.1:0/1313946110 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f07840cfce0 con 0x7f0794102ef0 2024-09-19T09:07:07.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.945+0000 7f079993f640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f077c0a3240 0x7f077c0a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f078c009bd0 tx=0x7f078c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:07.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:07.948+0000 7f0792ffd640 1 -- 172.21.15.1:0/1313946110 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f078409ca70 con 0x7f0794102ef0 2024-09-19T09:07:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:07 smithi064 ceph-mon[35179]: pgmap v428: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 1.23k op/s 2024-09-19T09:07:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.216+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0794198860 con 0x7f0794102ef0 2024-09-19T09:07:08.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.217+0000 7f0792ffd640 1 -- 172.21.15.1:0/1313946110 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7f0794198860 con 0x7f0794102ef0 2024-09-19T09:07:08.218 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:07:08.218 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-19T09:06:48:587019+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:06:47.596868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:07:08.218 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-19T09:07:08.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f077c0a3240 msgr2=0x7f077c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:08.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f077c0a3240 0x7f077c0a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f078c009bd0 tx=0x7f078c005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:08.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102ef0 msgr2=0x7f079419bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:08.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102ef0 0x7f079419bdd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f078400e9b0 tx=0x7f078400ee70 comp rx=0 tx=0).stop 2024-09-19T09:07:08.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 shutdown_connections 2024-09-19T09:07:08.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0794102ef0 0x7f079419bdd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:08.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0794102570 0x7f0794197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:08.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f077c0a3240 0x7f077c0a5700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:08.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 --2- 172.21.15.1:0/1313946110 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0794100e20 0x7f0794197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:08.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 >> 172.21.15.1:0/1313946110 conn(0x7f07940fc7d0 msgr2=0x7f07940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:08.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 shutdown_connections 2024-09-19T09:07:08.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:08.219+0000 7f079bba3640 1 -- 172.21.15.1:0/1313946110 wait complete. 2024-09-19T09:07:08.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:08 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1313946110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:08.964 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:08 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1313946110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:08.992 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T09:07:08.993 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T09:07:09.109 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:08 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1313946110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.224+0000 7f95488f0640 1 -- 172.21.15.1:0/788030842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544108300 msgr2=0x7f954410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.224+0000 7f95488f0640 1 --2- 172.21.15.1:0/788030842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544108300 0x7f954410ec70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f953c009930 tx=0x7f953c02a420 comp rx=0 tx=0).stop 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.225+0000 7f95488f0640 1 -- 172.21.15.1:0/788030842 shutdown_connections 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.225+0000 7f95488f0640 1 --2- 172.21.15.1:0/788030842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544108300 0x7f954410ec70 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.225+0000 7f95488f0640 1 --2- 172.21.15.1:0/788030842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9544103780 0x7f9544107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.225+0000 7f95488f0640 1 --2- 172.21.15.1:0/788030842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9544102dd0 0x7f95441031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.225+0000 7f95488f0640 1 -- 172.21.15.1:0/788030842 >> 172.21.15.1:0/788030842 conn(0x7f95440fc7d0 msgr2=0x7f95440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.225+0000 7f95488f0640 1 -- 172.21.15.1:0/788030842 shutdown_connections 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.225+0000 7f95488f0640 1 -- 172.21.15.1:0/788030842 wait complete. 2024-09-19T09:07:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f95488f0640 1 Processor -- start 2024-09-19T09:07:09.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f95488f0640 1 -- start start 2024-09-19T09:07:09.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f95488f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544102dd0 0x7f9544100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:09.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f95488f0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9544103780 0x7f9544100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:09.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f95488f0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9544108300 0x7f95441014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:09.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f95488f0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9544112250 con 0x7f9544102dd0 2024-09-19T09:07:09.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f95488f0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f95441120d0 con 0x7f9544103780 2024-09-19T09:07:09.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f95488f0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f95441123d0 con 0x7f9544108300 2024-09-19T09:07:09.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f954259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544102dd0 0x7f9544100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f954259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544102dd0 0x7f9544100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38228/0 (socket says 172.21.15.1:38228) 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f9541d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9544103780 0x7f9544100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f954259c640 1 -- 172.21.15.1:0/3105613835 learned_addr learned my addr 172.21.15.1:0/3105613835 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f9542d9d640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9544108300 0x7f95441014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f954259c640 1 -- 172.21.15.1:0/3105613835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9544108300 msgr2=0x7f95441014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f954259c640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9544108300 0x7f95441014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f954259c640 1 -- 172.21.15.1:0/3105613835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9544103780 msgr2=0x7f9544100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f954259c640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9544103780 0x7f9544100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.226+0000 7f954259c640 1 -- 172.21.15.1:0/3105613835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95441a6b60 con 0x7f9544102dd0 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.227+0000 7f9542d9d640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9544108300 0x7f95441014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.227+0000 7f9541d9b640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9544103780 0x7f9544100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:09.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.227+0000 7f954259c640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544102dd0 0x7f9544100a30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f953400ba50 tx=0x7f953400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.227+0000 7f953b7fe640 1 -- 172.21.15.1:0/3105613835 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534019070 con 0x7f9544102dd0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.227+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95441a6e50 con 0x7f9544102dd0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.227+0000 7f953b7fe640 1 -- 172.21.15.1:0/3105613835 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f953400cbe0 con 0x7f9544102dd0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.227+0000 7f953b7fe640 1 -- 172.21.15.1:0/3105613835 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534007770 con 0x7f9544102dd0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.227+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95441a7300 con 0x7f9544102dd0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.228+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954406a7b0 con 0x7f9544102dd0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.229+0000 7f953b7fe640 1 -- 172.21.15.1:0/3105613835 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f953401c070 con 0x7f9544102dd0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.230+0000 7f953b7fe640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95300a3240 0x7f95300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.230+0000 7f9541d9b640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95300a3240 0x7f95300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.230+0000 7f953b7fe640 1 -- 172.21.15.1:0/3105613835 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f95340cf410 con 0x7f9544102dd0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.231+0000 7f9541d9b640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95300a3240 0x7f95300a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f95441024c0 tx=0x7f952c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:09.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.233+0000 7f953b7fe640 1 -- 172.21.15.1:0/3105613835 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f953409bac0 con 0x7f9544102dd0 2024-09-19T09:07:09.345 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:09.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.467+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95441031b0 con 0x7f9544102dd0 2024-09-19T09:07:09.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.468+0000 7f953b7fe640 1 -- 172.21.15.1:0/3105613835 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7f953409fdc0 con 0x7f9544102dd0 2024-09-19T09:07:09.469 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:07:09.469 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-19T09:06:48:587019+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:06:47.596868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:07:09.469 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-19T09:07:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95300a3240 msgr2=0x7f95300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95300a3240 0x7f95300a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f95441024c0 tx=0x7f952c005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544102dd0 msgr2=0x7f9544100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544102dd0 0x7f9544100a30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f953400ba50 tx=0x7f953400bf10 comp rx=0 tx=0).stop 2024-09-19T09:07:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 shutdown_connections 2024-09-19T09:07:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f95300a3240 0x7f95300a5700 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9544108300 0x7f95441014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9544103780 0x7f9544100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 --2- 172.21.15.1:0/3105613835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9544102dd0 0x7f9544100a30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.470+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 >> 172.21.15.1:0/3105613835 conn(0x7f95440fc7d0 msgr2=0x7f95441063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.471+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 shutdown_connections 2024-09-19T09:07:09.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:09.471+0000 7f95488f0640 1 -- 172.21.15.1:0/3105613835 wait complete. 2024-09-19T09:07:09.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:09 smithi001 ceph-mon[30939]: pgmap v429: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 1.22k op/s 2024-09-19T09:07:09.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:09 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3105613835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:09 smithi022 ceph-mon[35107]: pgmap v429: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 1.22k op/s 2024-09-19T09:07:09.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:09 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3105613835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:09 smithi064 ceph-mon[35179]: pgmap v429: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 1.22k op/s 2024-09-19T09:07:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:09 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3105613835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:10.268 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:07:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 -- 172.21.15.1:0/2244904600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81741036e0 msgr2=0x7f8174107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 --2- 172.21.15.1:0/2244904600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81741036e0 0x7f8174107b90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8164009930 tx=0x7f816402a420 comp rx=0 tx=0).stop 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 -- 172.21.15.1:0/2244904600 shutdown_connections 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 --2- 172.21.15.1:0/2244904600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81741082a0 0x7f817410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 --2- 172.21.15.1:0/2244904600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81741036e0 0x7f8174107b90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 --2- 172.21.15.1:0/2244904600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8174102d30 0x7f8174103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 -- 172.21.15.1:0/2244904600 >> 172.21.15.1:0/2244904600 conn(0x7f81740fc7d0 msgr2=0x7f81740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 -- 172.21.15.1:0/2244904600 shutdown_connections 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 -- 172.21.15.1:0/2244904600 wait complete. 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 Processor -- start 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.650+0000 7f817ba72640 1 -- start start 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817ba72640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8174102d30 0x7f8174100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817ba72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81741036e0 0x7f8174100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817ba72640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81741082a0 0x7f8174101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817ba72640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81741121c0 con 0x7f8174102d30 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817ba72640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8174112040 con 0x7f81741036e0 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817ba72640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8174112340 con 0x7f81741082a0 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8174102d30 0x7f8174100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8174102d30 0x7f8174100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38236/0 (socket says 172.21.15.1:38236) 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 -- 172.21.15.1:0/2295448597 learned_addr learned my addr 172.21.15.1:0/2295448597 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817900d640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81741036e0 0x7f8174100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817a00f640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81741082a0 0x7f8174101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 -- 172.21.15.1:0/2295448597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81741082a0 msgr2=0x7f8174101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81741082a0 0x7f8174101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 -- 172.21.15.1:0/2295448597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81741036e0 msgr2=0x7f8174100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81741036e0 0x7f8174100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 -- 172.21.15.1:0/2295448597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81741a6b40 con 0x7f8174102d30 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817900d640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81741036e0 0x7f8174100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.651+0000 7f817980e640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8174102d30 0x7f8174100990 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f817000e9f0 tx=0x7f817000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.652+0000 7f816affd640 1 -- 172.21.15.1:0/2295448597 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817000cd80 con 0x7f8174102d30 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.652+0000 7f816affd640 1 -- 172.21.15.1:0/2295448597 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8170010930 con 0x7f8174102d30 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.652+0000 7f817ba72640 1 -- 172.21.15.1:0/2295448597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81741a6e30 con 0x7f8174102d30 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.652+0000 7f816affd640 1 -- 172.21.15.1:0/2295448597 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170018b00 con 0x7f8174102d30 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.652+0000 7f817ba72640 1 -- 172.21.15.1:0/2295448597 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81741a7290 con 0x7f8174102d30 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817de4b740 1 Processor -- start 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f816affd640 1 -- 172.21.15.1:0/2295448597 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f8170018ca0 con 0x7f8174102d30 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817de4b740 1 -- start start 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817de4b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe6760 0x556163fe6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817de4b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556163ff1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817de4b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163ff1940 0x556163ff3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817de4b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556163f4c2a0 con 0x556163fe7080 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817980e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556163ff1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817a00f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe6760 0x556163fe6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817de4b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556163ef3b10 con 0x556163fe6760 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.655+0000 7f817de4b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556163f48260 con 0x556163ff1940 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817a00f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe6760 0x556163fe6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:40504/0 (socket says 172.21.15.1:40504) 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817a00f640 1 -- 172.21.15.1:0/2360136499 learned_addr learned my addr 172.21.15.1:0/2360136499 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817900d640 1 --2- 172.21.15.1:0/2360136499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163ff1940 0x556163ff3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817a00f640 1 -- 172.21.15.1:0/2360136499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163ff1940 msgr2=0x556163ff3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817a00f640 1 --2- 172.21.15.1:0/2360136499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163ff1940 0x556163ff3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817a00f640 1 -- 172.21.15.1:0/2360136499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 msgr2=0x556163ff1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817a00f640 1 --2- 172.21.15.1:0/2360136499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556163ff1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817a00f640 1 -- 172.21.15.1:0/2360136499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556163cbdb90 con 0x556163fe6760 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f816affd640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81600a3240 0x7f81600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817980e640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81600a3240 0x7f81600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f817a00f640 1 --2- 172.21.15.1:0/2360136499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe6760 0x556163fe6b40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f816c009f40 tx=0x7f816c010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84aa4387f9c870f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f816affd640 1 -- 172.21.15.1:0/2295448597 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f81700cfd60 con 0x7f8174102d30 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f815ffff640 1 -- 172.21.15.1:0/2360136499 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c003b70 con 0x556163fe6760 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f815ffff640 1 -- 172.21.15.1:0/2360136499 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f816c003d10 con 0x556163fe6760 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.656+0000 7f815ffff640 1 -- 172.21.15.1:0/2360136499 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c011b30 con 0x556163fe6760 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.657+0000 7f817de4b740 1 -- 172.21.15.1:0/2360136499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe6760 msgr2=0x556163fe6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.657+0000 7f817980e640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81600a3240 0x7f81600a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f81700cdbb0 tx=0x7f81700d3840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.657+0000 7f817de4b740 1 --2- 172.21.15.1:0/2360136499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe6760 0x556163fe6b40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f816c009f40 tx=0x7f816c010860 comp rx=0 tx=0).stop 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.657+0000 7f817de4b740 1 -- 172.21.15.1:0/2360136499 shutdown_connections 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.657+0000 7f817de4b740 1 --2- 172.21.15.1:0/2360136499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163ff1940 0x556163ff3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.657+0000 7f817de4b740 1 --2- 172.21.15.1:0/2360136499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556163ff1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.657+0000 7f817de4b740 1 --2- 172.21.15.1:0/2360136499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe6760 0x556163fe6b40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.658+0000 7f817de4b740 1 -- 172.21.15.1:0/2360136499 >> 172.21.15.1:0/2360136499 conn(0x556163fe2cf0 msgr2=0x556163fe30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.658+0000 7f817de4b740 1 -- 172.21.15.1:0/2360136499 shutdown_connections 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.658+0000 7f817de4b740 1 -- 172.21.15.1:0/2360136499 wait complete. 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.658+0000 7f817de4b740 1 -- start start 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.658+0000 7f817de4b740 1 Processor -- start 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817de4b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fee820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817de4b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163feed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817de4b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163fef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817de4b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556163ff4510 con 0x556163ff1940 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817de4b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556163ed46e0 con 0x556163fe7080 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817de4b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x556163ff4690 con 0x556163fe6760 2024-09-19T09:07:10.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817900d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163feed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817a00f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163fef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817de4b740 10 client.0 _ll_register_callbacks cb 0x556163ef8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817900d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163feed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:40514/0 (socket says 172.21.15.1:40514) 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817900d640 1 -- 172.21.15.1:0/1168994213 learned_addr learned my addr 172.21.15.1:0/1168994213 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817a00f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163fef2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38256/0 (socket says 172.21.15.1:38256) 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817a00f640 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817900d640 1 -- 172.21.15.1:0/1168994213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 msgr2=0x556163fee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817900d640 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fee820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817900d640 1 -- 172.21.15.1:0/1168994213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 msgr2=0x556163fef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817900d640 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163fef2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817900d640 1 -- 172.21.15.1:0/1168994213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556163ffda00 con 0x556163fe7080 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.659+0000 7f817a00f640 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:10.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f817900d640 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163feed60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8164009900 tx=0x7f81640314d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaaae3cec7fb4171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f815d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f815d7fa640 1 -- 172.21.15.1:0/1168994213 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164035040 con 0x556163fe7080 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f817de4b740 1 -- 172.21.15.1:0/1168994213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f816c003d10 con 0x556163fe7080 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f815d7fa640 1 -- 172.21.15.1:0/1168994213 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8164004040 con 0x556163fe7080 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f815d7fa640 1 -- 172.21.15.1:0/1168994213 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8164004240 con 0x556163fe7080 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f817de4b740 10 client.25799 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f817de4b740 1 -- 172.21.15.1:0/1168994213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5561640003e0 con 0x556163fe7080 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.660+0000 7f815d7fa640 1 -- 172.21.15.1:0/1168994213 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f816c003d10 con 0x556163fe7080 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f815d7fa640 1 -- 172.21.15.1:0/1168994213 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f8164004cc0 con 0x556163fe7080 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f817de4b740 10 client.25799 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f817de4b740 10 client.25799 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f817de4b740 20 client.25799 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f817de4b740 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x556164001940 0x556164003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f817de4b740 4 client.25799 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f817de4b740 1 -- 172.21.15.1:0/1168994213 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556163f599d0 con 0x556164001940 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f817a00f640 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x556164001940 0x556164003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f817a00f640 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x556164001940 0x556164003d30 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a22c85a7a95eec6 server_cookie=660214a38d2b52a4 in_seq=0 out_seq=0 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.661+0000 7f815d7fa640 10 client.25799 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f815d7fa640 1 -- 172.21.15.1:0/1168994213 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556163f599d0 con 0x556164001940 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f815d7fa640 10 client.25799 handle_command_reply: tid=0 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 client.25799 shutdown 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 -- 172.21.15.1:0/1168994213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 msgr2=0x556163feed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163feed60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8164009900 tx=0x7f81640314d0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 -- 172.21.15.1:0/1168994213 shutdown_connections 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x556164001940 0x556164003d30 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163fef2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163feed60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 --2- 172.21.15.1:0/1168994213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 -- 172.21.15.1:0/1168994213 >> 172.21.15.1:0/1168994213 conn(0x556163fe2cf0 msgr2=0x556163fe1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:10.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f815d7fa640 0 client.25799 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:10.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 -- 172.21.15.1:0/1168994213 shutdown_connections 2024-09-19T09:07:10.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 1 -- 172.21.15.1:0/1168994213 wait complete. 2024-09-19T09:07:10.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.663+0000 7f817de4b740 20 client.25799 trim_cache size 0 max 16384 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.681+0000 7f817de4b740 1 Processor -- start 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.681+0000 7f817de4b740 1 -- start start 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817de4b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817de4b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556164009600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817de4b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163ff1940 0x556164009b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817de4b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81741b21e0 con 0x556163fe7080 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817de4b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81741afab0 con 0x556163ff1940 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817de4b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f81741ad900 con 0x556163fe6760 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556164009600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556164009600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38262/0 (socket says 172.21.15.1:38262) 2024-09-19T09:07:10.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 -- 172.21.15.1:0/1339846129 learned_addr learned my addr 172.21.15.1:0/1339846129 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817a00f640 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163ff1940 0x556164009b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817a00f640 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 -- 172.21.15.1:0/1339846129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 msgr2=0x556163fef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fef0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 -- 172.21.15.1:0/1339846129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163ff1940 msgr2=0x556164009b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163ff1940 0x556164009b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 -- 172.21.15.1:0/1339846129 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556163fe3d80 con 0x556163fe7080 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.682+0000 7f817900d640 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556164009600 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8164009930 tx=0x7f816402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbebe54688c09fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f815f7fe640 1 -- 172.21.15.1:0/1339846129 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164035030 con 0x556163fe7080 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f815f7fe640 1 -- 172.21.15.1:0/1339846129 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8164004070 con 0x556163fe7080 2024-09-19T09:07:10.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f815f7fe640 1 -- 172.21.15.1:0/1339846129 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81640459b0 con 0x556163fe7080 2024-09-19T09:07:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f817de4b740 1 -- 172.21.15.1:0/1339846129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 msgr2=0x556164009600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f817de4b740 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556164009600 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8164009930 tx=0x7f816402a420 comp rx=0 tx=0).stop 2024-09-19T09:07:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f817de4b740 1 -- 172.21.15.1:0/1339846129 shutdown_connections 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f817de4b740 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163ff1940 0x556164009b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f817de4b740 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163fe7080 0x556164009600 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f817de4b740 1 --2- 172.21.15.1:0/1339846129 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163fef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.683+0000 7f817de4b740 1 -- 172.21.15.1:0/1339846129 >> 172.21.15.1:0/1339846129 conn(0x556163fe2cf0 msgr2=0x556163ff08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.684+0000 7f817de4b740 1 -- 172.21.15.1:0/1339846129 shutdown_connections 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.684+0000 7f817de4b740 1 -- 172.21.15.1:0/1339846129 wait complete. 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.684+0000 7f817de4b740 1 -- start start 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.684+0000 7f817de4b740 1 Processor -- start 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817de4b740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163ff5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817de4b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163ff5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817de4b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163ff6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817de4b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81741adf70 con 0x556163ff1940 2024-09-19T09:07:10.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817de4b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81741af3e0 con 0x556163fe7080 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817de4b740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f81741ae640 con 0x556163fe6760 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817de4b740 10 client.0 _ll_register_callbacks cb 0x7f8164031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817a00f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163ff6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817a00f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163ff6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38270/0 (socket says 172.21.15.1:38270) 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817a00f640 1 -- 172.21.15.1:0/894080217 learned_addr learned my addr 172.21.15.1:0/894080217 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817900d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163ff5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817a00f640 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163ff5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817900d640 1 -- 172.21.15.1:0/894080217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 msgr2=0x556163ff5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817900d640 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163ff5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817900d640 1 -- 172.21.15.1:0/894080217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 msgr2=0x556163ff6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817900d640 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163ff6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817900d640 1 -- 172.21.15.1:0/894080217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55616406b870 con 0x556163fe7080 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817a00f640 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163ff5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:10.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f817900d640 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163ff5e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x556163fd47d0 tx=0x7f8164003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb7eaa4f4401915 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.685+0000 7f815d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f815d7fa640 1 -- 172.21.15.1:0/894080217 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164035040 con 0x556163fe7080 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f815d7fa640 1 -- 172.21.15.1:0/894080217 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f81640457f0 con 0x556163fe7080 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 1 -- 172.21.15.1:0/894080217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8164004070 con 0x556163fe7080 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f815d7fa640 1 -- 172.21.15.1:0/894080217 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8164066070 con 0x556163fe7080 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 10 client.25805 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 1 -- 172.21.15.1:0/894080217 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55616406cb50 con 0x556163fe7080 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f815d7fa640 1 -- 172.21.15.1:0/894080217 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8164004070 con 0x556163fe7080 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f815d7fa640 1 -- 172.21.15.1:0/894080217 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f81640586a0 con 0x556163fe7080 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 10 client.25805 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 10 client.25805 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 20 client.25805 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55616406d220 0x55616406f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 4 client.25805 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T09:07:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.686+0000 7f817de4b740 1 -- 172.21.15.1:0/894080217 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x556163f53d20 con 0x55616406d220 2024-09-19T09:07:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.687+0000 7f817a00f640 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55616406d220 0x55616406f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.687+0000 7f815d7fa640 10 client.25805 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:10.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:10.687+0000 7f817a00f640 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55616406d220 0x55616406f640 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe06b52e5cab01a5 server_cookie=ed60f8e53d68e6d2 in_seq=0 out_seq=0 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 -- 172.21.15.1:0/3312435385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c101b50 msgr2=0x7f235c101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 --2- 172.21.15.1:0/3312435385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c101b50 0x7f235c101f50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f234c009900 tx=0x7f234c02a410 comp rx=0 tx=0).stop 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 -- 172.21.15.1:0/3312435385 shutdown_connections 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 --2- 172.21.15.1:0/3312435385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235c103700 0x7f235c109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 --2- 172.21.15.1:0/3312435385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235c102d40 0x7f235c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 --2- 172.21.15.1:0/3312435385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c101b50 0x7f235c101f50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 -- 172.21.15.1:0/3312435385 >> 172.21.15.1:0/3312435385 conn(0x7f235c0fd2f0 msgr2=0x7f235c0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 -- 172.21.15.1:0/3312435385 shutdown_connections 2024-09-19T09:07:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.722+0000 7f2361a65640 1 -- 172.21.15.1:0/3312435385 wait complete. 2024-09-19T09:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.723+0000 7f2361a65640 1 Processor -- start 2024-09-19T09:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.723+0000 7f2361a65640 1 -- start start 2024-09-19T09:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f2361a65640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235c101b50 0x7f235c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f2361a65640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c102d40 0x7f235c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f2361a65640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235c103700 0x7f235c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f2361a65640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f235c10d980 con 0x7f235c102d40 2024-09-19T09:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f2361a65640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f235c10d800 con 0x7f235c103700 2024-09-19T09:07:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f2361a65640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f235c10db00 con 0x7f235c101b50 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c102d40 0x7f235c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c102d40 0x7f235c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38292/0 (socket says 172.21.15.1:38292) 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 -- 172.21.15.1:0/1716960429 learned_addr learned my addr 172.21.15.1:0/1716960429 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235bfff640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235c103700 0x7f235c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235b7fe640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235c101b50 0x7f235c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 -- 172.21.15.1:0/1716960429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235c101b50 msgr2=0x7f235c197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235c101b50 0x7f235c197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 -- 172.21.15.1:0/1716960429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235c103700 msgr2=0x7f235c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235c103700 0x7f235c19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 -- 172.21.15.1:0/1716960429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235c19fb70 con 0x7f235c102d40 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.724+0000 7f235affd640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c102d40 0x7f235c198490 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f235000e9f0 tx=0x7f235000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.725+0000 7f2358ff9640 1 -- 172.21.15.1:0/1716960429 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235000cd80 con 0x7f235c102d40 2024-09-19T09:07:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.725+0000 7f2358ff9640 1 -- 172.21.15.1:0/1716960429 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2350005520 con 0x7f235c102d40 2024-09-19T09:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.725+0000 7f2361a65640 1 -- 172.21.15.1:0/1716960429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235c19fe60 con 0x7f235c102d40 2024-09-19T09:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.726+0000 7f2358ff9640 1 -- 172.21.15.1:0/1716960429 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350010690 con 0x7f235c102d40 2024-09-19T09:07:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.726+0000 7f2361a65640 1 -- 172.21.15.1:0/1716960429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235c1a0320 con 0x7f235c102d40 2024-09-19T09:07:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.729+0000 7f2364807740 1 Processor -- start 2024-09-19T09:07:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f2364807740 1 -- start start 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f2364807740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x55936825dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f2364807740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368260d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f2364807740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559368261330 0x55936826e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f2364807740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5593681c12f0 con 0x55936825d920 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f2364807740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559368169270 con 0x559368261330 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f2364807740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5593681bd2b0 con 0x55936825e260 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f235bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x55936825dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f235bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x55936825dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38304/0 (socket says 172.21.15.1:38304) 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f235bfff640 1 -- 172.21.15.1:0/1230428034 learned_addr learned my addr 172.21.15.1:0/1230428034 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.730+0000 7f235b7fe640 1 --2- 172.21.15.1:0/1230428034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368260d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.732+0000 7f235bfff640 1 -- 172.21.15.1:0/1230428034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 msgr2=0x559368260d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.732+0000 7f235bfff640 1 --2- 172.21.15.1:0/1230428034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368260d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.732+0000 7f235bfff640 1 -- 172.21.15.1:0/1230428034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559368261330 msgr2=0x55936826e2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:07:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.732+0000 7f235bfff640 1 --2- 172.21.15.1:0/1230428034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559368261330 0x55936826e2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.732+0000 7f235bfff640 1 -- 172.21.15.1:0/1230428034 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559368168340 con 0x55936825d920 2024-09-19T09:07:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.732+0000 7f2358ff9640 1 -- 172.21.15.1:0/1716960429 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f23500046c0 con 0x7f235c102d40 2024-09-19T09:07:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.732+0000 7f235bfff640 1 --2- 172.21.15.1:0/1230428034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x55936825dd20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2354011440 tx=0x7f2354011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac08da0b422565d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.733+0000 7f2358ff9640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23440a3380 0x7f23440a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.733+0000 7f2341ffb640 1 -- 172.21.15.1:0/1230428034 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354004d20 con 0x55936825d920 2024-09-19T09:07:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.733+0000 7f235b7fe640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23440a3380 0x7f23440a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.733+0000 7f2358ff9640 1 -- 172.21.15.1:0/1716960429 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f23500cfce0 con 0x7f235c102d40 2024-09-19T09:07:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.733+0000 7f2341ffb640 1 -- 172.21.15.1:0/1230428034 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2354004050 con 0x55936825d920 2024-09-19T09:07:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.733+0000 7f2341ffb640 1 -- 172.21.15.1:0/1230428034 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235400f780 con 0x55936825d920 2024-09-19T09:07:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.734+0000 7f235b7fe640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23440a3380 0x7f23440a5840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f234c02aa00 tx=0x7f234c031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.734+0000 7f2364807740 1 -- 172.21.15.1:0/1230428034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 msgr2=0x55936825dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.734+0000 7f2364807740 1 --2- 172.21.15.1:0/1230428034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x55936825dd20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2354011440 tx=0x7f2354011900 comp rx=0 tx=0).stop 2024-09-19T09:07:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.735+0000 7f2364807740 1 -- 172.21.15.1:0/1230428034 shutdown_connections 2024-09-19T09:07:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.735+0000 7f2364807740 1 --2- 172.21.15.1:0/1230428034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559368261330 0x55936826e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.735+0000 7f2364807740 1 --2- 172.21.15.1:0/1230428034 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368260d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.735+0000 7f2364807740 1 --2- 172.21.15.1:0/1230428034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x55936825dd20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.735+0000 7f2364807740 1 -- 172.21.15.1:0/1230428034 >> 172.21.15.1:0/1230428034 conn(0x559368259010 msgr2=0x559368259410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.735+0000 7f2364807740 1 -- 172.21.15.1:0/1230428034 shutdown_connections 2024-09-19T09:07:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.735+0000 7f2364807740 1 -- 172.21.15.1:0/1230428034 wait complete. 2024-09-19T09:07:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.735+0000 7f2364807740 1 -- start start 2024-09-19T09:07:10.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f2364807740 1 Processor -- start 2024-09-19T09:07:10.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f2364807740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368270500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f2364807740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368270a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.738 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f2364807740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559368261330 0x559368277a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f2364807740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55936826ebc0 con 0x559368261330 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f2364807740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55936814a290 con 0x55936825d920 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f2364807740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55936826ed40 con 0x55936825e260 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f235b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368270500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f235b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368270500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:40554/0 (socket says 172.21.15.1:40554) 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f235b7fe640 1 -- 172.21.15.1:0/3247678345 learned_addr learned my addr 172.21.15.1:0/3247678345 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f235affd640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368270a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.736+0000 7f2364807740 10 client.0 _ll_register_callbacks cb 0x55936817b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235bfff640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559368261330 0x559368277a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235affd640 1 -- 172.21.15.1:0/3247678345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 msgr2=0x559368270500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235affd640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368270500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235affd640 1 -- 172.21.15.1:0/3247678345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559368261330 msgr2=0x559368277a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235affd640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559368261330 0x559368277a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235affd640 1 -- 172.21.15.1:0/3247678345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559367ed4210 con 0x55936825e260 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235b7fe640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368270500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235bfff640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559368261330 0x559368277a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f235affd640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368270a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f235009c210 tx=0x7f235009be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6364cb3a4f231af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f233affd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f233affd640 1 -- 172.21.15.1:0/3247678345 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23500a0630 con 0x55936825e260 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f233affd640 1 -- 172.21.15.1:0/3247678345 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f23500a4a60 con 0x55936825e260 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f2364807740 1 -- 172.21.15.1:0/3247678345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2354004050 con 0x55936825e260 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f233affd640 1 -- 172.21.15.1:0/3247678345 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f23500a4ef0 con 0x55936825e260 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f2364807740 10 client.25756 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.737+0000 7f2364807740 1 -- 172.21.15.1:0/3247678345 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559367fa0620 con 0x55936825e260 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.738+0000 7f233affd640 1 -- 172.21.15.1:0/3247678345 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2354004050 con 0x55936825e260 2024-09-19T09:07:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.738+0000 7f233affd640 1 -- 172.21.15.1:0/3247678345 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f23500bc070 con 0x55936825e260 2024-09-19T09:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.738+0000 7f2364807740 10 client.25756 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.738+0000 7f2364807740 10 client.25756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.738+0000 7f2364807740 20 client.25756 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.738+0000 7f2364807740 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55936827c170 0x55936827e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.738+0000 7f2364807740 4 client.25756 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.738+0000 7f2364807740 1 -- 172.21.15.1:0/3247678345 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593681cea20 con 0x55936827c170 2024-09-19T09:07:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.739+0000 7f235b7fe640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55936827c170 0x55936827e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.741+0000 7f233affd640 10 client.25756 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.741+0000 7f235b7fe640 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55936827c170 0x55936827e590 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cad5ec4219c61c8 server_cookie=d693a908163160e7 in_seq=0 out_seq=0 2024-09-19T09:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.746+0000 7f233affd640 1 -- 172.21.15.1:0/3247678345 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593681cea20 con 0x55936827c170 2024-09-19T09:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.746+0000 7f233affd640 10 client.25756 handle_command_reply: tid=0 2024-09-19T09:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.746+0000 7f2364807740 1 client.25756 shutdown 2024-09-19T09:07:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 -- 172.21.15.1:0/3247678345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 msgr2=0x559368270a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368270a40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f235009c210 tx=0x7f235009be80 comp rx=0 tx=0).stop 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 -- 172.21.15.1:0/3247678345 shutdown_connections 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55936827c170 0x55936827e590 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559368261330 0x559368277a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f233affd640 0 client.25756 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55936825e260 0x559368270a40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 --2- 172.21.15.1:0/3247678345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368270500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 -- 172.21.15.1:0/3247678345 >> 172.21.15.1:0/3247678345 conn(0x559368259010 msgr2=0x55936825a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 -- 172.21.15.1:0/3247678345 shutdown_connections 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 1 -- 172.21.15.1:0/3247678345 wait complete. 2024-09-19T09:07:10.748 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.747+0000 7f2364807740 20 client.25756 trim_cache size 0 max 16384 2024-09-19T09:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.763+0000 7f2364807740 1 Processor -- start 2024-09-19T09:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.763+0000 7f2364807740 1 -- start start 2024-09-19T09:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.763+0000 7f2364807740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x5593682589b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.763+0000 7f2364807740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825e260 0x559368277a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.763+0000 7f2364807740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 0x55936825a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.763+0000 7f2364807740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1a9850 con 0x55936825d920 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.763+0000 7f2364807740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1a7120 con 0x55936825e260 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.763+0000 7f2364807740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1a4f70 con 0x559368261330 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x5593682589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 0x55936825a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x5593682589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38324/0 (socket says 172.21.15.1:38324) 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 -- 172.21.15.1:0/680370350 learned_addr learned my addr 172.21.15.1:0/680370350 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235affd640 1 --2- 172.21.15.1:0/680370350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825e260 0x559368277a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 -- 172.21.15.1:0/680370350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 msgr2=0x55936825a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 --2- 172.21.15.1:0/680370350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 0x55936825a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 -- 172.21.15.1:0/680370350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825e260 msgr2=0x559368277a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 --2- 172.21.15.1:0/680370350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825e260 0x559368277a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 -- 172.21.15.1:0/680370350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559368278f20 con 0x55936825d920 2024-09-19T09:07:10.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f235b7fe640 1 --2- 172.21.15.1:0/680370350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x5593682589b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f234c031570 tx=0x7f234c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88c1d19cb682621 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f23417fa640 1 -- 172.21.15.1:0/680370350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c035040 con 0x55936825d920 2024-09-19T09:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f23417fa640 1 -- 172.21.15.1:0/680370350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f234c059070 con 0x55936825d920 2024-09-19T09:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.764+0000 7f23417fa640 1 -- 172.21.15.1:0/680370350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c004e30 con 0x55936825d920 2024-09-19T09:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 -- 172.21.15.1:0/680370350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 msgr2=0x5593682589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 --2- 172.21.15.1:0/680370350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x5593682589b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f234c031570 tx=0x7f234c03f000 comp rx=0 tx=0).stop 2024-09-19T09:07:10.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 -- 172.21.15.1:0/680370350 shutdown_connections 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 --2- 172.21.15.1:0/680370350 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 0x55936825a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 --2- 172.21.15.1:0/680370350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825e260 0x559368277a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 --2- 172.21.15.1:0/680370350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825d920 0x5593682589b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 -- 172.21.15.1:0/680370350 >> 172.21.15.1:0/680370350 conn(0x559368259010 msgr2=0x559368259f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 -- 172.21.15.1:0/680370350 shutdown_connections 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.765+0000 7f2364807740 1 -- 172.21.15.1:0/680370350 wait complete. 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 1 -- start start 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 1 Processor -- start 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368275250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825e260 0x559368275790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 0x559368276750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1a55e0 con 0x55936825e260 2024-09-19T09:07:10.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1a6a50 con 0x55936825d920 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1a5cb0 con 0x559368261330 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f2364807740 10 client.0 _ll_register_callbacks cb 0x7f2350098590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f235affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825e260 0x559368275790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f235b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368275250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f235affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825e260 0x559368275790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38330/0 (socket says 172.21.15.1:38330) 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f235affd640 1 -- 172.21.15.1:0/3133132040 learned_addr learned my addr 172.21.15.1:0/3133132040 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.766+0000 7f235bfff640 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 0x559368276750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f235affd640 1 -- 172.21.15.1:0/3133132040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 msgr2=0x559368276750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f235affd640 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 0x559368276750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f235affd640 1 -- 172.21.15.1:0/3133132040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 msgr2=0x559368275250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f235affd640 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368275250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f235affd640 1 -- 172.21.15.1:0/3133132040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559368276d60 con 0x55936825e260 2024-09-19T09:07:10.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f235affd640 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825e260 0x559368275790 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f23500057a0 tx=0x7f235009bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce55b98382b94ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f233affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f233affd640 1 -- 172.21.15.1:0/3133132040 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235009b8d0 con 0x55936825e260 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f233affd640 1 -- 172.21.15.1:0/3133132040 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f23500a4a60 con 0x55936825e260 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f2364807740 1 -- 172.21.15.1:0/3133132040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f234c059070 con 0x55936825e260 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f233affd640 1 -- 172.21.15.1:0/3133132040 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f23500a4c60 con 0x55936825e260 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f2364807740 10 client.16329 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f2364807740 1 -- 172.21.15.1:0/3133132040 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5593682e7000 con 0x55936825e260 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.767+0000 7f233affd640 1 -- 172.21.15.1:0/3133132040 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f234c059070 con 0x55936825e260 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.768+0000 7f233affd640 1 -- 172.21.15.1:0/3133132040 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f23500050d0 con 0x55936825e260 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.768+0000 7f2364807740 10 client.16329 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.768+0000 7f2364807740 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.768+0000 7f2364807740 20 client.16329 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:10.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.768+0000 7f2364807740 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5593682e7a60 0x5593682e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.768+0000 7f2364807740 4 client.16329 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.768+0000 7f2364807740 1 -- 172.21.15.1:0/3133132040 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593681c8d70 con 0x5593682e7a60 2024-09-19T09:07:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.768+0000 7f235b7fe640 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5593682e7a60 0x5593682e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.769+0000 7f235b7fe640 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5593682e7a60 0x5593682e9e80 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11c79ae6c7f74faa server_cookie=f32cafa6a8d0c533 in_seq=0 out_seq=0 2024-09-19T09:07:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:10.769+0000 7f233affd640 10 client.16329 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:10.776 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.297+0000 7fc0583c6640 1 -- 172.21.15.1:0/1089408894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc050100d00 msgr2=0x7fc050106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.297+0000 7fc0583c6640 1 --2- 172.21.15.1:0/1089408894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc050100d00 0x7fc050106840 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc040009930 tx=0x7fc04002a420 comp rx=0 tx=0).stop 2024-09-19T09:07:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 -- 172.21.15.1:0/1089408894 shutdown_connections 2024-09-19T09:07:11.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 --2- 172.21.15.1:0/1089408894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc050106f50 0x7fc05010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 --2- 172.21.15.1:0/1089408894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc050100d00 0x7fc050106840 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 --2- 172.21.15.1:0/1089408894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc050100350 0x7fc050100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 -- 172.21.15.1:0/1089408894 >> 172.21.15.1:0/1089408894 conn(0x7fc050077210 msgr2=0x7fc0500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 -- 172.21.15.1:0/1089408894 shutdown_connections 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 -- 172.21.15.1:0/1089408894 wait complete. 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 Processor -- start 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.298+0000 7fc0583c6640 1 -- start start 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0583c6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc050100350 0x7fc0501012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0583c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc050100d00 0x7fc050101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0583c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc050106f50 0x7fc050101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0583c6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0501120c0 con 0x7fc050100d00 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0583c6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc050111f40 con 0x7fc050106f50 2024-09-19T09:07:11.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0583c6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc050112240 con 0x7fc050100350 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc055961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc050100d00 0x7fc050101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc050100350 0x7fc0501012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc050100350 0x7fc0501012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:40668/0 (socket says 172.21.15.1:40668) 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 -- 172.21.15.1:0/3955222846 learned_addr learned my addr 172.21.15.1:0/3955222846 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056963640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc050106f50 0x7fc050101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 -- 172.21.15.1:0/3955222846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc050106f50 msgr2=0x7fc050101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc050106f50 0x7fc050101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 -- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc050100d00 msgr2=0x7fc050101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc050100d00 0x7fc050101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 -- 172.21.15.1:0/3955222846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0501a69e0 con 0x7fc050100350 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc056162640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc050100350 0x7fc0501012d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00e9f0 tx=0x7fc04c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:11.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0477fe640 1 -- 172.21.15.1:0/3955222846 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00cd80 con 0x7fc050100350 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0477fe640 1 -- 172.21.15.1:0/3955222846 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc04c010930 con 0x7fc050100350 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.299+0000 7fc0583c6640 1 -- 172.21.15.1:0/3955222846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0501a6cd0 con 0x7fc050100350 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.300+0000 7fc0477fe640 1 -- 172.21.15.1:0/3955222846 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c018b00 con 0x7fc050100350 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.300+0000 7fc0583c6640 1 -- 172.21.15.1:0/3955222846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0501a7190 con 0x7fc050100350 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.302+0000 7fc0477fe640 1 -- 172.21.15.1:0/3955222846 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fc04c018ca0 con 0x7fc050100350 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.302+0000 7fc05a79f740 1 Processor -- start 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.302+0000 7fc05a79f740 1 -- start start 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be2f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be2fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be3a370 0x55a77be3c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc05a79f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a77bd952f0 con 0x55a77be30b40 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc05a79f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a77bd3ccf0 con 0x55a77be3a370 2024-09-19T09:07:11.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc05a79f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a77bd912b0 con 0x55a77be2f5d0 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be2f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38372/0 (socket says 172.21.15.1:38372) 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 -- 172.21.15.1:0/2735433812 learned_addr learned my addr 172.21.15.1:0/2735433812 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056162640 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be2fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc055961640 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be3a370 0x55a77be3c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 -- 172.21.15.1:0/2735433812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 msgr2=0x55a77be2fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be2fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 -- 172.21.15.1:0/2735433812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be3a370 msgr2=0x55a77be3c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc0477fe640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc03c0a3240 0x7fc03c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be3a370 0x55a77be3c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 -- 172.21.15.1:0/2735433812 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77bd213a0 con 0x55a77be30b40 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be2f090 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc048009f50 tx=0x7fc0480118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18706d2b985d2bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:11.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc0477fe640 1 -- 172.21.15.1:0/3955222846 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc04c0cfd10 con 0x7fc050100350 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc056963640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc03c0a3240 0x7fc03c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.303+0000 7fc044dea640 1 -- 172.21.15.1:0/2735433812 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04801e070 con 0x55a77be30b40 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc044dea640 1 -- 172.21.15.1:0/2735433812 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc048004630 con 0x55a77be30b40 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc044dea640 1 -- 172.21.15.1:0/2735433812 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048019650 con 0x55a77be30b40 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 -- 172.21.15.1:0/2735433812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 msgr2=0x55a77be2f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be2f090 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc048009f50 tx=0x7fc0480118d0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc056963640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc03c0a3240 0x7fc03c0a5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc04801b000 tx=0x7fc048019ca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 -- 172.21.15.1:0/2735433812 shutdown_connections 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be3a370 0x55a77be3c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be2fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 --2- 172.21.15.1:0/2735433812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be2f090 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 -- 172.21.15.1:0/2735433812 >> 172.21.15.1:0/2735433812 conn(0x55a77bdf8310 msgr2=0x55a77be2bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:11.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 -- 172.21.15.1:0/2735433812 shutdown_connections 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.304+0000 7fc05a79f740 1 -- 172.21.15.1:0/2735433812 wait complete. 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 1 -- start start 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 1 Processor -- start 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be39d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be37030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 0x55a77be37640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a77be3d070 con 0x55a77be30b40 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a77bd50060 con 0x55a77be2f5d0 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a77be3d1f0 con 0x55a77be3a370 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc05a79f740 10 client.0 _ll_register_callbacks cb 0x55a77baa38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc055961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be37030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc056162640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be39d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc055961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be37030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38382/0 (socket says 172.21.15.1:38382) 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc056963640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 0x55a77be37640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc055961640 1 -- 172.21.15.1:0/651535219 learned_addr learned my addr 172.21.15.1:0/651535219 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.305+0000 7fc056162640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be39d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:40622/0 (socket says 172.21.15.1:40622) 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc055961640 1 -- 172.21.15.1:0/651535219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 msgr2=0x55a77be37640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc055961640 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 0x55a77be37640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc055961640 1 -- 172.21.15.1:0/651535219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 msgr2=0x55a77be39d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc055961640 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be39d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc055961640 1 -- 172.21.15.1:0/651535219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a77bb063c0 con 0x55a77be30b40 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc055961640 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be37030 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc040009930 tx=0x7fc040031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2f8d979938113 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc039ffb640 1 -- 172.21.15.1:0/651535219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040035040 con 0x55a77be30b40 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc039ffb640 1 -- 172.21.15.1:0/651535219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc040004040 con 0x55a77be30b40 2024-09-19T09:07:11.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc05a79f740 1 -- 172.21.15.1:0/651535219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc048004630 con 0x55a77be30b40 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc039ffb640 1 -- 172.21.15.1:0/651535219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc04004c070 con 0x55a77be30b40 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc05a79f740 10 client.16341 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc05a79f740 1 -- 172.21.15.1:0/651535219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a77be48b90 con 0x55a77be30b40 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.306+0000 7fc039ffb640 1 -- 172.21.15.1:0/651535219 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc048004630 con 0x55a77be30b40 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc039ffb640 1 -- 172.21.15.1:0/651535219 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc040046510 con 0x55a77be30b40 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc05a79f740 10 client.16341 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc05a79f740 10 client.16341 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc05a79f740 20 client.16341 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc05a79f740 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a77be4a050 0x55a77be4c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc05a79f740 4 client.16341 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc05a79f740 1 -- 172.21.15.1:0/651535219 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a77bda2860 con 0x55a77be4a050 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc056162640 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a77be4a050 0x55a77be4c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc056162640 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a77be4a050 0x55a77be4c480 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97993eadbd618f58 server_cookie=67f28997a885ff29 in_seq=0 out_seq=0 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.307+0000 7fc039ffb640 10 client.16341 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc039ffb640 1 -- 172.21.15.1:0/651535219 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a77bda2860 con 0x55a77be4a050 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc039ffb640 10 client.16341 handle_command_reply: tid=0 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 client.16341 shutdown 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 -- 172.21.15.1:0/651535219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 msgr2=0x55a77be37030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be37030 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc040009930 tx=0x7fc040031870 comp rx=0 tx=0).stop 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 -- 172.21.15.1:0/651535219 shutdown_connections 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a77be4a050 0x55a77be4c480 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 0x55a77be37640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be37030 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc039ffb640 0 client.16341 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 --2- 172.21.15.1:0/651535219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be39d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 -- 172.21.15.1:0/651535219 >> 172.21.15.1:0/651535219 conn(0x55a77bdf8310 msgr2=0x55a77be31960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.308+0000 7fc05a79f740 1 -- 172.21.15.1:0/651535219 shutdown_connections 2024-09-19T09:07:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.309+0000 7fc05a79f740 1 -- 172.21.15.1:0/651535219 wait complete. 2024-09-19T09:07:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.309+0000 7fc05a79f740 20 client.16341 trim_cache size 0 max 16384 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.321+0000 7fc05a79f740 1 Processor -- start 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.321+0000 7fc05a79f740 1 -- start start 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be38fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be32120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 0x55a77be32660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc05a79f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0501b2190 con 0x55a77be30b40 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc05a79f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc0501afa60 con 0x55a77be2f5d0 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc05a79f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc0501ad8b0 con 0x55a77be3a370 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc055961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be32120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc056162640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be38fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc056162640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be38fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:40626/0 (socket says 172.21.15.1:40626) 2024-09-19T09:07:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc055961640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be32120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38388/0 (socket says 172.21.15.1:38388) 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc056162640 1 -- 172.21.15.1:0/3307714530 learned_addr learned my addr 172.21.15.1:0/3307714530 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc056963640 1 --2- 172.21.15.1:0/3307714530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 0x55a77be32660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc055961640 1 -- 172.21.15.1:0/3307714530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 msgr2=0x55a77be32660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc055961640 1 --2- 172.21.15.1:0/3307714530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 0x55a77be32660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc055961640 1 -- 172.21.15.1:0/3307714530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 msgr2=0x55a77be38fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc055961640 1 --2- 172.21.15.1:0/3307714530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be38fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc055961640 1 -- 172.21.15.1:0/3307714530 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77be2b510 con 0x55a77be30b40 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.322+0000 7fc055961640 1 --2- 172.21.15.1:0/3307714530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be32120 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc040005940 tx=0x7fc040005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f82e27bf5bc4400 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc03bfff640 1 -- 172.21.15.1:0/3307714530 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040035030 con 0x55a77be30b40 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc03bfff640 1 -- 172.21.15.1:0/3307714530 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc040031ab0 con 0x55a77be30b40 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc03bfff640 1 -- 172.21.15.1:0/3307714530 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040000e60 con 0x55a77be30b40 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 -- 172.21.15.1:0/3307714530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 msgr2=0x55a77be32120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 --2- 172.21.15.1:0/3307714530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be32120 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc040005940 tx=0x7fc040005780 comp rx=0 tx=0).stop 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 -- 172.21.15.1:0/3307714530 shutdown_connections 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 --2- 172.21.15.1:0/3307714530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be3a370 0x55a77be32660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 --2- 172.21.15.1:0/3307714530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be30b40 0x55a77be32120 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 --2- 172.21.15.1:0/3307714530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be2f5d0 0x55a77be38fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 -- 172.21.15.1:0/3307714530 >> 172.21.15.1:0/3307714530 conn(0x55a77bdf8310 msgr2=0x55a77be38890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 -- 172.21.15.1:0/3307714530 shutdown_connections 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.323+0000 7fc05a79f740 1 -- 172.21.15.1:0/3307714530 wait complete. 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 1 -- start start 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 1 Processor -- start 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be3e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be30b40 0x55a77be3e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be3a370 0x55a77be3ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0501adf20 con 0x55a77be3a370 2024-09-19T09:07:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc0501af390 con 0x55a77be30b40 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc0501ae5f0 con 0x55a77be2f5d0 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc05a79f740 10 client.0 _ll_register_callbacks cb 0x7fc040009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc056162640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be3e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc056963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be3a370 0x55a77be3ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc055961640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be30b40 0x55a77be3e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc056162640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be3e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:40716/0 (socket says 172.21.15.1:40716) 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.324+0000 7fc056162640 1 -- 172.21.15.1:0/220286803 learned_addr learned my addr 172.21.15.1:0/220286803 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc056162640 1 -- 172.21.15.1:0/220286803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be30b40 msgr2=0x55a77be3e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc056162640 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be30b40 0x55a77be3e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc056162640 1 -- 172.21.15.1:0/220286803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be3a370 msgr2=0x55a77be3ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc056162640 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be3a370 0x55a77be3ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc056162640 1 -- 172.21.15.1:0/220286803 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a77beb3d20 con 0x55a77be2f5d0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc056963640 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be3a370 0x55a77be3ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc055961640 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be30b40 0x55a77be3e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc056162640 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be3e1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c6a0 tx=0x7fc04c0bc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ab67459168349e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc039ffb640 1 -- 172.21.15.1:0/220286803 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0abe80 con 0x55a77be2f5d0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc05a79f740 1 -- 172.21.15.1:0/220286803 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a77bd9cd70 con 0x55a77be2f5d0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc039ffb640 1 -- 172.21.15.1:0/220286803 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc04c0cd8a0 con 0x55a77be2f5d0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc039ffb640 1 -- 172.21.15.1:0/220286803 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc04c09c360 con 0x55a77be2f5d0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc05a79f740 10 client.25780 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.325+0000 7fc05a79f740 1 -- 172.21.15.1:0/220286803 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a77beb5020 con 0x55a77be2f5d0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc039ffb640 1 -- 172.21.15.1:0/220286803 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55a77bd9cd70 con 0x55a77be2f5d0 2024-09-19T09:07:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc039ffb640 1 -- 172.21.15.1:0/220286803 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc04c0d5070 con 0x55a77be2f5d0 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc05a79f740 10 client.25780 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc05a79f740 10 client.25780 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc05a79f740 20 client.25780 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc05a79f740 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a77beb56f0 0x55a77beb7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc05a79f740 4 client.25780 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc05a79f740 1 -- 172.21.15.1:0/220286803 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a77bd19170 con 0x55a77beb56f0 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc055961640 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a77beb56f0 0x55a77beb7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc055961640 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a77beb56f0 0x55a77beb7ae0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb7d21fdba94a186 server_cookie=3cab2bdb20ecc17b in_seq=0 out_seq=0 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.326+0000 7fc039ffb640 10 client.25780 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc039ffb640 1 -- 172.21.15.1:0/220286803 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a77bd19170 con 0x55a77beb56f0 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc039ffb640 10 client.25780 handle_command_reply: tid=0 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 client.25780 shutdown 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 -- 172.21.15.1:0/220286803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 msgr2=0x55a77be3e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be3e1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c6a0 tx=0x7fc04c0bc040 comp rx=0 tx=0).stop 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 -- 172.21.15.1:0/220286803 shutdown_connections 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x55a77beb56f0 0x55a77beb7ae0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a77be3a370 0x55a77be3ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a77be30b40 0x55a77be3e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc039ffb640 0 client.25780 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 --2- 172.21.15.1:0/220286803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a77be2f5d0 0x55a77be3e1b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 -- 172.21.15.1:0/220286803 >> 172.21.15.1:0/220286803 conn(0x55a77bdf8310 msgr2=0x55a77be390b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 -- 172.21.15.1:0/220286803 shutdown_connections 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 1 -- 172.21.15.1:0/220286803 wait complete. 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.327+0000 7fc05a79f740 20 client.25780 trim_cache size 0 max 16384 2024-09-19T09:07:11.335 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:07:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 -- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc03c0a3240 msgr2=0x7fc03c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc03c0a3240 0x7fc03c0a5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc04801b000 tx=0x7fc048019ca0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 -- 172.21.15.1:0/3955222846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc050100350 msgr2=0x7fc0501012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc050100350 0x7fc0501012d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00e9f0 tx=0x7fc04c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 -- 172.21.15.1:0/3955222846 shutdown_connections 2024-09-19T09:07:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc050106f50 0x7fc050101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc050100d00 0x7fc050101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc03c0a3240 0x7fc03c0a5700 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 --2- 172.21.15.1:0/3955222846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc050100350 0x7fc0501012d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 -- 172.21.15.1:0/3955222846 >> 172.21.15.1:0/3955222846 conn(0x7fc050077210 msgr2=0x7fc050105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 -- 172.21.15.1:0/3955222846 shutdown_connections 2024-09-19T09:07:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:11.328+0000 7fc0583c6640 1 -- 172.21.15.1:0/3955222846 wait complete. 2024-09-19T09:07:11.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:11 smithi022 ceph-mon[35107]: pgmap v430: 97 pgs: 97 active+clean; 142 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.0 MiB/s wr, 1.35k op/s 2024-09-19T09:07:12.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:11 smithi001 ceph-mon[30939]: pgmap v430: 97 pgs: 97 active+clean; 142 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.0 MiB/s wr, 1.35k op/s 2024-09-19T09:07:12.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:07:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:11 smithi064 ceph-mon[35179]: pgmap v430: 97 pgs: 97 active+clean; 142 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.0 MiB/s wr, 1.35k op/s 2024-09-19T09:07:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:12.884 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:12 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:12.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:12 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:13.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:12 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:07:13.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 -- 172.21.15.1:0/2563422557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 msgr2=0x7f25b8110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/2563422557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 0x7f25b8110910 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009ca0 tx=0x7f25b002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 -- 172.21.15.1:0/2563422557 shutdown_connections 2024-09-19T09:07:13.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/2563422557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 0x7f25b8110910 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/2563422557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25b8101440 0x7f25b810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/2563422557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b8100b20 0x7f25b8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 -- 172.21.15.1:0/2563422557 >> 172.21.15.1:0/2563422557 conn(0x7f25b80fc7d0 msgr2=0x7f25b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 -- 172.21.15.1:0/2563422557 shutdown_connections 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 -- 172.21.15.1:0/2563422557 wait complete. 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.124+0000 7f25bfcf7640 1 Processor -- start 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bfcf7640 1 -- start start 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bfcf7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25b8100b20 0x7f25b81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bfcf7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b8101440 0x7f25b81a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bfcf7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 0x7f25b819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bfcf7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8114390 con 0x7f25b810e500 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bfcf7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8114210 con 0x7f25b8101440 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bfcf7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8114510 con 0x7f25b8100b20 2024-09-19T09:07:13.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25be294640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 0x7f25b819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bda93640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25b8100b20 0x7f25b81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bd292640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b8101440 0x7f25b81a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25be294640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 0x7f25b819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58568/0 (socket says 172.21.15.1:58568) 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bda93640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25b8100b20 0x7f25b81a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:57838/0 (socket says 172.21.15.1:57838) 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25be294640 1 -- 172.21.15.1:0/45999812 learned_addr learned my addr 172.21.15.1:0/45999812 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bda93640 1 -- 172.21.15.1:0/45999812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b8101440 msgr2=0x7f25b81a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bda93640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b8101440 0x7f25b81a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bda93640 1 -- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 msgr2=0x7f25b819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bda93640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 0x7f25b819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25bda93640 1 -- 172.21.15.1:0/45999812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b819acf0 con 0x7f25b8100b20 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.125+0000 7f25be294640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 0x7f25b819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.126+0000 7f25bda93640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25b8100b20 0x7f25b81a0400 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e9f0 tx=0x7f25b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.126+0000 7f25aeffd640 1 -- 172.21.15.1:0/45999812 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b400ccc0 con 0x7f25b8100b20 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.126+0000 7f25bfcf7640 1 -- 172.21.15.1:0/45999812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b819afe0 con 0x7f25b8100b20 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.126+0000 7f25aeffd640 1 -- 172.21.15.1:0/45999812 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25b4010930 con 0x7f25b8100b20 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.126+0000 7f25aeffd640 1 -- 172.21.15.1:0/45999812 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b40189f0 con 0x7f25b8100b20 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.126+0000 7f25bfcf7640 1 -- 172.21.15.1:0/45999812 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b81a72d0 con 0x7f25b8100b20 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.128+0000 7f25aeffd640 1 -- 172.21.15.1:0/45999812 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f25b4010ae0 con 0x7f25b8100b20 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.128+0000 7f25c20d0740 1 Processor -- start 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.128+0000 7f25c20d0740 1 -- start start 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53848b40 0x562b53847090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b538475d0 0x562b53847a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53854760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25c20d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562b537ad2f0 con 0x562b538475d0 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25c20d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b53754cf0 con 0x562b53852370 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25c20d0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562b537a92b0 con 0x562b53848b40 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25bda93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b538475d0 0x562b53847a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25be294640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53848b40 0x562b53847090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25bd292640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53854760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25be294640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53848b40 0x562b53847090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:57848/0 (socket says 172.21.15.1:57848) 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25be294640 1 -- 172.21.15.1:0/65399584 learned_addr learned my addr 172.21.15.1:0/65399584 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25bda93640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b538475d0 0x562b53847a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58580/0 (socket says 172.21.15.1:58580) 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25bd292640 1 -- 172.21.15.1:0/65399584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53848b40 msgr2=0x562b53847090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25bd292640 1 --2- 172.21.15.1:0/65399584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53848b40 0x562b53847090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25bd292640 1 -- 172.21.15.1:0/65399584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b538475d0 msgr2=0x562b53847a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25bd292640 1 --2- 172.21.15.1:0/65399584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b538475d0 0x562b53847a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25bd292640 1 -- 172.21.15.1:0/65399584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b537393a0 con 0x562b53852370 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25be294640 1 --2- 172.21.15.1:0/65399584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53848b40 0x562b53847090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25aeffd640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25a40a3240 0x7f25a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.129+0000 7f25be294640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25a40a3240 0x7f25a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.130+0000 7f25aeffd640 1 -- 172.21.15.1:0/45999812 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f25b40cfc60 con 0x7f25b8100b20 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.130+0000 7f25bd292640 1 --2- 172.21.15.1:0/65399584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53854760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25b819b700 tx=0x7f25a8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c9c0b81ff12a58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.130+0000 7f25a3fff640 1 -- 172.21.15.1:0/65399584 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8009d70 con 0x562b53852370 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.130+0000 7f25a3fff640 1 -- 172.21.15.1:0/65399584 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25a8005020 con 0x562b53852370 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.130+0000 7f25a3fff640 1 -- 172.21.15.1:0/65399584 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8004b00 con 0x562b53852370 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.130+0000 7f25c20d0740 1 -- 172.21.15.1:0/65399584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 msgr2=0x562b53854760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.130+0000 7f25be294640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25a40a3240 0x7f25a40a5700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f25b002f540 tx=0x7f25b0009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.130+0000 7f25c20d0740 1 --2- 172.21.15.1:0/65399584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53854760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25b819b700 tx=0x7f25a8011810 comp rx=0 tx=0).stop 2024-09-19T09:07:13.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 -- 172.21.15.1:0/65399584 shutdown_connections 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 --2- 172.21.15.1:0/65399584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53854760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 --2- 172.21.15.1:0/65399584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b538475d0 0x562b53847a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 --2- 172.21.15.1:0/65399584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53848b40 0x562b53847090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 -- 172.21.15.1:0/65399584 >> 172.21.15.1:0/65399584 conn(0x562b53810310 msgr2=0x562b53843c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 -- 172.21.15.1:0/65399584 shutdown_connections 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 -- 172.21.15.1:0/65399584 wait complete. 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 -- start start 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.131+0000 7f25c20d0740 1 Processor -- start 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b53851ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5384efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 0x562b5384f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25c20d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562b53855070 con 0x562b53848b40 2024-09-19T09:07:13.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25c20d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b53768060 con 0x562b538475d0 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25c20d0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562b538551f0 con 0x562b53852370 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25c20d0740 10 client.0 _ll_register_callbacks cb 0x562b534bb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5384efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bda93640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b53851ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25be294640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 0x562b5384f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5384efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58582/0 (socket says 172.21.15.1:58582) 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 -- 172.21.15.1:0/2590099800 learned_addr learned my addr 172.21.15.1:0/2590099800 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 -- 172.21.15.1:0/2590099800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 msgr2=0x562b5384f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 0x562b5384f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 -- 172.21.15.1:0/2590099800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 msgr2=0x562b53851ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b53851ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 -- 172.21.15.1:0/2590099800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b5351e3c0 con 0x562b53848b40 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bda93640 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b53851ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25bd292640 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5384efe0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f25a8005bc0 tx=0x7f25a8005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69086657a8ce0fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.132+0000 7f25a17fa640 1 -- 172.21.15.1:0/2590099800 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8028020 con 0x562b53848b40 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25a17fa640 1 -- 172.21.15.1:0/2590099800 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f25a8004880 con 0x562b53848b40 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 1 -- 172.21.15.1:0/2590099800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25a8005020 con 0x562b53848b40 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25a17fa640 1 -- 172.21.15.1:0/2590099800 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f25a8033050 con 0x562b53848b40 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 10 client.16359 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 1 -- 172.21.15.1:0/2590099800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b53860ac0 con 0x562b53848b40 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25a17fa640 1 -- 172.21.15.1:0/2590099800 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25a8005020 con 0x562b53848b40 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25a17fa640 1 -- 172.21.15.1:0/2590099800 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f25a8023cc0 con 0x562b53848b40 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 10 client.16359 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 10 client.16359 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:07:13.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 20 client.16359 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x562b53861f80 0x562b53864370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 4 client.16359 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25c20d0740 1 -- 172.21.15.1:0/2590099800 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b537ba860 con 0x562b53861f80 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.133+0000 7f25bda93640 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x562b53861f80 0x562b53864370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.134+0000 7f25a17fa640 10 client.16359 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.134+0000 7f25bda93640 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x562b53861f80 0x562b53864370 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f86c3382ada6bdd3 server_cookie=16fe265033129e02 in_seq=0 out_seq=0 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25a17fa640 1 -- 172.21.15.1:0/2590099800 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b537ba860 con 0x562b53861f80 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25a17fa640 10 client.16359 handle_command_reply: tid=0 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 client.16359 shutdown 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 -- 172.21.15.1:0/2590099800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 msgr2=0x562b5384efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5384efe0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f25a8005bc0 tx=0x7f25a8005690 comp rx=0 tx=0).stop 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 -- 172.21.15.1:0/2590099800 shutdown_connections 2024-09-19T09:07:13.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x562b53861f80 0x562b53864370 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 0x562b5384f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5384efe0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25a17fa640 0 client.16359 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2590099800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b53851ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 -- 172.21.15.1:0/2590099800 >> 172.21.15.1:0/2590099800 conn(0x562b53810310 msgr2=0x562b53849960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 -- 172.21.15.1:0/2590099800 shutdown_connections 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 1 -- 172.21.15.1:0/2590099800 wait complete. 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.135+0000 7f25c20d0740 20 client.16359 trim_cache size 0 max 16384 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.148+0000 7f25c20d0740 1 Processor -- start 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.148+0000 7f25c20d0740 1 -- start start 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.148+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b538475d0 0x562b53843e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.148+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5385e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.148+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53869b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.148+0000 7f25c20d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81b2190 con 0x562b53848b40 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.148+0000 7f25c20d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81afa60 con 0x562b53852370 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.148+0000 7f25c20d0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81ad8b0 con 0x562b538475d0 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5385e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5385e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58584/0 (socket says 172.21.15.1:58584) 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 -- 172.21.15.1:0/2974437688 learned_addr learned my addr 172.21.15.1:0/2974437688 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bda93640 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b538475d0 0x562b53843e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25be294640 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53869b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 -- 172.21.15.1:0/2974437688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b538475d0 msgr2=0x562b53843e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b538475d0 0x562b53843e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 -- 172.21.15.1:0/2974437688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 msgr2=0x562b53869b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53869b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 -- 172.21.15.1:0/2974437688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b53848780 con 0x562b53848b40 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25bd292640 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5385e310 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f25a80196c0 tx=0x7f25a8005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad4109ca5ce3617 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25a37fe640 1 -- 172.21.15.1:0/2974437688 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8028040 con 0x562b53848b40 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25a37fe640 1 -- 172.21.15.1:0/2974437688 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25a8019940 con 0x562b53848b40 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.149+0000 7f25a37fe640 1 -- 172.21.15.1:0/2974437688 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a801d040 con 0x562b53848b40 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 -- 172.21.15.1:0/2974437688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 msgr2=0x562b5385e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5385e310 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f25a80196c0 tx=0x7f25a8005e70 comp rx=0 tx=0).stop 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 -- 172.21.15.1:0/2974437688 shutdown_connections 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b53852370 0x562b53869b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b5385e310 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2974437688 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b538475d0 0x562b53843e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 -- 172.21.15.1:0/2974437688 >> 172.21.15.1:0/2974437688 conn(0x562b53810310 msgr2=0x562b53843700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 -- 172.21.15.1:0/2974437688 shutdown_connections 2024-09-19T09:07:13.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 -- 172.21.15.1:0/2974437688 wait complete. 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 -- start start 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.150+0000 7f25c20d0740 1 Processor -- start 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b538559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b53855f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25c20d0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 0x562b538caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25c20d0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81adf20 con 0x562b53848b40 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25c20d0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81af390 con 0x562b538475d0 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25c20d0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25b81ae5f0 con 0x562b53852370 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25c20d0740 10 client.0 _ll_register_callbacks cb 0x7f25b40d3570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b538559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bd292640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b53855f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b538559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45240/0 (socket says 172.21.15.1:45240) 2024-09-19T09:07:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 -- 172.21.15.1:0/2211822499 learned_addr learned my addr 172.21.15.1:0/2211822499 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25be294640 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 0x562b538caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 -- 172.21.15.1:0/2211822499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 msgr2=0x562b538caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 0x562b538caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 -- 172.21.15.1:0/2211822499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 msgr2=0x562b53855f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b53855f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 -- 172.21.15.1:0/2211822499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b538cb100 con 0x562b538475d0 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bd292640 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b53855f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25bda93640 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b538559e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25b4098c80 tx=0x7f25b40d36a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9019b7f9509639fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.151+0000 7f25a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25a17fa640 1 -- 172.21.15.1:0/2211822499 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b40a05b0 con 0x562b538475d0 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25a17fa640 1 -- 172.21.15.1:0/2211822499 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f25b40cd7f0 con 0x562b538475d0 2024-09-19T09:07:13.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 1 -- 172.21.15.1:0/2211822499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25a8019940 con 0x562b538475d0 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25a17fa640 1 -- 172.21.15.1:0/2211822499 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f25b40a4e70 con 0x562b538475d0 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 10 client.25856 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 1 -- 172.21.15.1:0/2211822499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b538cc440 con 0x562b538475d0 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25a17fa640 1 -- 172.21.15.1:0/2211822499 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25a8019940 con 0x562b538475d0 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25a17fa640 1 -- 172.21.15.1:0/2211822499 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f25b40a01e0 con 0x562b538475d0 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 10 client.25856 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 10 client.25856 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 20 client.25856 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x562b538ccb60 0x562b538cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 4 client.25856 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25c20d0740 1 -- 172.21.15.1:0/2211822499 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562b537b4d70 con 0x562b538ccb60 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.152+0000 7f25bd292640 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x562b538ccb60 0x562b538cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:13.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25bd292640 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x562b538ccb60 0x562b538cef50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15ed5a4ccbd1d967 server_cookie=547381ca84cf8142 in_seq=0 out_seq=0 2024-09-19T09:07:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25a17fa640 10 client.25856 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:07:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25a17fa640 1 -- 172.21.15.1:0/2211822499 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562b537b4d70 con 0x562b538ccb60 2024-09-19T09:07:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25a17fa640 10 client.25856 handle_command_reply: tid=0 2024-09-19T09:07:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 client.25856 shutdown 2024-09-19T09:07:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 -- 172.21.15.1:0/2211822499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 msgr2=0x562b538559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b538559e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f25b4098c80 tx=0x7f25b40d36a0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 -- 172.21.15.1:0/2211822499 shutdown_connections 2024-09-19T09:07:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x562b538ccb60 0x562b538cef50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.175 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:07:13.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562b53852370 0x562b538caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b53848b40 0x562b53855f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25a17fa640 0 client.25856 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:07:13.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 --2- 172.21.15.1:0/2211822499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b538475d0 0x562b538559e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 -- 172.21.15.1:0/2211822499 >> 172.21.15.1:0/2211822499 conn(0x562b53810310 msgr2=0x562b53850840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 -- 172.21.15.1:0/2211822499 shutdown_connections 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 1 -- 172.21.15.1:0/2211822499 wait complete. 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.153+0000 7f25c20d0740 20 client.25856 trim_cache size 0 max 16384 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 -- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25a40a3240 msgr2=0x7f25a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25a40a3240 0x7f25a40a5700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f25b002f540 tx=0x7f25b0009360 comp rx=0 tx=0).stop 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 -- 172.21.15.1:0/45999812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25b8100b20 msgr2=0x7f25b81a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25b8100b20 0x7f25b81a0400 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25b400e9f0 tx=0x7f25b400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 -- 172.21.15.1:0/45999812 shutdown_connections 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f25b810e500 0x7f25b819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25b8101440 0x7f25b81a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f25a40a3240 0x7f25a40a5700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 --2- 172.21.15.1:0/45999812 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25b8100b20 0x7f25b81a0400 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:13.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 -- 172.21.15.1:0/45999812 >> 172.21.15.1:0/45999812 conn(0x7f25b80fc7d0 msgr2=0x7f25b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:13.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 -- 172.21.15.1:0/45999812 shutdown_connections 2024-09-19T09:07:13.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:13.154+0000 7f25bfcf7640 1 -- 172.21.15.1:0/45999812 wait complete. 2024-09-19T09:07:13.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:13 smithi001 ceph-mon[30939]: pgmap v431: 97 pgs: 97 active+clean; 142 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 391 op/s 2024-09-19T09:07:13.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:13.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:13.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:07:13.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:13 smithi022 ceph-mon[35107]: pgmap v431: 97 pgs: 97 active+clean; 142 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 391 op/s 2024-09-19T09:07:13.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:13.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:13.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:07:14.010 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:07:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:13 smithi064 ceph-mon[35179]: pgmap v431: 97 pgs: 97 active+clean; 142 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 391 op/s 2024-09-19T09:07:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:07:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:07:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:07:14.274 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:14.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.772+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/3451211076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 msgr2=0x7ff8a4107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.772+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/3451211076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 0x7ff8a4107ba0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff894009930 tx=0x7ff89402a420 comp rx=0 tx=0).stop 2024-09-19T09:07:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.773+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/3451211076 shutdown_connections 2024-09-19T09:07:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.773+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/3451211076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8a41082e0 0x7ff8a410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.773+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/3451211076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 0x7ff8a4107ba0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.773+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/3451211076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8a4102db0 0x7ff8a4103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.773+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/3451211076 >> 172.21.15.1:0/3451211076 conn(0x7ff8a40fc7d0 msgr2=0x7ff8a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.773+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/3451211076 shutdown_connections 2024-09-19T09:07:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.773+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/3451211076 wait complete. 2024-09-19T09:07:14.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a8aa5640 1 Processor -- start 2024-09-19T09:07:14.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a8aa5640 1 -- start start 2024-09-19T09:07:14.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a8aa5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8a4102db0 0x7ff8a4100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a8aa5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 0x7ff8a4100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a8aa5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8a41082e0 0x7ff8a4101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a8aa5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4112190 con 0x7ff8a4103760 2024-09-19T09:07:14.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a8aa5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4112010 con 0x7ff8a4102db0 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a8aa5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4112310 con 0x7ff8a41082e0 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8a4102db0 0x7ff8a4100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8a4102db0 0x7ff8a4100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45252/0 (socket says 172.21.15.1:45252) 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8a41082e0 0x7ff8a4101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 0x7ff8a4100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8a41082e0 0x7ff8a4101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:57906/0 (socket says 172.21.15.1:57906) 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.774+0000 7ff8a2d9d640 1 -- 172.21.15.1:0/1524643553 learned_addr learned my addr 172.21.15.1:0/1524643553 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8a2d9d640 1 -- 172.21.15.1:0/1524643553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8a4102db0 msgr2=0x7ff8a4100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8a2d9d640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8a4102db0 0x7ff8a4100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8a2d9d640 1 -- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 msgr2=0x7ff8a4100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8a2d9d640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 0x7ff8a4100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8a2d9d640 1 -- 172.21.15.1:0/1524643553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a41a6b60 con 0x7ff8a41082e0 2024-09-19T09:07:14.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 0x7ff8a4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:14.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8a2d9d640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8a41082e0 0x7ff8a4101490 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00eb10 tx=0x7ff89c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8937fe640 1 -- 172.21.15.1:0/1524643553 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c004b20 con 0x7ff8a41082e0 2024-09-19T09:07:14.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.775+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/1524643553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a41a6e50 con 0x7ff8a41082e0 2024-09-19T09:07:14.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.776+0000 7ff8937fe640 1 -- 172.21.15.1:0/1524643553 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff89c004cc0 con 0x7ff8a41082e0 2024-09-19T09:07:14.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.776+0000 7ff8937fe640 1 -- 172.21.15.1:0/1524643553 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c0107f0 con 0x7ff8a41082e0 2024-09-19T09:07:14.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.776+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/1524643553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a41a7310 con 0x7ff8a41082e0 2024-09-19T09:07:14.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.778+0000 7ff8aae7e740 1 Processor -- start 2024-09-19T09:07:14.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.778+0000 7ff8937fe640 1 -- 172.21.15.1:0/1524643553 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7ff89c005020 con 0x7ff8a41082e0 2024-09-19T09:07:14.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8aae7e740 1 -- start start 2024-09-19T09:07:14.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d22090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d225d0 0x564982d22a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d2d370 0x564982d2f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564982c882f0 con 0x564982d23b40 2024-09-19T09:07:14.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564982c2fcf0 con 0x564982d2d370 2024-09-19T09:07:14.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564982c842b0 con 0x564982d225d0 2024-09-19T09:07:14.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d225d0 0x564982d22a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8a1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d22090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d225d0 0x564982d22a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:57910/0 (socket says 172.21.15.1:57910) 2024-09-19T09:07:14.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8a259c640 1 -- 172.21.15.1:0/372360909 learned_addr learned my addr 172.21.15.1:0/372360909 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.779+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/372360909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d2d370 0x564982d2f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8a1d9b640 1 -- 172.21.15.1:0/372360909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d225d0 msgr2=0x564982d22a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/372360909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d225d0 0x564982d22a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8a1d9b640 1 -- 172.21.15.1:0/372360909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d2d370 msgr2=0x564982d2f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/372360909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d2d370 0x564982d2f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8a1d9b640 1 -- 172.21.15.1:0/372360909 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564982c143a0 con 0x564982d23b40 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8937fe640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff88c0a3240 0x7ff88c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/372360909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d22090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff89402a940 tx=0x7ff894005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7376b89520c758c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8937fe640 1 -- 172.21.15.1:0/1524643553 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff89c0cfe60 con 0x7ff8a41082e0 2024-09-19T09:07:14.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff8a259c640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff88c0a3240 0x7ff88c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.780+0000 7ff890ff9640 1 -- 172.21.15.1:0/372360909 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894035040 con 0x564982d23b40 2024-09-19T09:07:14.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.781+0000 7ff890ff9640 1 -- 172.21.15.1:0/372360909 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff894005040 con 0x564982d23b40 2024-09-19T09:07:14.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.781+0000 7ff890ff9640 1 -- 172.21.15.1:0/372360909 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894004af0 con 0x564982d23b40 2024-09-19T09:07:14.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.781+0000 7ff8aae7e740 1 -- 172.21.15.1:0/372360909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 msgr2=0x564982d22090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.781+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/372360909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d22090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff89402a940 tx=0x7ff894005fd0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.781+0000 7ff8a259c640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff88c0a3240 0x7ff88c0a5700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x564982d1fac0 tx=0x7ff898005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 -- 172.21.15.1:0/372360909 shutdown_connections 2024-09-19T09:07:14.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/372360909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d2d370 0x564982d2f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/372360909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d225d0 0x564982d22a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/372360909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d22090 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 -- 172.21.15.1:0/372360909 >> 172.21.15.1:0/372360909 conn(0x564982ceb310 msgr2=0x564982d1ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 -- 172.21.15.1:0/372360909 shutdown_connections 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 -- 172.21.15.1:0/372360909 wait complete. 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 -- start start 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.782+0000 7ff8aae7e740 1 Processor -- start 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d2cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 0x564982d2a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d2a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564982d30060 con 0x564982d2d370 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564982c43060 con 0x564982d225d0 2024-09-19T09:07:14.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x564982d301e0 con 0x564982d23b40 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8aae7e740 10 client.0 _ll_register_callbacks cb 0x5649829968c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d2cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d2cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45260/0 (socket says 172.21.15.1:45260) 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 -- 172.21.15.1:0/2231892511 learned_addr learned my addr 172.21.15.1:0/2231892511 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 0x564982d2a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a2d9d640 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d2a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 -- 172.21.15.1:0/2231892511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 msgr2=0x564982d2a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 0x564982d2a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 -- 172.21.15.1:0/2231892511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 msgr2=0x564982d2a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d2a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 -- 172.21.15.1:0/2231892511 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649829f93c0 con 0x564982d225d0 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff8a259c640 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d2cd50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff898009b90 tx=0x7ff898004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2f372884e464d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.783+0000 7ff889ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.784+0000 7ff889ffb640 1 -- 172.21.15.1:0/2231892511 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898029ae0 con 0x564982d225d0 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.784+0000 7ff889ffb640 1 -- 172.21.15.1:0/2231892511 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff898029c80 con 0x564982d225d0 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.784+0000 7ff8aae7e740 1 -- 172.21.15.1:0/2231892511 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff894005040 con 0x564982d225d0 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.784+0000 7ff889ffb640 1 -- 172.21.15.1:0/2231892511 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff898034480 con 0x564982d225d0 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.784+0000 7ff8aae7e740 10 client.25868 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.784+0000 7ff8aae7e740 1 -- 172.21.15.1:0/2231892511 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564982d3bb90 con 0x564982d225d0 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.784+0000 7ff889ffb640 1 -- 172.21.15.1:0/2231892511 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff898034b20 con 0x564982d225d0 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff889ffb640 1 -- 172.21.15.1:0/2231892511 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff89803f980 con 0x564982d225d0 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff8aae7e740 10 client.25868 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff8aae7e740 10 client.25868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff8aae7e740 20 client.25868 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564982d3d0f0 0x564982d3f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff8aae7e740 4 client.25868 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:14.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff8aae7e740 1 -- 172.21.15.1:0/2231892511 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff894005040 con 0x564982d3d0f0 2024-09-19T09:07:14.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564982d3d0f0 0x564982d3f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564982d3d0f0 0x564982d3f510 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cc660a634ce3755 server_cookie=6fbe458faa9a44d8 in_seq=0 out_seq=0 2024-09-19T09:07:14.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.785+0000 7ff889ffb640 10 client.25868 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.788+0000 7ff889ffb640 1 -- 172.21.15.1:0/2231892511 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff894005040 con 0x564982d3d0f0 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.788+0000 7ff889ffb640 10 client.25868 handle_command_reply: tid=0 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.788+0000 7ff8aae7e740 1 client.25868 shutdown 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 -- 172.21.15.1:0/2231892511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 msgr2=0x564982d2cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d2cd50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff898009b90 tx=0x7ff898004730 comp rx=0 tx=0).stop 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 -- 172.21.15.1:0/2231892511 shutdown_connections 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564982d3d0f0 0x564982d3f510 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d2a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 0x564982d2a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/2231892511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d2cd50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 -- 172.21.15.1:0/2231892511 >> 172.21.15.1:0/2231892511 conn(0x564982ceb310 msgr2=0x564982d249c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff889ffb640 0 client.25868 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:14.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 -- 172.21.15.1:0/2231892511 shutdown_connections 2024-09-19T09:07:14.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 1 -- 172.21.15.1:0/2231892511 wait complete. 2024-09-19T09:07:14.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.789+0000 7ff8aae7e740 20 client.25868 trim_cache size 0 max 16384 2024-09-19T09:07:14.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.802+0000 7ff8aae7e740 1 Processor -- start 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.802+0000 7ff8aae7e740 1 -- start start 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.802+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d39350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.802+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d44e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.802+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d2d370 0x564982d45360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.802+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a41add70 con 0x564982d23b40 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.802+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a41ab640 con 0x564982d225d0 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a41a94b0 con 0x564982d2d370 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d44e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d39350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d39350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45264/0 (socket says 172.21.15.1:45264) 2024-09-19T09:07:14.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 -- 172.21.15.1:0/1266155264 learned_addr learned my addr 172.21.15.1:0/1266155264 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a2d9d640 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d2d370 0x564982d45360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 -- 172.21.15.1:0/1266155264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d2d370 msgr2=0x564982d45360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d2d370 0x564982d45360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 -- 172.21.15.1:0/1266155264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 msgr2=0x564982d44e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d44e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 -- 172.21.15.1:0/1266155264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564982d23750 con 0x564982d225d0 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d44e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a2d9d640 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d2d370 0x564982d45360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff8a259c640 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d39350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff898019040 tx=0x7ff8980098d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d000e3809659dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.803+0000 7ff88bfff640 1 -- 172.21.15.1:0/1266155264 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898029ce0 con 0x564982d225d0 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff88bfff640 1 -- 172.21.15.1:0/1266155264 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff89801e7c0 con 0x564982d225d0 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff88bfff640 1 -- 172.21.15.1:0/1266155264 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898034e30 con 0x564982d225d0 2024-09-19T09:07:14.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1266155264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 msgr2=0x564982d39350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d39350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff898019040 tx=0x7ff8980098d0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1266155264 shutdown_connections 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d2d370 0x564982d45360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d23b40 0x564982d44e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1266155264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d39350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1266155264 >> 172.21.15.1:0/1266155264 conn(0x564982ceb310 msgr2=0x564982d252c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.804+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1266155264 shutdown_connections 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1266155264 wait complete. 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 -- start start 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 Processor -- start 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d270e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 0x564982d27620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d27b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a41a9b00 con 0x564982d2d370 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a41aaf70 con 0x564982d225d0 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a41aa1d0 con 0x564982d23b40 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8aae7e740 10 client.0 _ll_register_callbacks cb 0x7ff898012f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8a1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 0x564982d27620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8a259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d270e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45266/0 (socket says 172.21.15.1:45266) 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8a259c640 1 -- 172.21.15.1:0/1390719289 learned_addr learned my addr 172.21.15.1:0/1390719289 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.805+0000 7ff8a2d9d640 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8a259c640 1 -- 172.21.15.1:0/1390719289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 msgr2=0x564982d27620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8a259c640 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 0x564982d27620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8a259c640 1 -- 172.21.15.1:0/1390719289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 msgr2=0x564982d27b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:14.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8a259c640 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d27b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8a259c640 1 -- 172.21.15.1:0/1390719289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564982da6ec0 con 0x564982d225d0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8a2d9d640 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d27b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8a259c640 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d270e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff89803fec0 tx=0x7ff898012da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=564b5a84811b56ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff889ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff889ffb640 1 -- 172.21.15.1:0/1390719289 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898005440 con 0x564982d225d0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1390719289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564982c95860 con 0x564982d225d0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff889ffb640 1 -- 172.21.15.1:0/1390719289 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff89803f420 con 0x564982d225d0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff889ffb640 1 -- 172.21.15.1:0/1390719289 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff8980055e0 con 0x564982d225d0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8aae7e740 10 client.25874 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.806+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1390719289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564982da81a0 con 0x564982d225d0 2024-09-19T09:07:14.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff889ffb640 1 -- 172.21.15.1:0/1390719289 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x564982c95860 con 0x564982d225d0 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff889ffb640 1 -- 172.21.15.1:0/1390719289 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff898047020 con 0x564982d225d0 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff8aae7e740 10 client.25874 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff8aae7e740 10 client.25874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff8aae7e740 20 client.25874 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564982da8830 0x564982daac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff8aae7e740 4 client.25874 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1390719289 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564982c8fd70 con 0x564982da8830 2024-09-19T09:07:14.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.807+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564982da8830 0x564982daac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:14.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.808+0000 7ff889ffb640 10 client.25874 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.808+0000 7ff8a1d9b640 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564982da8830 0x564982daac50 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274949dcdbfbdad5 server_cookie=9ed41dd7f49896e6 in_seq=0 out_seq=0 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff889ffb640 1 -- 172.21.15.1:0/1390719289 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564982c8fd70 con 0x564982da8830 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff889ffb640 10 client.25874 handle_command_reply: tid=0 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 client.25874 shutdown 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1390719289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 msgr2=0x564982d270e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d270e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff89803fec0 tx=0x7ff898012da0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1390719289 shutdown_connections 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564982da8830 0x564982daac50 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564982d2d370 0x564982d27b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564982d23b40 0x564982d27620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 --2- 172.21.15.1:0/1390719289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564982d225d0 0x564982d270e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1390719289 >> 172.21.15.1:0/1390719289 conn(0x564982ceb310 msgr2=0x564982d1d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff889ffb640 0 client.25874 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:14.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.811+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1390719289 shutdown_connections 2024-09-19T09:07:14.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8aae7e740 1 -- 172.21.15.1:0/1390719289 wait complete. 2024-09-19T09:07:14.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8aae7e740 20 client.25874 trim_cache size 0 max 16384 2024-09-19T09:07:14.816 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:07:14.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff88c0a3240 msgr2=0x7ff88c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff88c0a3240 0x7ff88c0a5700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x564982d1fac0 tx=0x7ff898005f90 comp rx=0 tx=0).stop 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/1524643553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8a41082e0 msgr2=0x7ff8a4101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8a41082e0 0x7ff8a4101490 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00eb10 tx=0x7ff89c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/1524643553 shutdown_connections 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7ff88c0a3240 0x7ff88c0a5700 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8a41082e0 0x7ff8a4101490 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8a4103760 0x7ff8a4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.812+0000 7ff8a8aa5640 1 --2- 172.21.15.1:0/1524643553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8a4102db0 0x7ff8a4100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.813+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/1524643553 >> 172.21.15.1:0/1524643553 conn(0x7ff8a40fc7d0 msgr2=0x7ff8a4105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.813+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/1524643553 shutdown_connections 2024-09-19T09:07:14.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:14.813+0000 7ff8a8aa5640 1 -- 172.21.15.1:0/1524643553 wait complete. 2024-09-19T09:07:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f233affd640 1 -- 172.21.15.1:0/3133132040 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5593681c8d70 con 0x5593682e7a60 2024-09-19T09:07:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f233affd640 10 client.16329 handle_command_reply: tid=0 2024-09-19T09:07:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 client.16329 shutdown 2024-09-19T09:07:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 -- 172.21.15.1:0/3133132040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825e260 msgr2=0x559368275790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825e260 0x559368275790 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f23500057a0 tx=0x7f235009bef0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 -- 172.21.15.1:0/3133132040 shutdown_connections 2024-09-19T09:07:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5593682e7a60 0x5593682e9e80 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559368261330 0x559368276750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55936825e260 0x559368275790 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f233affd640 0 client.16329 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 --2- 172.21.15.1:0/3133132040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55936825d920 0x559368275250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 -- 172.21.15.1:0/3133132040 >> 172.21.15.1:0/3133132040 conn(0x559368259010 msgr2=0x55936825a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 -- 172.21.15.1:0/3133132040 shutdown_connections 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.965+0000 7f2364807740 1 -- 172.21.15.1:0/3133132040 wait complete. 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2364807740 20 client.16329 trim_cache size 0 max 16384 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:07:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:07:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:07:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:07:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 -- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23440a3380 msgr2=0x7f23440a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23440a3380 0x7f23440a5840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f234c02aa00 tx=0x7f234c031640 comp rx=0 tx=0).stop 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 -- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c102d40 msgr2=0x7f235c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c102d40 0x7f235c198490 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f235000e9f0 tx=0x7f235000edf0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 -- 172.21.15.1:0/1716960429 shutdown_connections 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f235c103700 0x7f235c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f235c102d40 0x7f235c198490 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f23440a3380 0x7f23440a5840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 --2- 172.21.15.1:0/1716960429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235c101b50 0x7f235c197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 -- 172.21.15.1:0/1716960429 >> 172.21.15.1:0/1716960429 conn(0x7f235c0fd2f0 msgr2=0x7f235c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 -- 172.21.15.1:0/1716960429 shutdown_connections 2024-09-19T09:07:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:14.966+0000 7f2361a65640 1 -- 172.21.15.1:0/1716960429 wait complete. 2024-09-19T09:07:15.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:15 smithi001 ceph-mon[30939]: pgmap v432: 97 pgs: 97 active+clean; 146 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 857 op/s 2024-09-19T09:07:15.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:15 smithi022 ceph-mon[35107]: pgmap v432: 97 pgs: 97 active+clean; 146 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 857 op/s 2024-09-19T09:07:16.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:15 smithi064 ceph-mon[35179]: pgmap v432: 97 pgs: 97 active+clean; 146 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 857 op/s 2024-09-19T09:07:16.652 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:07:16.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:07:16.940 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.214+0000 7f815d7fa640 1 -- 172.21.15.1:0/894080217 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556163f53d20 con 0x55616406d220 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.214+0000 7f815d7fa640 10 client.25805 handle_command_reply: tid=0 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.214+0000 7f817de4b740 1 client.25805 shutdown 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 -- 172.21.15.1:0/894080217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 msgr2=0x556163ff5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163ff5e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x556163fd47d0 tx=0x7f8164003f80 comp rx=0 tx=0).stop 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 -- 172.21.15.1:0/894080217 shutdown_connections 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55616406d220 0x55616406f640 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556163ff1940 0x556163ff6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556163fe7080 0x556163ff5e40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 --2- 172.21.15.1:0/894080217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x556163fe6760 0x556163ff5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f815d7fa640 0 client.25805 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 -- 172.21.15.1:0/894080217 >> 172.21.15.1:0/894080217 conn(0x556163fe2cf0 msgr2=0x556163ff0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 -- 172.21.15.1:0/894080217 shutdown_connections 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 1 -- 172.21.15.1:0/894080217 wait complete. 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.215+0000 7f817de4b740 20 client.25805 trim_cache size 0 max 16384 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 25, 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:07:17.217 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 14, 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "855efd89": { 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 14, 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 136.6, 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:07:17.218 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:17.219 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 -- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81600a3240 msgr2=0x7f81600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81600a3240 0x7f81600a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f81700cdbb0 tx=0x7f81700d3840 comp rx=0 tx=0).stop 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 -- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8174102d30 msgr2=0x7f8174100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8174102d30 0x7f8174100990 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f817000e9f0 tx=0x7f817000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 -- 172.21.15.1:0/2295448597 shutdown_connections 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f81600a3240 0x7f81600a5700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81741082a0 0x7f8174101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81741036e0 0x7f8174100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 --2- 172.21.15.1:0/2295448597 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8174102d30 0x7f8174100990 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 -- 172.21.15.1:0/2295448597 >> 172.21.15.1:0/2295448597 conn(0x7f81740fc7d0 msgr2=0x7f8174106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 -- 172.21.15.1:0/2295448597 shutdown_connections 2024-09-19T09:07:17.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.216+0000 7f817ba72640 1 -- 172.21.15.1:0/2295448597 wait complete. 2024-09-19T09:07:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 -- 172.21.15.1:0/3120176288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901036e0 msgr2=0x7f3090107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 --2- 172.21.15.1:0/3120176288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901036e0 0x7f3090107b90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3084009930 tx=0x7f308402a420 comp rx=0 tx=0).stop 2024-09-19T09:07:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 -- 172.21.15.1:0/3120176288 shutdown_connections 2024-09-19T09:07:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 --2- 172.21.15.1:0/3120176288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30901082a0 0x7f309010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 --2- 172.21.15.1:0/3120176288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901036e0 0x7f3090107b90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 --2- 172.21.15.1:0/3120176288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3090102d30 0x7f3090103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 -- 172.21.15.1:0/3120176288 >> 172.21.15.1:0/3120176288 conn(0x7f30900fc7d0 msgr2=0x7f30900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 -- 172.21.15.1:0/3120176288 shutdown_connections 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.406+0000 7f3094995640 1 -- 172.21.15.1:0/3120176288 wait complete. 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f3094995640 1 Processor -- start 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f3094995640 1 -- start start 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f3094995640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3090102d30 0x7f3090100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f3094995640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30901036e0 0x7f3090100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f3094995640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901082a0 0x7f3090101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f3094995640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30901121c0 con 0x7f30901082a0 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f3094995640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3090112040 con 0x7f3090102d30 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f3094995640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3090112340 con 0x7f30901036e0 2024-09-19T09:07:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901082a0 0x7f3090101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30901036e0 0x7f3090100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901082a0 0x7f3090101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58680/0 (socket says 172.21.15.1:58680) 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308ed9d640 1 -- 172.21.15.1:0/1015779424 learned_addr learned my addr 172.21.15.1:0/1015779424 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308e59c640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3090102d30 0x7f3090100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308ed9d640 1 -- 172.21.15.1:0/1015779424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30901036e0 msgr2=0x7f3090100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308ed9d640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30901036e0 0x7f3090100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308ed9d640 1 -- 172.21.15.1:0/1015779424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3090102d30 msgr2=0x7f3090100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308ed9d640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3090102d30 0x7f3090100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308ed9d640 1 -- 172.21.15.1:0/1015779424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30901a6c20 con 0x7f30901082a0 2024-09-19T09:07:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.407+0000 7f308dd9b640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30901036e0 0x7f3090100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.408+0000 7f308ed9d640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901082a0 0x7f3090101410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3088009fd0 tx=0x7f308800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.408+0000 7f307f7fe640 1 -- 172.21.15.1:0/1015779424 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088017070 con 0x7f30901082a0 2024-09-19T09:07:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.408+0000 7f307f7fe640 1 -- 172.21.15.1:0/1015779424 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3088004020 con 0x7f30901082a0 2024-09-19T09:07:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.408+0000 7f3094995640 1 -- 172.21.15.1:0/1015779424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30901a6f10 con 0x7f30901082a0 2024-09-19T09:07:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.408+0000 7f307f7fe640 1 -- 172.21.15.1:0/1015779424 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30880106c0 con 0x7f30901082a0 2024-09-19T09:07:17.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.408+0000 7f3094995640 1 -- 172.21.15.1:0/1015779424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30901a73d0 con 0x7f30901082a0 2024-09-19T09:07:17.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.410+0000 7f307f7fe640 1 -- 172.21.15.1:0/1015779424 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f30880041d0 con 0x7f30901082a0 2024-09-19T09:07:17.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.410+0000 7f3096d6e740 1 Processor -- start 2024-09-19T09:07:17.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f3096d6e740 1 -- start start 2024-09-19T09:07:17.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4de9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f3096d6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d9e4d4f280 con 0x55d9e4de9b60 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f3096d6e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d9e4cf6b10 con 0x55d9e4dea480 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f3096d6e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d9e4d4b240 con 0x55d9e4df4d40 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4de9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4de9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58694/0 (socket says 172.21.15.1:58694) 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f307f7fe640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30780a32c0 0x7f30780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f308dd9b640 1 -- 172.21.15.1:0/1149753214 learned_addr learned my addr 172.21.15.1:0/1149753214 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f308e59c640 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f308ed9d640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30780a32c0 0x7f30780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f308dd9b640 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.411+0000 7f307f7fe640 1 -- 172.21.15.1:0/1015779424 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f30880cf4b0 con 0x7f30901082a0 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f308dd9b640 1 -- 172.21.15.1:0/1149753214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 msgr2=0x55d9e4df7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f308dd9b640 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f308dd9b640 1 -- 172.21.15.1:0/1149753214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 msgr2=0x55d9e4df4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f308dd9b640 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f308dd9b640 1 -- 172.21.15.1:0/1149753214 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e4d031f0 con 0x55d9e4de9b60 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f308e59c640 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f308dd9b640 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4de9f40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3084005dc0 tx=0x7f3084005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591a57433c462602 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f308ed9d640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30780a32c0 0x7f30780a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f308809baf0 tx=0x7f308800bf30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f307cff9640 1 -- 172.21.15.1:0/1149753214 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084044030 con 0x55d9e4de9b60 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f307cff9640 1 -- 172.21.15.1:0/1149753214 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3084005040 con 0x55d9e4de9b60 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.412+0000 7f307cff9640 1 -- 172.21.15.1:0/1149753214 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084035040 con 0x55d9e4de9b60 2024-09-19T09:07:17.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 -- 172.21.15.1:0/1149753214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 msgr2=0x55d9e4de9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4de9f40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3084005dc0 tx=0x7f3084005d50 comp rx=0 tx=0).stop 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 -- 172.21.15.1:0/1149753214 shutdown_connections 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 --2- 172.21.15.1:0/1149753214 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4de9f40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 -- 172.21.15.1:0/1149753214 >> 172.21.15.1:0/1149753214 conn(0x55d9e4de60f0 msgr2=0x55d9e4de64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 -- 172.21.15.1:0/1149753214 shutdown_connections 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 -- 172.21.15.1:0/1149753214 wait complete. 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 -- start start 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.413+0000 7f3096d6e740 1 Processor -- start 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4df1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f3096d6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d9e4df7910 con 0x55d9e4de9b60 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f3096d6e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d9e4d09f10 con 0x55d9e4dea480 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f3096d6e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d9e4df7a90 con 0x55d9e4df4d40 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f3096d6e740 10 client.0 _ll_register_callbacks cb 0x55d9e4cd2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4df1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4df1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58698/0 (socket says 172.21.15.1:58698) 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308dd9b640 1 -- 172.21.15.1:0/2428311115 learned_addr learned my addr 172.21.15.1:0/2428311115 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308e59c640 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308e59c640 1 -- 172.21.15.1:0/2428311115 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 msgr2=0x55d9e4df2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308e59c640 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308e59c640 1 -- 172.21.15.1:0/2428311115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 msgr2=0x55d9e4df1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:17.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308e59c640 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4df1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308e59c640 1 -- 172.21.15.1:0/2428311115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e4ac06a0 con 0x55d9e4dea480 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4df1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f308e59c640 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df2200 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3080005d00 tx=0x7f30800118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79758c47c2c529a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.414+0000 7f3075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3075ffb640 1 -- 172.21.15.1:0/2428311115 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080004020 con 0x55d9e4dea480 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3075ffb640 1 -- 172.21.15.1:0/2428311115 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f30800041c0 con 0x55d9e4dea480 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 1 -- 172.21.15.1:0/2428311115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3084005040 con 0x55d9e4dea480 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3075ffb640 1 -- 172.21.15.1:0/2428311115 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30800043c0 con 0x55d9e4dea480 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 10 client.25886 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 1 -- 172.21.15.1:0/2428311115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d9e4e03530 con 0x55d9e4dea480 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3075ffb640 1 -- 172.21.15.1:0/2428311115 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3084005040 con 0x55d9e4dea480 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3075ffb640 1 -- 172.21.15.1:0/2428311115 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3080003bc0 con 0x55d9e4dea480 2024-09-19T09:07:17.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 10 client.25886 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 10 client.25886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 20 client.25886 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55d9e4e04a40 0x55d9e4e06e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 4 client.25886 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.415+0000 7f3096d6e740 1 -- 172.21.15.1:0/2428311115 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9e4d5c7f0 con 0x55d9e4e04a40 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.416+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55d9e4e04a40 0x55d9e4e06e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.416+0000 7f3075ffb640 10 client.25886 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.416+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55d9e4e04a40 0x55d9e4e06e50 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c408e5e53839fcc4 server_cookie=316f68a6ccc26b48 in_seq=0 out_seq=0 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3075ffb640 1 -- 172.21.15.1:0/2428311115 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9e4d5c7f0 con 0x55d9e4e04a40 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3075ffb640 10 client.25886 handle_command_reply: tid=0 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 client.25886 shutdown 2024-09-19T09:07:17.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 -- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 msgr2=0x55d9e4df2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df2200 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3080005d00 tx=0x7f30800118d0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 -- 172.21.15.1:0/2428311115 shutdown_connections 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55d9e4e04a40 0x55d9e4e06e50 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df2200 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3075ffb640 0 client.25886 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2428311115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4de9b60 0x55d9e4df1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 -- 172.21.15.1:0/2428311115 >> 172.21.15.1:0/2428311115 conn(0x55d9e4de60f0 msgr2=0x55d9e4debe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 -- 172.21.15.1:0/2428311115 shutdown_connections 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 1 -- 172.21.15.1:0/2428311115 wait complete. 2024-09-19T09:07:17.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.417+0000 7f3096d6e740 20 client.25886 trim_cache size 0 max 16384 2024-09-19T09:07:17.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f3096d6e740 1 Processor -- start 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f3096d6e740 1 -- start start 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4de9b60 0x55d9e4dec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4df4d40 0x55d9e4e0c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f3096d6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30901b21e0 con 0x55d9e4df4d40 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f3096d6e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30901afab0 con 0x55d9e4dea480 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f3096d6e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f30901ad900 con 0x55d9e4de9b60 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4df4d40 0x55d9e4e0c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4df4d40 0x55d9e4e0c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58710/0 (socket says 172.21.15.1:58710) 2024-09-19T09:07:17.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 -- 172.21.15.1:0/2469859874 learned_addr learned my addr 172.21.15.1:0/2469859874 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308e59c640 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4de9b60 0x55d9e4dec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 -- 172.21.15.1:0/2469859874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4de9b60 msgr2=0x55d9e4dec5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4de9b60 0x55d9e4dec5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 -- 172.21.15.1:0/2469859874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 msgr2=0x55d9e4df3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308dd9b640 1 -- 172.21.15.1:0/2469859874 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e4decb00 con 0x55d9e4df4d40 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.435+0000 7f308e59c640 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4df4d40 0x55d9e4e0c760 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3084005ec0 tx=0x7f3084009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8515762a73ae3bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f3077fff640 1 -- 172.21.15.1:0/2469859874 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084035040 con 0x55d9e4df4d40 2024-09-19T09:07:17.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f3077fff640 1 -- 172.21.15.1:0/2469859874 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3084005610 con 0x55d9e4df4d40 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f3077fff640 1 -- 172.21.15.1:0/2469859874 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084044040 con 0x55d9e4df4d40 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f3096d6e740 1 -- 172.21.15.1:0/2469859874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4df4d40 msgr2=0x55d9e4e0c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4df4d40 0x55d9e4e0c760 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3084005ec0 tx=0x7f3084009520 comp rx=0 tx=0).stop 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f3096d6e740 1 -- 172.21.15.1:0/2469859874 shutdown_connections 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4df4d40 0x55d9e4e0c760 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.436+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4dea480 0x55d9e4df3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2469859874 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4de9b60 0x55d9e4dec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 -- 172.21.15.1:0/2469859874 >> 172.21.15.1:0/2469859874 conn(0x55d9e4de60f0 msgr2=0x55d9e4df3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 -- 172.21.15.1:0/2469859874 shutdown_connections 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 -- 172.21.15.1:0/2469859874 wait complete. 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 -- start start 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 Processor -- start 2024-09-19T09:07:17.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4de9b60 0x55d9e4dfcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4dea480 0x55d9e4dfd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30901adf70 con 0x55d9e4dea480 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30901af3e0 con 0x55d9e4de9b60 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f30901ae640 con 0x55d9e4df4d40 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f3096d6e740 10 client.0 _ll_register_callbacks cb 0x7f308000bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f308e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4dea480 0x55d9e4dfd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f308dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4de9b60 0x55d9e4dfcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f308e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4dea480 0x55d9e4dfd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58726/0 (socket says 172.21.15.1:58726) 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.437+0000 7f308e59c640 1 -- 172.21.15.1:0/2918738506 learned_addr learned my addr 172.21.15.1:0/2918738506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f308dd9b640 1 -- 172.21.15.1:0/2918738506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 msgr2=0x55d9e4df9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f308dd9b640 1 -- 172.21.15.1:0/2918738506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4dea480 msgr2=0x55d9e4dfd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4dea480 0x55d9e4dfd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f308dd9b640 1 -- 172.21.15.1:0/2918738506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e4dfa3c0 con 0x55d9e4de9b60 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f308e59c640 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4dea480 0x55d9e4dfd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f308dd9b640 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4de9b60 0x55d9e4dfcec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3084005ec0 tx=0x7f3084003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299f52430f26be5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f3075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f3075ffb640 1 -- 172.21.15.1:0/2918738506 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084035020 con 0x55d9e4de9b60 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f3075ffb640 1 -- 172.21.15.1:0/2918738506 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3084004040 con 0x55d9e4de9b60 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f3096d6e740 1 -- 172.21.15.1:0/2918738506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3084005610 con 0x55d9e4de9b60 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f3075ffb640 1 -- 172.21.15.1:0/2918738506 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3084044070 con 0x55d9e4de9b60 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f3096d6e740 10 client.25892 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f3096d6e740 1 -- 172.21.15.1:0/2918738506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d9e4e70180 con 0x55d9e4de9b60 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.438+0000 7f3075ffb640 1 -- 172.21.15.1:0/2918738506 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3084005610 con 0x55d9e4de9b60 2024-09-19T09:07:17.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f3075ffb640 1 -- 172.21.15.1:0/2918738506 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3084004930 con 0x55d9e4de9b60 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f3096d6e740 10 client.25892 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f3096d6e740 10 client.25892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f3096d6e740 20 client.25892 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55d9e4e04a40 0x55d9e4e72360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f3096d6e740 4 client.25892 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f3096d6e740 1 -- 172.21.15.1:0/2918738506 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d9e4d56d00 con 0x55d9e4e04a40 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f308e59c640 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55d9e4e04a40 0x55d9e4e72360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f3075ffb640 10 client.25892 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:17.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.439+0000 7f308e59c640 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55d9e4e04a40 0x55d9e4e72360 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25241eecb8449f42 server_cookie=373314ee187a92b7 in_seq=0 out_seq=0 2024-09-19T09:07:17.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3075ffb640 1 -- 172.21.15.1:0/2918738506 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d9e4d56d00 con 0x55d9e4e04a40 2024-09-19T09:07:17.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3075ffb640 10 client.25892 handle_command_reply: tid=0 2024-09-19T09:07:17.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 client.25892 shutdown 2024-09-19T09:07:17.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 -- 172.21.15.1:0/2918738506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4de9b60 msgr2=0x55d9e4dfcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4de9b60 0x55d9e4dfcec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3084005ec0 tx=0x7f3084003d50 comp rx=0 tx=0).stop 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 -- 172.21.15.1:0/2918738506 shutdown_connections 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x55d9e4e04a40 0x55d9e4e72360 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d9e4df4d40 0x55d9e4df9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d9e4dea480 0x55d9e4dfd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 --2- 172.21.15.1:0/2918738506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9e4de9b60 0x55d9e4dfcec0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 -- 172.21.15.1:0/2918738506 >> 172.21.15.1:0/2918738506 conn(0x55d9e4de60f0 msgr2=0x55d9e4df3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3075ffb640 0 client.25892 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 -- 172.21.15.1:0/2918738506 shutdown_connections 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.440+0000 7f3096d6e740 1 -- 172.21.15.1:0/2918738506 wait complete. 2024-09-19T09:07:17.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3096d6e740 20 client.25892 trim_cache size 0 max 16384 2024-09-19T09:07:17.448 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:07:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:07:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "f858db19-739a-4555-aefb-db75065baae5", 2024-09-19T09:07:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:07:17.448 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:07:17.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 -- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30780a32c0 msgr2=0x7f30780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30780a32c0 0x7f30780a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f308809baf0 tx=0x7f308800bf30 comp rx=0 tx=0).stop 2024-09-19T09:07:17.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 -- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901082a0 msgr2=0x7f3090101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:17.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901082a0 0x7f3090101410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3088009fd0 tx=0x7f308800b260 comp rx=0 tx=0).stop 2024-09-19T09:07:17.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 -- 172.21.15.1:0/1015779424 shutdown_connections 2024-09-19T09:07:17.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30901082a0 0x7f3090101410 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f30780a32c0 0x7f30780a5780 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30901036e0 0x7f3090100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 --2- 172.21.15.1:0/1015779424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3090102d30 0x7f3090100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:17.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 -- 172.21.15.1:0/1015779424 >> 172.21.15.1:0/1015779424 conn(0x7f30900fc7d0 msgr2=0x7f3090106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:17.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.441+0000 7f3094995640 1 -- 172.21.15.1:0/1015779424 shutdown_connections 2024-09-19T09:07:17.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:17.442+0000 7f3094995640 1 -- 172.21.15.1:0/1015779424 wait complete. 2024-09-19T09:07:17.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:17 smithi022 ceph-mon[35107]: pgmap v433: 97 pgs: 97 active+clean; 142 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 968 op/s 2024-09-19T09:07:17.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:17 smithi022 ceph-mon[35107]: scrub queued for path: / 2024-09-19T09:07:17.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:17 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:17.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:17 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:17 smithi001 ceph-mon[30939]: pgmap v433: 97 pgs: 97 active+clean; 142 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 968 op/s 2024-09-19T09:07:18.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:17 smithi001 ceph-mon[30939]: scrub queued for path: / 2024-09-19T09:07:18.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:17 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:17 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:17 smithi064 ceph-mon[35179]: pgmap v433: 97 pgs: 97 active+clean; 142 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 968 op/s 2024-09-19T09:07:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:17 smithi064 ceph-mon[35179]: scrub queued for path: / 2024-09-19T09:07:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:17 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:17 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:18.376 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:07:18.825 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '855efd89', quiesce took 11.8 seconds. Will release after: 4.800000000000001 2024-09-19T09:07:18.867 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:18.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:18 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.985 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.987 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.987 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.987 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.987 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:07:18.987 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:18.987 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:18 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:18 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:07:19.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.345+0000 7f61d2fea640 1 -- 172.21.15.1:0/1955770516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 msgr2=0x7f61cc10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.345+0000 7f61d2fea640 1 --2- 172.21.15.1:0/1955770516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 0x7f61cc10eaf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009cd0 tx=0x7f61c402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 -- 172.21.15.1:0/1955770516 shutdown_connections 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 --2- 172.21.15.1:0/1955770516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 0x7f61cc10eaf0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 --2- 172.21.15.1:0/1955770516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61cc100ca0 0x7f61cc106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 --2- 172.21.15.1:0/1955770516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61cc1002f0 0x7f61cc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 -- 172.21.15.1:0/1955770516 >> 172.21.15.1:0/1955770516 conn(0x7f61cc077210 msgr2=0x7f61cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 -- 172.21.15.1:0/1955770516 shutdown_connections 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 -- 172.21.15.1:0/1955770516 wait complete. 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 Processor -- start 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.346+0000 7f61d2fea640 1 -- start start 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d2fea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61cc1002f0 0x7f61cc198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d2fea640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61cc100ca0 0x7f61cc198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d2fea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 0x7f61cc19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d2fea640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1120c0 con 0x7f61cc106f50 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d2fea640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc111f40 con 0x7f61cc1002f0 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d2fea640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc112240 con 0x7f61cc100ca0 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 0x7f61cc19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 0x7f61cc19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58746/0 (socket says 172.21.15.1:58746) 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 -- 172.21.15.1:0/795676509 learned_addr learned my addr 172.21.15.1:0/795676509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d0d86640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61cc1002f0 0x7f61cc198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61c3fff640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61cc100ca0 0x7f61cc198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 -- 172.21.15.1:0/795676509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61cc100ca0 msgr2=0x7f61cc198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61cc100ca0 0x7f61cc198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 -- 172.21.15.1:0/795676509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61cc1002f0 msgr2=0x7f61cc198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61cc1002f0 0x7f61cc198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 -- 172.21.15.1:0/795676509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc19d4d0 con 0x7f61cc106f50 2024-09-19T09:07:19.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.347+0000 7f61d1587640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 0x7f61cc19cdf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f61c4006010 tx=0x7f61c4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:19.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.348+0000 7f61c1ffb640 1 -- 172.21.15.1:0/795676509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c4031c80 con 0x7f61cc106f50 2024-09-19T09:07:19.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.348+0000 7f61c1ffb640 1 -- 172.21.15.1:0/795676509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61c4031e20 con 0x7f61cc106f50 2024-09-19T09:07:19.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.348+0000 7f61d2fea640 1 -- 172.21.15.1:0/795676509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61cc19d760 con 0x7f61cc106f50 2024-09-19T09:07:19.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.348+0000 7f61c1ffb640 1 -- 172.21.15.1:0/795676509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c403a420 con 0x7f61cc106f50 2024-09-19T09:07:19.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.348+0000 7f61d2fea640 1 -- 172.21.15.1:0/795676509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61cc1a50a0 con 0x7f61cc106f50 2024-09-19T09:07:19.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.350+0000 7f61c1ffb640 1 -- 172.21.15.1:0/795676509 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f61c4004040 con 0x7f61cc106f50 2024-09-19T09:07:19.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d53c3740 1 Processor -- start 2024-09-19T09:07:19.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d53c3740 1 -- start start 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716dc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716eb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 0x558b716ede80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d53c3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558b716422e0 con 0x558b716dcc80 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d53c3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558b715e9ce0 con 0x558b716dc360 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d53c3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558b7163e2a0 con 0x558b716eba90 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d0d86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d0d86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716eb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58752/0 (socket says 172.21.15.1:58752) 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d0d86640 1 -- 172.21.15.1:0/3473946168 learned_addr learned my addr 172.21.15.1:0/3473946168 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61c1ffb640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f61b40a3240 0x7f61b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61c3fff640 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716dc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61c3fff640 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 0x558b716ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d0d86640 1 -- 172.21.15.1:0/3473946168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 msgr2=0x558b716ede80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d0d86640 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 0x558b716ede80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.351+0000 7f61d0d86640 1 -- 172.21.15.1:0/3473946168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 msgr2=0x558b716dc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61d0d86640 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716dc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61d0d86640 1 -- 172.21.15.1:0/3473946168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b715ce440 con 0x558b716dcc80 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61c1ffb640 1 -- 172.21.15.1:0/795676509 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f61c40f06e0 con 0x7f61cc106f50 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61d1587640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f61b40a3240 0x7f61b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61c3fff640 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716dc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61d0d86640 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716eb550 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f61c800bcd0 tx=0x7f61c80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4f1ad8559b4b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61b2ffd640 1 -- 172.21.15.1:0/3473946168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8005220 con 0x558b716dcc80 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61b2ffd640 1 -- 172.21.15.1:0/3473946168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61c8004ca0 con 0x558b716dcc80 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61b2ffd640 1 -- 172.21.15.1:0/3473946168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8011840 con 0x558b716dcc80 2024-09-19T09:07:19.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.352+0000 7f61d1587640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f61b40a3240 0x7f61b40a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f61c40ee160 tx=0x7f61c40a7040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 -- 172.21.15.1:0/3473946168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 msgr2=0x558b716eb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716eb550 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f61c800bcd0 tx=0x7f61c80107a0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 -- 172.21.15.1:0/3473946168 shutdown_connections 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 0x558b716ede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716eb550 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 --2- 172.21.15.1:0/3473946168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716dc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 -- 172.21.15.1:0/3473946168 >> 172.21.15.1:0/3473946168 conn(0x558b716d8a30 msgr2=0x558b716d8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 -- 172.21.15.1:0/3473946168 shutdown_connections 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 -- 172.21.15.1:0/3473946168 wait complete. 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 -- start start 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.353+0000 7f61d53c3740 1 Processor -- start 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716eb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716e86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 0x558b716e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d53c3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558b716ee660 con 0x558b716dcc80 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d53c3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558b715fd050 con 0x558b716dc360 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d53c3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558b716ee7e0 con 0x558b716eba90 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d53c3740 10 client.0 _ll_register_callbacks cb 0x558b7163d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716e86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716e86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58754/0 (socket says 172.21.15.1:58754) 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 -- 172.21.15.1:0/484818477 learned_addr learned my addr 172.21.15.1:0/484818477 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61c3fff640 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61c3fff640 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 0x558b716e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 -- 172.21.15.1:0/484818477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 msgr2=0x558b716e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 0x558b716e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 -- 172.21.15.1:0/484818477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 msgr2=0x558b716eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716eb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 -- 172.21.15.1:0/484818477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b713b33c0 con 0x558b716dcc80 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61d0d86640 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716e86c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f61c8005940 tx=0x7f61c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2879e23e1239b42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.354+0000 7f61abfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61abfff640 1 -- 172.21.15.1:0/484818477 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c800b8c0 con 0x558b716dcc80 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61abfff640 1 -- 172.21.15.1:0/484818477 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f61c8004020 con 0x558b716dcc80 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 1 -- 172.21.15.1:0/484818477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c8004ca0 con 0x558b716dcc80 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61abfff640 1 -- 172.21.15.1:0/484818477 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61c8004220 con 0x558b716dcc80 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 10 client.16413 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 1 -- 172.21.15.1:0/484818477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558b716fa090 con 0x558b716dcc80 2024-09-19T09:07:19.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61abfff640 1 -- 172.21.15.1:0/484818477 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61c8004ca0 con 0x558b716dcc80 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61abfff640 1 -- 172.21.15.1:0/484818477 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f61c8003c30 con 0x558b716dcc80 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 10 client.16413 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 20 client.16413 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b716fb3e0 0x558b716fd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 4 client.16413 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.355+0000 7f61d53c3740 1 -- 172.21.15.1:0/484818477 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b7164f850 con 0x558b716fb3e0 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.356+0000 7f61c3fff640 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b716fb3e0 0x558b716fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.356+0000 7f61c3fff640 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b716fb3e0 0x558b716fd7d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c010dd1826068670 server_cookie=1cebd7dc0ba258e9 in_seq=0 out_seq=0 2024-09-19T09:07:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.356+0000 7f61abfff640 10 client.16413 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61abfff640 1 -- 172.21.15.1:0/484818477 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b7164f850 con 0x558b716fb3e0 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61abfff640 10 client.16413 handle_command_reply: tid=0 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 client.16413 shutdown 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 -- 172.21.15.1:0/484818477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 msgr2=0x558b716e86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716e86c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f61c8005940 tx=0x7f61c80048f0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 -- 172.21.15.1:0/484818477 shutdown_connections 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b716fb3e0 0x558b716fd7d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716eba90 0x558b716e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716e86c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 --2- 172.21.15.1:0/484818477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dc360 0x558b716eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 -- 172.21.15.1:0/484818477 >> 172.21.15.1:0/484818477 conn(0x558b716d8a30 msgr2=0x558b716de790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61abfff640 0 client.16413 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 -- 172.21.15.1:0/484818477 shutdown_connections 2024-09-19T09:07:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 1 -- 172.21.15.1:0/484818477 wait complete. 2024-09-19T09:07:19.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.357+0000 7f61d53c3740 20 client.16413 trim_cache size 0 max 16384 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.374+0000 7f61d53c3740 1 Processor -- start 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.374+0000 7f61d53c3740 1 -- start start 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.374+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716f7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.374+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dcc80 0x558b716ea630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.374+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716eba90 0x558b71702e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.374+0000 7f61d53c3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1adec0 con 0x558b716eba90 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.374+0000 7f61d53c3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1ab790 con 0x558b716dcc80 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.374+0000 7f61d53c3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1a95e0 con 0x558b716dc360 2024-09-19T09:07:19.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716eba90 0x558b71702e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716eba90 0x558b71702e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58758/0 (socket says 172.21.15.1:58758) 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 -- 172.21.15.1:0/2165693593 learned_addr learned my addr 172.21.15.1:0/2165693593 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61d0d86640 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dcc80 0x558b716ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 -- 172.21.15.1:0/2165693593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 msgr2=0x558b716f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716f7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 -- 172.21.15.1:0/2165693593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dcc80 msgr2=0x558b716ea630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dcc80 0x558b716ea630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 -- 172.21.15.1:0/2165693593 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b716d8860 con 0x558b716eba90 2024-09-19T09:07:19.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61d0d86640 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dcc80 0x558b716ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:19.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61c3fff640 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716eba90 0x558b71702e80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0ff780 tx=0x7f61bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e336a18aa27e745 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:19.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61b27fc640 1 -- 172.21.15.1:0/2165693593 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc010880 con 0x558b716eba90 2024-09-19T09:07:19.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61b27fc640 1 -- 172.21.15.1:0/2165693593 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61bc026070 con 0x558b716eba90 2024-09-19T09:07:19.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.375+0000 7f61b27fc640 1 -- 172.21.15.1:0/2165693593 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0047a0 con 0x558b716eba90 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 -- 172.21.15.1:0/2165693593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716eba90 msgr2=0x558b71702e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716eba90 0x558b71702e80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0ff780 tx=0x7f61bc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 -- 172.21.15.1:0/2165693593 shutdown_connections 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716eba90 0x558b71702e80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716dcc80 0x558b716ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 --2- 172.21.15.1:0/2165693593 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 -- 172.21.15.1:0/2165693593 >> 172.21.15.1:0/2165693593 conn(0x558b716d8a30 msgr2=0x558b716e9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 -- 172.21.15.1:0/2165693593 shutdown_connections 2024-09-19T09:07:19.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 -- 172.21.15.1:0/2165693593 wait complete. 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 -- start start 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.376+0000 7f61d53c3740 1 Processor -- start 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716ef840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716efd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d53c3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716eba90 0x558b716f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d53c3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1a9c50 con 0x558b716dcc80 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d53c3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1ab0c0 con 0x558b716eba90 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d53c3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1aa320 con 0x558b716dc360 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d53c3740 10 client.0 _ll_register_callbacks cb 0x7f61c800bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716efd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58774/0 (socket says 172.21.15.1:58774) 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 -- 172.21.15.1:0/1724054880 learned_addr learned my addr 172.21.15.1:0/1724054880 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61c3fff640 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716eba90 0x558b716f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61c3fff640 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 -- 172.21.15.1:0/1724054880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 msgr2=0x558b716ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 -- 172.21.15.1:0/1724054880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716eba90 msgr2=0x558b716f02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716eba90 0x558b716f02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 -- 172.21.15.1:0/1724054880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b716d96c0 con 0x558b716dcc80 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61c3fff640 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61d0d86640 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716efd80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f61c8011fc0 tx=0x7f61c8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993246290271ab89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.377+0000 7f61abfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61abfff640 1 -- 172.21.15.1:0/1724054880 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8010ca0 con 0x558b716dcc80 2024-09-19T09:07:19.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61abfff640 1 -- 172.21.15.1:0/1724054880 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f61c800b810 con 0x558b716dcc80 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 1 -- 172.21.15.1:0/1724054880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61bc026070 con 0x558b716dcc80 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61abfff640 1 -- 172.21.15.1:0/1724054880 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61c803f050 con 0x558b716dcc80 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 10 client.16419 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 1 -- 172.21.15.1:0/1724054880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558b71765f60 con 0x558b716dcc80 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61abfff640 1 -- 172.21.15.1:0/1724054880 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61bc026070 con 0x558b716dcc80 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61abfff640 1 -- 172.21.15.1:0/1724054880 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f61c801b730 con 0x558b716dcc80 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 10 client.16419 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 20 client.16419 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b717666e0 0x558b71768b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 4 client.16419 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.378+0000 7f61d53c3740 1 -- 172.21.15.1:0/1724054880 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558b71649d60 con 0x558b717666e0 2024-09-19T09:07:19.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61c3fff640 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b717666e0 0x558b71768b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61c3fff640 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b717666e0 0x558b71768b00 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feeae1a5e161039a server_cookie=cd6c02042644045b in_seq=0 out_seq=0 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61abfff640 10 client.16419 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61abfff640 1 -- 172.21.15.1:0/1724054880 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558b71649d60 con 0x558b717666e0 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61abfff640 10 client.16419 handle_command_reply: tid=0 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 client.16419 shutdown 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 -- 172.21.15.1:0/1724054880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 msgr2=0x558b716efd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716efd80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f61c8011fc0 tx=0x7f61c8001e50 comp rx=0 tx=0).stop 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 -- 172.21.15.1:0/1724054880 shutdown_connections 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558b717666e0 0x558b71768b00 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558b716eba90 0x558b716f02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61abfff640 0 client.16419 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558b716dcc80 0x558b716efd80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 --2- 172.21.15.1:0/1724054880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558b716dc360 0x558b716ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.379+0000 7f61d53c3740 1 -- 172.21.15.1:0/1724054880 >> 172.21.15.1:0/1724054880 conn(0x558b716d8a30 msgr2=0x558b716d7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d53c3740 1 -- 172.21.15.1:0/1724054880 shutdown_connections 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d53c3740 1 -- 172.21.15.1:0/1724054880 wait complete. 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d53c3740 20 client.16419 trim_cache size 0 max 16384 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stdout: "f858db19-739a-4555-aefb-db75065baae5": { 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:07:19.387 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "f858db19-739a-4555-aefb-db75065baae5", 2024-09-19T09:07:19.388 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:07:19.388 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:19.388 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:19.388 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:07:19.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 -- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f61b40a3240 msgr2=0x7f61b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f61b40a3240 0x7f61b40a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f61c40ee160 tx=0x7f61c40a7040 comp rx=0 tx=0).stop 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 -- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 msgr2=0x7f61cc19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 0x7f61cc19cdf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f61c4006010 tx=0x7f61c4003f10 comp rx=0 tx=0).stop 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 -- 172.21.15.1:0/795676509 shutdown_connections 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61cc106f50 0x7f61cc19cdf0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f61b40a3240 0x7f61b40a5700 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61cc100ca0 0x7f61cc198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 --2- 172.21.15.1:0/795676509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61cc1002f0 0x7f61cc198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.380+0000 7f61d2fea640 1 -- 172.21.15.1:0/795676509 >> 172.21.15.1:0/795676509 conn(0x7f61cc077210 msgr2=0x7f61cc105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.381+0000 7f61d2fea640 1 -- 172.21.15.1:0/795676509 shutdown_connections 2024-09-19T09:07:19.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:19.381+0000 7f61d2fea640 1 -- 172.21.15.1:0/795676509 wait complete. 2024-09-19T09:07:19.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:19 smithi022 ceph-mon[35107]: pgmap v434: 97 pgs: 97 active+clean; 142 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 913 op/s 2024-09-19T09:07:19.992 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:19 smithi001 ceph-mon[30939]: pgmap v434: 97 pgs: 97 active+clean; 142 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 913 op/s 2024-09-19T09:07:20.022 INFO:tasks.cephfs.filesystem:scrub status for tag:f858db19-739a-4555-aefb-db75065baae5 - {'path': '/', 'tag': 'f858db19-739a-4555-aefb-db75065baae5', 'options': 'recursive,force'} 2024-09-19T09:07:20.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:19 smithi064 ceph-mon[35179]: pgmap v434: 97 pgs: 97 active+clean; 142 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 913 op/s 2024-09-19T09:07:21.909 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:21 smithi064 ceph-mon[35179]: pgmap v435: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 1.48k op/s 2024-09-19T09:07:21.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:21 smithi022 ceph-mon[35107]: pgmap v435: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 1.48k op/s 2024-09-19T09:07:22.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:21 smithi001 ceph-mon[30939]: pgmap v435: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 1.48k op/s 2024-09-19T09:07:23.627 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:07:23.887 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:23.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:23 smithi022 ceph-mon[35107]: pgmap v436: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 1.35k op/s 2024-09-19T09:07:24.008 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:23 smithi001 ceph-mon[30939]: pgmap v436: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 1.35k op/s 2024-09-19T09:07:24.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:23 smithi064 ceph-mon[35179]: pgmap v436: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 1.35k op/s 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.373+0000 7feaef49e640 1 -- 172.21.15.1:0/3787819133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae81008d0 msgr2=0x7feae8100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.373+0000 7feaef49e640 1 --2- 172.21.15.1:0/3787819133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae81008d0 0x7feae8100cb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7feae4009900 tx=0x7feae402a410 comp rx=0 tx=0).stop 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.373+0000 7feaef49e640 1 -- 172.21.15.1:0/3787819133 shutdown_connections 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.373+0000 7feaef49e640 1 --2- 172.21.15.1:0/3787819133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feae810e480 0x7feae8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.373+0000 7feaef49e640 1 --2- 172.21.15.1:0/3787819133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae8101280 0x7feae810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.373+0000 7feaef49e640 1 --2- 172.21.15.1:0/3787819133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae81008d0 0x7feae8100cb0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.373+0000 7feaef49e640 1 -- 172.21.15.1:0/3787819133 >> 172.21.15.1:0/3787819133 conn(0x7feae80fc7a0 msgr2=0x7feae80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.374+0000 7feaef49e640 1 -- 172.21.15.1:0/3787819133 shutdown_connections 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.374+0000 7feaef49e640 1 -- 172.21.15.1:0/3787819133 wait complete. 2024-09-19T09:07:24.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.374+0000 7feaef49e640 1 Processor -- start 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.374+0000 7feaef49e640 1 -- start start 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaef49e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae81008d0 0x7feae81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaef49e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feae8101280 0x7feae81a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaef49e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae810e480 0x7feae819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaef49e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feae81142e0 con 0x7feae810e480 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaef49e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feae8114160 con 0x7feae81008d0 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaef49e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feae8114460 con 0x7feae8101280 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae810e480 0x7feae819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae810e480 0x7feae819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37346/0 (socket says 172.21.15.1:37346) 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 -- 172.21.15.1:0/3974827301 learned_addr learned my addr 172.21.15.1:0/3974827301 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaed23a640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae81008d0 0x7feae81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeca39640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feae8101280 0x7feae81a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:24.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 -- 172.21.15.1:0/3974827301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feae8101280 msgr2=0x7feae81a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feae8101280 0x7feae81a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 -- 172.21.15.1:0/3974827301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae81008d0 msgr2=0x7feae81a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae81008d0 0x7feae81a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 -- 172.21.15.1:0/3974827301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae819acf0 con 0x7feae810e480 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeca39640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feae8101280 0x7feae81a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaeda3b640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae810e480 0x7feae819a5c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7feae0009fd0 tx=0x7feae000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feade7fc640 1 -- 172.21.15.1:0/3974827301 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0004d20 con 0x7feae810e480 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feade7fc640 1 -- 172.21.15.1:0/3974827301 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feae000cb20 con 0x7feae810e480 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae819afe0 con 0x7feae810e480 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.375+0000 7feade7fc640 1 -- 172.21.15.1:0/3974827301 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae00117e0 con 0x7feae810e480 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.376+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae81a72d0 con 0x7feae810e480 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.377+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae8100cb0 con 0x7feae810e480 2024-09-19T09:07:24.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.378+0000 7feade7fc640 1 -- 172.21.15.1:0/3974827301 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7feae000ccd0 con 0x7feae810e480 2024-09-19T09:07:24.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.379+0000 7feade7fc640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fead40a32c0 0x7fead40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:24.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.379+0000 7feaed23a640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fead40a32c0 0x7fead40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:24.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.379+0000 7feade7fc640 1 -- 172.21.15.1:0/3974827301 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7feae00cfe00 con 0x7feae810e480 2024-09-19T09:07:24.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.379+0000 7feaed23a640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fead40a32c0 0x7fead40a5780 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feae4009230 tx=0x7feae40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:24.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.383+0000 7feade7fc640 1 -- 172.21.15.1:0/3974827301 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feae0016030 con 0x7feae810e480 2024-09-19T09:07:24.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.597+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feae8109610 con 0x7feae810e480 2024-09-19T09:07:24.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.598+0000 7feade7fc640 1 -- 172.21.15.1:0/3974827301 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11881 (secure 0 0 0) 0x7feae009cb00 con 0x7feae810e480 2024-09-19T09:07:24.599 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:07:24.599 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"btime":"2024-09-19T09:06:48:587019+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:06:47.596868+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24482,24493,24500]},"id":1}]} 2024-09-19T09:07:24.599 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 25 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fead40a32c0 msgr2=0x7fead40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fead40a32c0 0x7fead40a5780 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feae4009230 tx=0x7feae40058d0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae810e480 msgr2=0x7feae819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae810e480 0x7feae819a5c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7feae0009fd0 tx=0x7feae000ee60 comp rx=0 tx=0).stop 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 shutdown_connections 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feae810e480 0x7feae819a5c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fead40a32c0 0x7fead40a5780 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feae8101280 0x7feae81a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 --2- 172.21.15.1:0/3974827301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae81008d0 0x7feae81a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:24.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 >> 172.21.15.1:0/3974827301 conn(0x7feae80fc7a0 msgr2=0x7feae80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:24.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 shutdown_connections 2024-09-19T09:07:24.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:24.600+0000 7feaef49e640 1 -- 172.21.15.1:0/3974827301 wait complete. 2024-09-19T09:07:24.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:24 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3974827301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:25.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:24 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3974827301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:25.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:24 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3974827301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:25.282 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db --set-id 855efd89 --release --await' 2024-09-19T09:07:25.282 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db --set-id 855efd89 --release --await 2024-09-19T09:07:25.543 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:25.921 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:25 smithi001 ceph-mon[30939]: pgmap v437: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 1.35k op/s 2024-09-19T09:07:25.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:25 smithi022 ceph-mon[35107]: pgmap v437: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 1.35k op/s 2024-09-19T09:07:26.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 -- 172.21.15.1:0/2995272308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 msgr2=0x7fb5341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 --2- 172.21.15.1:0/2995272308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 0x7fb5341067e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009900 tx=0x7fb51c02a410 comp rx=0 tx=0).stop 2024-09-19T09:07:26.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 -- 172.21.15.1:0/2995272308 shutdown_connections 2024-09-19T09:07:26.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 --2- 172.21.15.1:0/2995272308 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb534106f10 0x7fb53410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 --2- 172.21.15.1:0/2995272308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 0x7fb5341067e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 --2- 172.21.15.1:0/2995272308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb534101de0 0x7fb5341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 -- 172.21.15.1:0/2995272308 >> 172.21.15.1:0/2995272308 conn(0x7fb5340fd8c0 msgr2=0x7fb5340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:26.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 -- 172.21.15.1:0/2995272308 shutdown_connections 2024-09-19T09:07:26.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.009+0000 7fb53908c640 1 -- 172.21.15.1:0/2995272308 wait complete. 2024-09-19T09:07:26.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.010+0000 7fb53908c640 1 Processor -- start 2024-09-19T09:07:26.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.010+0000 7fb53908c640 1 -- start start 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb53908c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb534101de0 0x7fb534198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb53908c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 0x7fb5341989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb53908c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb534106f10 0x7fb53419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb53908c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb534112090 con 0x7fb534102790 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb53908c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb534111f10 con 0x7fb534101de0 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb53908c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb534112210 con 0x7fb534106f10 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 0x7fb5341989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb532d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb534101de0 0x7fb534198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 0x7fb5341989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37358/0 (socket says 172.21.15.1:37358) 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 -- 172.21.15.1:0/216812933 learned_addr learned my addr 172.21.15.1:0/216812933 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb53359e640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb534106f10 0x7fb53419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 -- 172.21.15.1:0/216812933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb534106f10 msgr2=0x7fb53419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb534106f10 0x7fb53419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 -- 172.21.15.1:0/216812933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb534101de0 msgr2=0x7fb534198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb534101de0 0x7fb534198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 -- 172.21.15.1:0/216812933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53419d420 con 0x7fb534102790 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.011+0000 7fb52bfff640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 0x7fb5341989b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb51c006010 tx=0x7fb51c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.012+0000 7fb530d99640 1 -- 172.21.15.1:0/216812933 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c03f030 con 0x7fb534102790 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.012+0000 7fb53908c640 1 -- 172.21.15.1:0/216812933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53419d6b0 con 0x7fb534102790 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.012+0000 7fb530d99640 1 -- 172.21.15.1:0/216812933 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb51c003d00 con 0x7fb534102790 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.012+0000 7fb530d99640 1 -- 172.21.15.1:0/216812933 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c035070 con 0x7fb534102790 2024-09-19T09:07:26.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.012+0000 7fb53908c640 1 -- 172.21.15.1:0/216812933 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5341a4ff0 con 0x7fb534102790 2024-09-19T09:07:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.014+0000 7fb530d99640 1 -- 172.21.15.1:0/216812933 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fb51c042030 con 0x7fb534102790 2024-09-19T09:07:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.014+0000 7fb53b465740 1 Processor -- start 2024-09-19T09:07:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.014+0000 7fb53b465740 1 -- start start 2024-09-19T09:07:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb53b465740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 0x56068d8da440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb53b465740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da980 0x56068d8e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb53b465740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d8e7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb53b465740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56068d83f620 con 0x56068d8da980 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb53b465740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56068d7e6e50 con 0x56068d8e5240 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb530d99640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb5200a32c0 0x7fb5200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb53b465740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56068d83b5e0 con 0x56068d8da060 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb53359e640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb5200a32c0 0x7fb5200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb532d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da980 0x56068d8e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb532d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da980 0x56068d8e4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37374/0 (socket says 172.21.15.1:37374) 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb532d9d640 1 -- 172.21.15.1:0/3308061907 learned_addr learned my addr 172.21.15.1:0/3308061907 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb530d99640 1 -- 172.21.15.1:0/216812933 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb51c0efa50 con 0x7fb534102790 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb53359e640 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 0x56068d8da440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb52bfff640 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d8e7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb532d9d640 1 -- 172.21.15.1:0/3308061907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 msgr2=0x56068d8da440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:26.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb532d9d640 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 0x56068d8da440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb532d9d640 1 -- 172.21.15.1:0/3308061907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 msgr2=0x56068d8e7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb532d9d640 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d8e7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.015+0000 7fb532d9d640 1 -- 172.21.15.1:0/3308061907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56068d7d7d40 con 0x56068d8da980 2024-09-19T09:07:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.016+0000 7fb53359e640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb5200a32c0 0x7fb5200a5780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb52c007310 tx=0x7fb52c013aa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.016+0000 7fb532d9d640 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da980 0x56068d8e4d00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb52400bd10 tx=0x7fb5240107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d567c267c8858d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.016+0000 7fb5297fa640 1 -- 172.21.15.1:0/3308061907 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524004030 con 0x56068d8da980 2024-09-19T09:07:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.016+0000 7fb5297fa640 1 -- 172.21.15.1:0/3308061907 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb5240041d0 con 0x56068d8da980 2024-09-19T09:07:26.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.016+0000 7fb5297fa640 1 -- 172.21.15.1:0/3308061907 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5240118a0 con 0x56068d8da980 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- 172.21.15.1:0/3308061907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da980 msgr2=0x56068d8e4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da980 0x56068d8e4d00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb52400bd10 tx=0x7fb5240107a0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- 172.21.15.1:0/3308061907 shutdown_connections 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d8e7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da980 0x56068d8e4d00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 --2- 172.21.15.1:0/3308061907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 0x56068d8da440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- 172.21.15.1:0/3308061907 >> 172.21.15.1:0/3308061907 conn(0x56068d8d65f0 msgr2=0x56068d8d69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- 172.21.15.1:0/3308061907 shutdown_connections 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- 172.21.15.1:0/3308061907 wait complete. 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- start start 2024-09-19T09:07:26.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 Processor -- start 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 0x56068d8e20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8da980 0x56068d8e2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8e5240 0x56068d8e2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56068d8e7e10 con 0x56068d8e5240 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56068d7c7f10 con 0x56068d8da980 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.017+0000 7fb53b465740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56068d8e7f90 con 0x56068d8da060 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53b465740 10 client.0 _ll_register_callbacks cb 0x56068d7ebdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8e5240 0x56068d8e2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8e5240 0x56068d8e2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37376/0 (socket says 172.21.15.1:37376) 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 -- 172.21.15.1:0/3797164480 learned_addr learned my addr 172.21.15.1:0/3797164480 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb532d9d640 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 0x56068d8e20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb52bfff640 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8da980 0x56068d8e2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 -- 172.21.15.1:0/3797164480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 msgr2=0x56068d8e20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 0x56068d8e20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 -- 172.21.15.1:0/3797164480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8da980 msgr2=0x56068d8e2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8da980 0x56068d8e2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 -- 172.21.15.1:0/3797164480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56068d54e580 con 0x56068d8e5240 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53359e640 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8e5240 0x56068d8e2b60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb52c011d10 tx=0x7fb52c007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804c969f4739361b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb51a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb51a7fc640 1 -- 172.21.15.1:0/3797164480 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52c023070 con 0x56068d8e5240 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb51a7fc640 1 -- 172.21.15.1:0/3797164480 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb52c01f3f0 con 0x56068d8e5240 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.018+0000 7fb53b465740 1 -- 172.21.15.1:0/3797164480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5240041d0 con 0x56068d8e5240 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb51a7fc640 1 -- 172.21.15.1:0/3797164480 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb52c02f050 con 0x56068d8e5240 2024-09-19T09:07:26.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb53b465740 10 client.16437 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb53b465740 1 -- 172.21.15.1:0/3797164480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56068d618960 con 0x56068d8e5240 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb51a7fc640 1 -- 172.21.15.1:0/3797164480 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb5240041d0 con 0x56068d8e5240 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb51a7fc640 1 -- 172.21.15.1:0/3797164480 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb52c00f630 con 0x56068d8e5240 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb53b465740 10 client.16437 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb53b465740 10 client.16437 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb53b465740 20 client.16437 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb53b465740 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56068d8f4d00 0x56068d8f7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb53b465740 4 client.16437 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.019+0000 7fb53b465740 1 -- 172.21.15.1:0/3797164480 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56068d84cb90 con 0x56068d8f4d00 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.020+0000 7fb532d9d640 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56068d8f4d00 0x56068d8f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.020+0000 7fb532d9d640 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56068d8f4d00 0x56068d8f7170 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a5d5e4c6666c58 server_cookie=bb77a27be8bd3954 in_seq=0 out_seq=0 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.020+0000 7fb51a7fc640 10 client.16437 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb51a7fc640 1 -- 172.21.15.1:0/3797164480 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56068d84cb90 con 0x56068d8f4d00 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb51a7fc640 10 client.16437 handle_command_reply: tid=0 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 client.16437 shutdown 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 -- 172.21.15.1:0/3797164480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8e5240 msgr2=0x56068d8e2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8e5240 0x56068d8e2b60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb52c011d10 tx=0x7fb52c007520 comp rx=0 tx=0).stop 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 -- 172.21.15.1:0/3797164480 shutdown_connections 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56068d8f4d00 0x56068d8f7170 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8e5240 0x56068d8e2b60 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8da980 0x56068d8e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb51a7fc640 0 client.16437 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 --2- 172.21.15.1:0/3797164480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da060 0x56068d8e20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 -- 172.21.15.1:0/3797164480 >> 172.21.15.1:0/3797164480 conn(0x56068d8d65f0 msgr2=0x56068d8dc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 -- 172.21.15.1:0/3797164480 shutdown_connections 2024-09-19T09:07:26.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 1 -- 172.21.15.1:0/3797164480 wait complete. 2024-09-19T09:07:26.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.021+0000 7fb53b465740 20 client.16437 trim_cache size 0 max 16384 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.038+0000 7fb53b465740 1 Processor -- start 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.038+0000 7fb53b465740 1 -- start start 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.038+0000 7fb53b465740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8dcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.038+0000 7fb53b465740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.038+0000 7fb53b465740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d8e4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb53b465740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5341afef0 con 0x56068d8da060 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb53b465740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5341ad7c0 con 0x56068d8e5240 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb53b465740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb5341ab610 con 0x56068d8da980 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8dcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8dcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37378/0 (socket says 172.21.15.1:37378) 2024-09-19T09:07:26.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 -- 172.21.15.1:0/2300212335 learned_addr learned my addr 172.21.15.1:0/2300212335 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb53359e640 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d8e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb52bfff640 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 -- 172.21.15.1:0/2300212335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 msgr2=0x56068d8dd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8dd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 -- 172.21.15.1:0/2300212335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 msgr2=0x56068d8e4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d8e4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 -- 172.21.15.1:0/2300212335 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56068d8d5610 con 0x56068d8da060 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb52bfff640 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb532d9d640 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8dcac0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb52400baa0 tx=0x7fb524011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ce9bd0bd765b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb528ff9640 1 -- 172.21.15.1:0/2300212335 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524005240 con 0x56068d8da060 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.039+0000 7fb528ff9640 1 -- 172.21.15.1:0/2300212335 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb524003af0 con 0x56068d8da060 2024-09-19T09:07:26.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb528ff9640 1 -- 172.21.15.1:0/2300212335 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524011910 con 0x56068d8da060 2024-09-19T09:07:26.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 -- 172.21.15.1:0/2300212335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 msgr2=0x56068d8dcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8dcac0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb52400baa0 tx=0x7fb524011440 comp rx=0 tx=0).stop 2024-09-19T09:07:26.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 -- 172.21.15.1:0/2300212335 shutdown_connections 2024-09-19T09:07:26.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d8e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 --2- 172.21.15.1:0/2300212335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8dcac0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 -- 172.21.15.1:0/2300212335 >> 172.21.15.1:0/2300212335 conn(0x56068d8d65f0 msgr2=0x56068d8e3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 -- 172.21.15.1:0/2300212335 shutdown_connections 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.040+0000 7fb53b465740 1 -- 172.21.15.1:0/2300212335 wait complete. 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 1 -- start start 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 1 Processor -- start 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8e9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d95cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5341abc80 con 0x56068d8da060 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5341ad0f0 con 0x56068d8e5240 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb5341ac350 con 0x56068d8da980 2024-09-19T09:07:26.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53b465740 10 client.0 _ll_register_callbacks cb 0x7fb52c0119b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb532d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb532d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8e9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37386/0 (socket says 172.21.15.1:37386) 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb532d9d640 1 -- 172.21.15.1:0/4273050810 learned_addr learned my addr 172.21.15.1:0/4273050810 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53359e640 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d95cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb52bfff640 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb532d9d640 1 -- 172.21.15.1:0/4273050810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 msgr2=0x56068d8e9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb532d9d640 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8e9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb532d9d640 1 -- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 msgr2=0x56068d95cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb532d9d640 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d95cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb532d9d640 1 -- 172.21.15.1:0/4273050810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56068d95d490 con 0x56068d8da060 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.041+0000 7fb53359e640 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d95cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb532d9d640 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8e9870 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb5240107e0 tx=0x7fb52400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9f278e554125d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:26.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb51a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb51a7fc640 1 -- 172.21.15.1:0/4273050810 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524003d20 con 0x56068d8da060 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb51a7fc640 1 -- 172.21.15.1:0/4273050810 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb5240050b0 con 0x56068d8da060 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb53b465740 1 -- 172.21.15.1:0/4273050810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb524003af0 con 0x56068d8da060 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb51a7fc640 1 -- 172.21.15.1:0/4273050810 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5240052b0 con 0x56068d8da060 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb53b465740 10 client.16443 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb53b465740 1 -- 172.21.15.1:0/4273050810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56068d9647f0 con 0x56068d8da060 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb51a7fc640 1 -- 172.21.15.1:0/4273050810 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb524003af0 con 0x56068d8da060 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.042+0000 7fb51a7fc640 1 -- 172.21.15.1:0/4273050810 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb52401b570 con 0x56068d8da060 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb53b465740 10 client.16443 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb53b465740 10 client.16443 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb53b465740 20 client.16443 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb53b465740 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56068d964d60 0x56068d967180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb53b465740 4 client.16443 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "855efd89", "release": true, "await": true}] 2024-09-19T09:07:26.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb53b465740 1 -- 172.21.15.1:0/4273050810 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "set_id": "855efd89", "release": true, "await": true}) -- 0x56068d8470a0 con 0x56068d964d60 2024-09-19T09:07:26.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb52bfff640 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56068d964d60 0x56068d967180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:26.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb52bfff640 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56068d964d60 0x56068d967180 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2214bd1276c2140 server_cookie=bd7a91ac7e24f8 in_seq=0 out_seq=0 2024-09-19T09:07:26.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.043+0000 7fb51a7fc640 10 client.16443 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:26.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:25 smithi064 ceph-mon[35179]: pgmap v437: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 1.35k op/s 2024-09-19T09:07:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb51a7fc640 1 -- 172.21.15.1:0/4273050810 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56068d8470a0 con 0x56068d964d60 2024-09-19T09:07:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb51a7fc640 10 client.16443 handle_command_reply: tid=0 2024-09-19T09:07:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 client.16443 shutdown 2024-09-19T09:07:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 -- 172.21.15.1:0/4273050810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 msgr2=0x56068d8e9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8e9870 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb5240107e0 tx=0x7fb52400be00 comp rx=0 tx=0).stop 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 -- 172.21.15.1:0/4273050810 shutdown_connections 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56068d964d60 0x56068d967180 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56068d8e5240 0x56068d95cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56068d8da980 0x56068d8e9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 --2- 172.21.15.1:0/4273050810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56068d8da060 0x56068d8e9870 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb53b465740 1 -- 172.21.15.1:0/4273050810 >> 172.21.15.1:0/4273050810 conn(0x56068d8d65f0 msgr2=0x56068d8e4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.303+0000 7fb51a7fc640 0 client.16443 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53b465740 1 -- 172.21.15.1:0/4273050810 shutdown_connections 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53b465740 1 -- 172.21.15.1:0/4273050810 wait complete. 2024-09-19T09:07:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53b465740 20 client.16443 trim_cache size 0 max 16384 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 25, 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 16, 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "855efd89": { 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 16, 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:07:26.306 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 136.6, 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:07:26.307 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:07:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 -- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb5200a32c0 msgr2=0x7fb5200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb5200a32c0 0x7fb5200a5780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb52c007310 tx=0x7fb52c013aa0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 -- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 msgr2=0x7fb5341989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 0x7fb5341989b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb51c006010 tx=0x7fb51c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 -- 172.21.15.1:0/216812933 shutdown_connections 2024-09-19T09:07:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb5200a32c0 0x7fb5200a5780 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb534106f10 0x7fb53419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb534102790 0x7fb5341989b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 --2- 172.21.15.1:0/216812933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb534101de0 0x7fb534198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.304+0000 7fb53908c640 1 -- 172.21.15.1:0/216812933 >> 172.21.15.1:0/216812933 conn(0x7fb5340fd8c0 msgr2=0x7fb5340febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.305+0000 7fb53908c640 1 -- 172.21.15.1:0/216812933 shutdown_connections 2024-09-19T09:07:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:26.305+0000 7fb53908c640 1 -- 172.21.15.1:0/216812933 wait complete. 2024-09-19T09:07:26.548 INFO:tasks.workunit.client.0.smithi001.stderr:+ sync 2024-09-19T09:07:27.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:27 smithi022 ceph-mon[35107]: pgmap v438: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 816 op/s 2024-09-19T09:07:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:27 smithi001 ceph-mon[30939]: pgmap v438: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 816 op/s 2024-09-19T09:07:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 -- 172.21.15.1:0/943048486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6801025f0 msgr2=0x7fb6801049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 --2- 172.21.15.1:0/943048486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6801025f0 0x7fb6801049e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb670009900 tx=0x7fb67002a410 comp rx=0 tx=0).stop 2024-09-19T09:07:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 -- 172.21.15.1:0/943048486 shutdown_connections 2024-09-19T09:07:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 --2- 172.21.15.1:0/943048486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb680107850 0x7fb680109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 --2- 172.21.15.1:0/943048486 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb680104f20 0x7fb680107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 --2- 172.21.15.1:0/943048486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6801025f0 0x7fb6801049e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 -- 172.21.15.1:0/943048486 >> 172.21.15.1:0/943048486 conn(0x7fb6800fc1f0 msgr2=0x7fb6800fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 -- 172.21.15.1:0/943048486 shutdown_connections 2024-09-19T09:07:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.071+0000 7fb68599f640 1 -- 172.21.15.1:0/943048486 wait complete. 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.072+0000 7fb68599f640 1 Processor -- start 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.072+0000 7fb68599f640 1 -- start start 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.072+0000 7fb68599f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6801025f0 0x7fb680101f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb68599f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb680104f20 0x7fb6801005a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb68599f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb680107850 0x7fb680100ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb68599f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb68010d980 con 0x7fb680104f20 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb68599f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb68010d800 con 0x7fb680107850 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb68599f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb68010db00 con 0x7fb6801025f0 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6801025f0 0x7fb680101f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb680104f20 0x7fb6801005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6801025f0 0x7fb680101f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:36572/0 (socket says 172.21.15.1:36572) 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 -- 172.21.15.1:0/1284963244 learned_addr learned my addr 172.21.15.1:0/1284963244 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb680107850 0x7fb680100ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 -- 172.21.15.1:0/1284963244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb680107850 msgr2=0x7fb680100ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb680107850 0x7fb680100ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 -- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb680104f20 msgr2=0x7fb6801005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb680104f20 0x7fb6801005a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 -- 172.21.15.1:0/1284963244 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb680101370 con 0x7fb6801025f0 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb67effd640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6801025f0 0x7fb680101f60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb670005940 tx=0x7fb670004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.073+0000 7fb68499d640 1 -- 172.21.15.1:0/1284963244 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67003f030 con 0x7fb6801025f0 2024-09-19T09:07:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.074+0000 7fb68599f640 1 -- 172.21.15.1:0/1284963244 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6801a20d0 con 0x7fb6801025f0 2024-09-19T09:07:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.074+0000 7fb68499d640 1 -- 172.21.15.1:0/1284963244 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb670003af0 con 0x7fb6801025f0 2024-09-19T09:07:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.074+0000 7fb68499d640 1 -- 172.21.15.1:0/1284963244 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670035070 con 0x7fb6801025f0 2024-09-19T09:07:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.074+0000 7fb68599f640 1 -- 172.21.15.1:0/1284963244 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6801a2670 con 0x7fb6801025f0 2024-09-19T09:07:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.076+0000 7fb68499d640 1 -- 172.21.15.1:0/1284963244 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fb670042030 con 0x7fb6801025f0 2024-09-19T09:07:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.076+0000 7fb68881a740 1 Processor -- start 2024-09-19T09:07:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.076+0000 7fb68881a740 1 -- start start 2024-09-19T09:07:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb68881a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e349a0 0x558dc4e34da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb68881a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e352e0 0x558dc4e39da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb68881a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e3c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb68881a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558dc4d982f0 con 0x558dc4e352e0 2024-09-19T09:07:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb68881a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558dc4d40270 con 0x558dc4e3a370 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb68881a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558dc4d942b0 con 0x558dc4e349a0 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb68499d640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6680a3240 0x7fb6680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e352e0 0x558dc4e39da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e3c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6680a3240 0x7fb6680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e3c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:42912/0 (socket says 172.21.15.1:42912) 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e349a0 0x558dc4e34da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 -- 172.21.15.1:0/89354964 learned_addr learned my addr 172.21.15.1:0/89354964 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb68499d640 1 -- 172.21.15.1:0/1284963244 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb6700efe80 con 0x7fb6801025f0 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 -- 172.21.15.1:0/89354964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e349a0 msgr2=0x558dc4e34da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 --2- 172.21.15.1:0/89354964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e349a0 0x558dc4e34da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 -- 172.21.15.1:0/89354964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e352e0 msgr2=0x558dc4e39da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 --2- 172.21.15.1:0/89354964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e352e0 0x558dc4e39da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 -- 172.21.15.1:0/89354964 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dc4d3f340 con 0x558dc4e3a370 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6680a3240 0x7fb6680a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb678009fd0 tx=0x7fb678004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.077+0000 7fb67e7fc640 1 --2- 172.21.15.1:0/89354964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e3c830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb674009c60 tx=0x7fb674011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf64037580ecb21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb665ffb640 1 -- 172.21.15.1:0/89354964 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674004230 con 0x558dc4e3a370 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb665ffb640 1 -- 172.21.15.1:0/89354964 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6740043d0 con 0x558dc4e3a370 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb665ffb640 1 -- 172.21.15.1:0/89354964 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674019840 con 0x558dc4e3a370 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 -- 172.21.15.1:0/89354964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 msgr2=0x558dc4e3c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 --2- 172.21.15.1:0/89354964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e3c830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb674009c60 tx=0x7fb674011810 comp rx=0 tx=0).stop 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 -- 172.21.15.1:0/89354964 shutdown_connections 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 --2- 172.21.15.1:0/89354964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e3c830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 --2- 172.21.15.1:0/89354964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e352e0 0x558dc4e39da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 --2- 172.21.15.1:0/89354964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e349a0 0x558dc4e34da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 -- 172.21.15.1:0/89354964 >> 172.21.15.1:0/89354964 conn(0x558dc4e30010 msgr2=0x558dc4e30410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 -- 172.21.15.1:0/89354964 shutdown_connections 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.078+0000 7fb68881a740 1 -- 172.21.15.1:0/89354964 wait complete. 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 1 -- start start 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 1 Processor -- start 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 0x558dc4e3ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e3f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e46140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558dc4e3d340 con 0x558dc4e3a370 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558dc4d21290 con 0x558dc4e349a0 2024-09-19T09:07:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558dc4e3d4c0 con 0x558dc4e352e0 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb68881a740 10 client.0 _ll_register_callbacks cb 0x558dc4d52140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.079+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e46140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e46140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37434/0 (socket says 172.21.15.1:37434) 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67f7fe640 1 -- 172.21.15.1:0/3976570536 learned_addr learned my addr 172.21.15.1:0/3976570536 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67e7fc640 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e3f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67effd640 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 0x558dc4e3ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67f7fe640 1 -- 172.21.15.1:0/3976570536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 msgr2=0x558dc4e3f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e3f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67f7fe640 1 -- 172.21.15.1:0/3976570536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 msgr2=0x558dc4e3ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 0x558dc4e3ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67f7fe640 1 -- 172.21.15.1:0/3976570536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dc4aab210 con 0x558dc4e3a370 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e46140 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb67800de90 tx=0x7fb678004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9cdceea868fbd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb65effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb65effd640 1 -- 172.21.15.1:0/3976570536 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678012e10 con 0x558dc4e3a370 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb68881a740 1 -- 172.21.15.1:0/3976570536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6740043d0 con 0x558dc4e3a370 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb65effd640 1 -- 172.21.15.1:0/3976570536 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb678003e00 con 0x558dc4e3a370 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb65effd640 1 -- 172.21.15.1:0/3976570536 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb678030070 con 0x558dc4e3a370 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb68881a740 10 client.16455 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.080+0000 7fb68881a740 1 -- 172.21.15.1:0/3976570536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558dc4b77620 con 0x558dc4e3a370 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb65effd640 1 -- 172.21.15.1:0/3976570536 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6740043d0 con 0x558dc4e3a370 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb65effd640 1 -- 172.21.15.1:0/3976570536 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb6780056e0 con 0x558dc4e3a370 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb68881a740 10 client.16455 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb68881a740 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb68881a740 20 client.16455 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb68881a740 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558dc4e4a920 0x558dc4e4cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb68881a740 4 client.16455 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb68881a740 1 -- 172.21.15.1:0/3976570536 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558dc4da5a20 con 0x558dc4e4a920 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb67effd640 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558dc4e4a920 0x558dc4e4cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb65effd640 10 client.16455 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.081+0000 7fb67effd640 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558dc4e4a920 0x558dc4e4cd50 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44c33349c3d70ce server_cookie=abf512881d57be2 in_seq=0 out_seq=0 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb65effd640 1 -- 172.21.15.1:0/3976570536 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558dc4da5a20 con 0x558dc4e4a920 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb65effd640 10 client.16455 handle_command_reply: tid=0 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 client.16455 shutdown 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 -- 172.21.15.1:0/3976570536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 msgr2=0x558dc4e46140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e46140 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb67800de90 tx=0x7fb678004a40 comp rx=0 tx=0).stop 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 -- 172.21.15.1:0/3976570536 shutdown_connections 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558dc4e4a920 0x558dc4e4cd50 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e46140 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e3f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb65effd640 0 client.16455 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 --2- 172.21.15.1:0/3976570536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 0x558dc4e3ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 -- 172.21.15.1:0/3976570536 >> 172.21.15.1:0/3976570536 conn(0x558dc4e30010 msgr2=0x558dc4e31820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 -- 172.21.15.1:0/3976570536 shutdown_connections 2024-09-19T09:07:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.082+0000 7fb68881a740 1 -- 172.21.15.1:0/3976570536 wait complete. 2024-09-19T09:07:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.083+0000 7fb68881a740 20 client.16455 trim_cache size 0 max 16384 2024-09-19T09:07:28.092 INFO:tasks.workunit.client.0.smithi001.stderr:+ tar c linux-4.0.5 2024-09-19T09:07:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.097+0000 7fb68881a740 1 Processor -- start 2024-09-19T09:07:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb68881a740 1 -- start start 2024-09-19T09:07:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb68881a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e349a0 0x558dc4e30ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb68881a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e46100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb68881a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e31400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb68881a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801adc60 con 0x558dc4e349a0 2024-09-19T09:07:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb68881a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801ab530 con 0x558dc4e3a370 2024-09-19T09:07:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb68881a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801a9380 con 0x558dc4e352e0 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e349a0 0x558dc4e30ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e349a0 0x558dc4e30ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37450/0 (socket says 172.21.15.1:37450) 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 -- 172.21.15.1:0/4249675584 learned_addr learned my addr 172.21.15.1:0/4249675584 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e31400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67e7fc640 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e46100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 -- 172.21.15.1:0/4249675584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 msgr2=0x558dc4e46100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e46100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 -- 172.21.15.1:0/4249675584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 msgr2=0x558dc4e31400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e31400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 -- 172.21.15.1:0/4249675584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dc4e30ca0 con 0x558dc4e349a0 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e31400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb67effd640 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e349a0 0x558dc4e30ec0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb670000c00 tx=0x7fb67008f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18581f5fa1878c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.098+0000 7fb6657fa640 1 -- 172.21.15.1:0/4249675584 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670049040 con 0x558dc4e349a0 2024-09-19T09:07:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb6657fa640 1 -- 172.21.15.1:0/4249675584 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6700c41c0 con 0x558dc4e349a0 2024-09-19T09:07:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb6657fa640 1 -- 172.21.15.1:0/4249675584 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6700eda10 con 0x558dc4e349a0 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 -- 172.21.15.1:0/4249675584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e349a0 msgr2=0x558dc4e30ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e349a0 0x558dc4e30ec0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb670000c00 tx=0x7fb67008f350 comp rx=0 tx=0).stop 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 -- 172.21.15.1:0/4249675584 shutdown_connections 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e3a370 0x558dc4e31400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e46100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 --2- 172.21.15.1:0/4249675584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e349a0 0x558dc4e30ec0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 -- 172.21.15.1:0/4249675584 >> 172.21.15.1:0/4249675584 conn(0x558dc4e30010 msgr2=0x558dc4e36490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 -- 172.21.15.1:0/4249675584 shutdown_connections 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.099+0000 7fb68881a740 1 -- 172.21.15.1:0/4249675584 wait complete. 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 1 -- start start 2024-09-19T09:07:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 1 Processor -- start 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 0x558dc4e438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e43df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e44e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801a99f0 con 0x558dc4e3a370 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801aae60 con 0x558dc4e349a0 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801aa0c0 con 0x558dc4e352e0 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb68881a740 10 client.0 _ll_register_callbacks cb 0x7fb678012d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e44e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e44e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37454/0 (socket says 172.21.15.1:37454) 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb67effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 0x558dc4e438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb67f7fe640 1 -- 172.21.15.1:0/1204797284 learned_addr learned my addr 172.21.15.1:0/1204797284 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb67e7fc640 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e43df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb67f7fe640 1 -- 172.21.15.1:0/1204797284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 msgr2=0x558dc4e43df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e43df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.100+0000 7fb67f7fe640 1 -- 172.21.15.1:0/1204797284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 msgr2=0x558dc4e438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 0x558dc4e438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb67f7fe640 1 -- 172.21.15.1:0/1204797284 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dc4e45410 con 0x558dc4e3a370 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb67f7fe640 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e44e00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb678000f80 tx=0x7fb6780048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25a1f032bef4a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb65effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb65effd640 1 -- 172.21.15.1:0/1204797284 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678009cc0 con 0x558dc4e3a370 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb65effd640 1 -- 172.21.15.1:0/1204797284 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb67801b040 con 0x558dc4e3a370 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb68881a740 1 -- 172.21.15.1:0/1204797284 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6700c41c0 con 0x558dc4e3a370 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb65effd640 1 -- 172.21.15.1:0/1204797284 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb6780129c0 con 0x558dc4e3a370 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb68881a740 10 client.16461 fetch_fsmap learned FSMap version 25 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb68881a740 1 -- 172.21.15.1:0/1204797284 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558dc4eb5720 con 0x558dc4e3a370 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb65effd640 1 -- 172.21.15.1:0/1204797284 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6700c41c0 con 0x558dc4e3a370 2024-09-19T09:07:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.101+0000 7fb65effd640 1 -- 172.21.15.1:0/1204797284 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb678035780 con 0x558dc4e3a370 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb68881a740 10 client.16461 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb68881a740 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb68881a740 20 client.16461 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb68881a740 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558dc4eb6050 0x558dc4eb8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb68881a740 4 client.16461 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb68881a740 1 -- 172.21.15.1:0/1204797284 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558dc4d9fd70 con 0x558dc4eb6050 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb67effd640 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558dc4eb6050 0x558dc4eb8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb65effd640 10 client.16461 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.102+0000 7fb67effd640 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558dc4eb6050 0x558dc4eb8470 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f2844fd9cf24d09 server_cookie=932140a48bb33f83 in_seq=0 out_seq=0 2024-09-19T09:07:28.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:27 smithi064 ceph-mon[35179]: pgmap v438: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 816 op/s 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb65effd640 1 -- 172.21.15.1:0/1204797284 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558dc4d9fd70 con 0x558dc4eb6050 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb65effd640 10 client.16461 handle_command_reply: tid=0 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 client.16461 shutdown 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 -- 172.21.15.1:0/1204797284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 msgr2=0x558dc4e44e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e44e00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb678000f80 tx=0x7fb6780048d0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 -- 172.21.15.1:0/1204797284 shutdown_connections 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558dc4eb6050 0x558dc4eb8470 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558dc4e3a370 0x558dc4e44e00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558dc4e352e0 0x558dc4e43df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 --2- 172.21.15.1:0/1204797284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558dc4e349a0 0x558dc4e438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb68881a740 1 -- 172.21.15.1:0/1204797284 >> 172.21.15.1:0/1204797284 conn(0x558dc4e30010 msgr2=0x558dc4e2e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.323+0000 7fb65effd640 0 client.16461 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68881a740 1 -- 172.21.15.1:0/1204797284 shutdown_connections 2024-09-19T09:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68881a740 1 -- 172.21.15.1:0/1204797284 wait complete. 2024-09-19T09:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68881a740 20 client.16461 trim_cache size 0 max 16384 2024-09-19T09:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:07:28.326 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:07:28.327 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 -- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6680a3240 msgr2=0x7fb6680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6680a3240 0x7fb6680a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb678009fd0 tx=0x7fb678004ab0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 -- 172.21.15.1:0/1284963244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6801025f0 msgr2=0x7fb680101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6801025f0 0x7fb680101f60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb670005940 tx=0x7fb670004270 comp rx=0 tx=0).stop 2024-09-19T09:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 -- 172.21.15.1:0/1284963244 shutdown_connections 2024-09-19T09:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb680107850 0x7fb680100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb680104f20 0x7fb6801005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb6680a3240 0x7fb6680a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 --2- 172.21.15.1:0/1284963244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6801025f0 0x7fb680101f60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.324+0000 7fb68599f640 1 -- 172.21.15.1:0/1284963244 >> 172.21.15.1:0/1284963244 conn(0x7fb6800fc1f0 msgr2=0x7fb680102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.325+0000 7fb68599f640 1 -- 172.21.15.1:0/1284963244 shutdown_connections 2024-09-19T09:07:28.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:28.325+0000 7fb68599f640 1 -- 172.21.15.1:0/1284963244 wait complete. 2024-09-19T09:07:28.582 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '855efd89', total seconds elapsed: 21.6 2024-09-19T09:07:28.583 INFO:tasks.workunit.client.0.smithi001.stderr:+ rm -rf linux-4.0.5 2024-09-19T09:07:29.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:29 smithi022 ceph-mon[35107]: pgmap v439: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 576 op/s 2024-09-19T09:07:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:29 smithi001 ceph-mon[30939]: pgmap v439: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 576 op/s 2024-09-19T09:07:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:29 smithi064 ceph-mon[35179]: pgmap v439: 97 pgs: 97 active+clean; 135 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 576 op/s 2024-09-19T09:07:31.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:31 smithi022 ceph-mon[35107]: pgmap v440: 97 pgs: 97 active+clean; 134 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 761 op/s 2024-09-19T09:07:32.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:31 smithi001 ceph-mon[30939]: pgmap v440: 97 pgs: 97 active+clean; 134 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 761 op/s 2024-09-19T09:07:32.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:31 smithi064 ceph-mon[35179]: pgmap v440: 97 pgs: 97 active+clean; 134 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 761 op/s 2024-09-19T09:07:32.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:32 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:32.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:32 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:07:33.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:32 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:33.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:32 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:07:33.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:32 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:33.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:32 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:07:33.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:33 smithi022 ceph-mon[35107]: pgmap v441: 97 pgs: 97 active+clean; 134 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 1.1 MiB/s wr, 190 op/s 2024-09-19T09:07:33.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:33 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:07:33.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:33 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:07:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:33 smithi001 ceph-mon[30939]: pgmap v441: 97 pgs: 97 active+clean; 134 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 1.1 MiB/s wr, 190 op/s 2024-09-19T09:07:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:33 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:07:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:33 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:07:34.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:33 smithi064 ceph-mon[35179]: pgmap v441: 97 pgs: 97 active+clean; 134 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 1.1 MiB/s wr, 190 op/s 2024-09-19T09:07:34.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:33 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:07:34.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:33 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:07:35.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:35 smithi022 ceph-mon[35107]: pgmap v442: 97 pgs: 97 active+clean; 127 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.5 MiB/s wr, 327 op/s 2024-09-19T09:07:35.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:35 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:35 smithi001 ceph-mon[30939]: pgmap v442: 97 pgs: 97 active+clean; 127 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.5 MiB/s wr, 327 op/s 2024-09-19T09:07:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:35 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:36.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:35 smithi064 ceph-mon[35179]: pgmap v442: 97 pgs: 97 active+clean; 127 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.5 MiB/s wr, 327 op/s 2024-09-19T09:07:36.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:35 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:37.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:37 smithi022 ceph-mon[35107]: pgmap v443: 97 pgs: 97 active+clean; 132 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.0 MiB/s wr, 395 op/s 2024-09-19T09:07:37.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:37 smithi022 ceph-mon[35107]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:38.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:37 smithi001 ceph-mon[30939]: pgmap v443: 97 pgs: 97 active+clean; 132 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.0 MiB/s wr, 395 op/s 2024-09-19T09:07:38.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:37 smithi001 ceph-mon[30939]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:38.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:37 smithi064 ceph-mon[35179]: pgmap v443: 97 pgs: 97 active+clean; 132 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.0 MiB/s wr, 395 op/s 2024-09-19T09:07:38.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:37 smithi064 ceph-mon[35179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:07:38.390 INFO:tasks.workunit.client.0.smithi001.stderr:+ tar xf doc.tar 2024-09-19T09:07:39.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:39 smithi022 ceph-mon[35107]: pgmap v444: 97 pgs: 97 active+clean; 132 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 1.9 MiB/s wr, 390 op/s 2024-09-19T09:07:40.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:39 smithi001 ceph-mon[30939]: pgmap v444: 97 pgs: 97 active+clean; 132 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 1.9 MiB/s wr, 390 op/s 2024-09-19T09:07:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:39 smithi064 ceph-mon[35179]: pgmap v444: 97 pgs: 97 active+clean; 132 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 1.9 MiB/s wr, 390 op/s 2024-09-19T09:07:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 -- 172.21.15.1:0/3679214606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb08100a40 msgr2=0x7feb08100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 --2- 172.21.15.1:0/3679214606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb08100a40 0x7feb08100e40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009900 tx=0x7feaf802a410 comp rx=0 tx=0).stop 2024-09-19T09:07:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 -- 172.21.15.1:0/3679214606 shutdown_connections 2024-09-19T09:07:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 --2- 172.21.15.1:0/3679214606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb081025f0 0x7feb08108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 --2- 172.21.15.1:0/3679214606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08101c30 0x7feb081020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 --2- 172.21.15.1:0/3679214606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb08100a40 0x7feb08100e40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 -- 172.21.15.1:0/3679214606 >> 172.21.15.1:0/3679214606 conn(0x7feb080fc1c0 msgr2=0x7feb080fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 -- 172.21.15.1:0/3679214606 shutdown_connections 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.413+0000 7feb0df42640 1 -- 172.21.15.1:0/3679214606 wait complete. 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb0df42640 1 Processor -- start 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb0df42640 1 -- start start 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb0df42640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb08100a40 0x7feb08197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb0df42640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08101c30 0x7feb081984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb0df42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb081025f0 0x7feb0819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb0df42640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feb0810d990 con 0x7feb081025f0 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb0df42640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feb0810d810 con 0x7feb08101c30 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb0df42640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feb0810db10 con 0x7feb08100a40 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb07fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb081025f0 0x7feb0819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb07fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb081025f0 0x7feb0819f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50284/0 (socket says 172.21.15.1:50284) 2024-09-19T09:07:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb07fff640 1 -- 172.21.15.1:0/2604527700 learned_addr learned my addr 172.21.15.1:0/2604527700 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb06ffd640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08101c30 0x7feb081984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.414+0000 7feb077fe640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb08100a40 0x7feb08197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb07fff640 1 -- 172.21.15.1:0/2604527700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb08100a40 msgr2=0x7feb08197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb07fff640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb08100a40 0x7feb08197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb07fff640 1 -- 172.21.15.1:0/2604527700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08101c30 msgr2=0x7feb081984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb07fff640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08101c30 0x7feb081984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb07fff640 1 -- 172.21.15.1:0/2604527700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0819fb80 con 0x7feb081025f0 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb06ffd640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08101c30 0x7feb081984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb07fff640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb081025f0 0x7feb0819f510 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7feb0000eaa0 tx=0x7feb0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb04ff9640 1 -- 172.21.15.1:0/2604527700 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0000cdb0 con 0x7feb081025f0 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb04ff9640 1 -- 172.21.15.1:0/2604527700 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb00004b20 con 0x7feb081025f0 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb0df42640 1 -- 172.21.15.1:0/2604527700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0819fe70 con 0x7feb081025f0 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb04ff9640 1 -- 172.21.15.1:0/2604527700 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00011760 con 0x7feb081025f0 2024-09-19T09:07:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.415+0000 7feb0df42640 1 -- 172.21.15.1:0/2604527700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb081a02e0 con 0x7feb081025f0 2024-09-19T09:07:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.417+0000 7feb04ff9640 1 -- 172.21.15.1:0/2604527700 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7feb00004cd0 con 0x7feb081025f0 2024-09-19T09:07:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb10cdb740 1 Processor -- start 2024-09-19T09:07:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb10cdb740 1 -- start start 2024-09-19T09:07:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d4db0 0x5610cf8d51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d56f0 0x5610cf8da1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8dcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb10cdb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610cf8342f0 con 0x5610cf8da780 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb10cdb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5610cf7dc270 con 0x5610cf8d4db0 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb10cdb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610cf8302b0 con 0x5610cf8d56f0 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d4db0 0x5610cf8d51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb077fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d56f0 0x5610cf8da1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d4db0 0x5610cf8d51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:56158/0 (socket says 172.21.15.1:56158) 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 -- 172.21.15.1:0/1753676739 learned_addr learned my addr 172.21.15.1:0/1753676739 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8dcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb04ff9640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feaf00a3240 0x7feaf00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 -- 172.21.15.1:0/1753676739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d56f0 msgr2=0x5610cf8da1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d56f0 0x5610cf8da1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb07fff640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feaf00a3240 0x7feaf00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 -- 172.21.15.1:0/1753676739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 msgr2=0x5610cf8dcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8dcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb06ffd640 1 -- 172.21.15.1:0/1753676739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cf7db340 con 0x5610cf8d4db0 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.418+0000 7feb077fe640 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d56f0 0x5610cf8da1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.419+0000 7feb04ff9640 1 -- 172.21.15.1:0/2604527700 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7feb000cfb30 con 0x7feb081025f0 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.419+0000 7feb06ffd640 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d4db0 0x5610cf8d51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feafc011be0 tx=0x7feafc009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=251374eaac74749d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.419+0000 7feaedffb640 1 -- 172.21.15.1:0/1753676739 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc00fc50 con 0x5610cf8d4db0 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.419+0000 7feb07fff640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feaf00a3240 0x7feaf00a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb000cd980 tx=0x7feb000670c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.419+0000 7feaedffb640 1 -- 172.21.15.1:0/1753676739 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feafc00fdf0 con 0x5610cf8d4db0 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.419+0000 7feaedffb640 1 -- 172.21.15.1:0/1753676739 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc00e740 con 0x5610cf8d4db0 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 -- 172.21.15.1:0/1753676739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d4db0 msgr2=0x5610cf8d51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d4db0 0x5610cf8d51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feafc011be0 tx=0x7feafc009ba0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 -- 172.21.15.1:0/1753676739 shutdown_connections 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8dcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d56f0 0x5610cf8da1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 --2- 172.21.15.1:0/1753676739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d4db0 0x5610cf8d51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 -- 172.21.15.1:0/1753676739 >> 172.21.15.1:0/1753676739 conn(0x5610cf8cc010 msgr2=0x5610cf8cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 -- 172.21.15.1:0/1753676739 shutdown_connections 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 -- 172.21.15.1:0/1753676739 wait complete. 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 -- start start 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.420+0000 7feb10cdb740 1 Processor -- start 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8d4db0 0x5610cf8df000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8df540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8da780 0x5610cf8e6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb10cdb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5610cf8dd750 con 0x5610cf8d4db0 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb10cdb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5610cf7bd290 con 0x5610cf8d56f0 2024-09-19T09:07:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb10cdb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5610cf8dd8d0 con 0x5610cf8da780 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb10cdb740 10 client.0 _ll_register_callbacks cb 0x5610cf7ee140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8d4db0 0x5610cf8df000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8df540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8d4db0 0x5610cf8df000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50300/0 (socket says 172.21.15.1:50300) 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 -- 172.21.15.1:0/185481707 learned_addr learned my addr 172.21.15.1:0/185481707 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8da780 0x5610cf8e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 -- 172.21.15.1:0/185481707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8da780 msgr2=0x5610cf8e6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8da780 0x5610cf8e6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 -- 172.21.15.1:0/185481707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 msgr2=0x5610cf8df540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8df540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 -- 172.21.15.1:0/185481707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610cf547210 con 0x5610cf8d4db0 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb077fe640 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8df540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feb06ffd640 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8d4db0 0x5610cf8df000 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7feafc020fd0 tx=0x7feafc0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853f33675b94e4fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feae6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.421+0000 7feae6ffd640 1 -- 172.21.15.1:0/185481707 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc005460 con 0x5610cf8d4db0 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feae6ffd640 1 -- 172.21.15.1:0/185481707 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7feafc0046c0 con 0x5610cf8d4db0 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 1 -- 172.21.15.1:0/185481707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feafc00fdf0 con 0x5610cf8d4db0 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feae6ffd640 1 -- 172.21.15.1:0/185481707 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feafc032070 con 0x5610cf8d4db0 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 10 client.16473 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 1 -- 172.21.15.1:0/185481707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610cf613620 con 0x5610cf8d4db0 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feae6ffd640 1 -- 172.21.15.1:0/185481707 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feafc00fdf0 con 0x5610cf8d4db0 2024-09-19T09:07:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feae6ffd640 1 -- 172.21.15.1:0/185481707 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feafc01d020 con 0x5610cf8d4db0 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 10 client.16473 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 10 client.16473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 20 client.16473 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5610cf8eaa50 0x5610cf8ece70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 4 client.16473 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb10cdb740 1 -- 172.21.15.1:0/185481707 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610cf841a20 con 0x5610cf8eaa50 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.422+0000 7feb077fe640 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5610cf8eaa50 0x5610cf8ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.423+0000 7feae6ffd640 10 client.16473 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.423+0000 7feb077fe640 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5610cf8eaa50 0x5610cf8ece70 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a8788de463931bf server_cookie=f5e4bf1821ec534c in_seq=0 out_seq=0 2024-09-19T09:07:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feae6ffd640 1 -- 172.21.15.1:0/185481707 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610cf841a20 con 0x5610cf8eaa50 2024-09-19T09:07:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feae6ffd640 10 client.16473 handle_command_reply: tid=0 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 client.16473 shutdown 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 -- 172.21.15.1:0/185481707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8d4db0 msgr2=0x5610cf8df000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8d4db0 0x5610cf8df000 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7feafc020fd0 tx=0x7feafc0096c0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 -- 172.21.15.1:0/185481707 shutdown_connections 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5610cf8eaa50 0x5610cf8ece70 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8da780 0x5610cf8e6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8df540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feae6ffd640 0 client.16473 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 --2- 172.21.15.1:0/185481707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8d4db0 0x5610cf8df000 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 -- 172.21.15.1:0/185481707 >> 172.21.15.1:0/185481707 conn(0x5610cf8cc010 msgr2=0x5610cf8cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 -- 172.21.15.1:0/185481707 shutdown_connections 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 1 -- 172.21.15.1:0/185481707 wait complete. 2024-09-19T09:07:41.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.425+0000 7feb10cdb740 20 client.16473 trim_cache size 0 max 16384 2024-09-19T09:07:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb10cdb740 1 Processor -- start 2024-09-19T09:07:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb10cdb740 1 -- start start 2024-09-19T09:07:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 0x5610cf8cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8f1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb10cdb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feb081a9960 con 0x5610cf8da780 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb10cdb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feb081a7170 con 0x5610cf8d56f0 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb10cdb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feb081a4fc0 con 0x5610cf8d4db0 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8f1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50316/0 (socket says 172.21.15.1:50316) 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb06ffd640 1 -- 172.21.15.1:0/3103946716 learned_addr learned my addr 172.21.15.1:0/3103946716 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb06ffd640 1 --2- 172.21.15.1:0/3103946716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 0x5610cf8cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb077fe640 1 -- 172.21.15.1:0/3103946716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 msgr2=0x5610cf8cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb077fe640 1 --2- 172.21.15.1:0/3103946716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 0x5610cf8cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb077fe640 1 -- 172.21.15.1:0/3103946716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 msgr2=0x5610cf8f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:41.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb077fe640 1 --2- 172.21.15.1:0/3103946716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8f1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.441+0000 7feb077fe640 1 -- 172.21.15.1:0/3103946716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610cf8d5bd0 con 0x5610cf8d56f0 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb077fe640 1 --2- 172.21.15.1:0/3103946716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e6540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009230 tx=0x7feaf8005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=508cbf7f4eaef294 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feaed7fa640 1 -- 172.21.15.1:0/3103946716 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8035040 con 0x5610cf8d56f0 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feaed7fa640 1 -- 172.21.15.1:0/3103946716 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feaf804b070 con 0x5610cf8d56f0 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feaed7fa640 1 -- 172.21.15.1:0/3103946716 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8031740 con 0x5610cf8d56f0 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb10cdb740 1 -- 172.21.15.1:0/3103946716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 msgr2=0x5610cf8e6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb10cdb740 1 --2- 172.21.15.1:0/3103946716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e6540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009230 tx=0x7feaf8005a20 comp rx=0 tx=0).stop 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb10cdb740 1 -- 172.21.15.1:0/3103946716 shutdown_connections 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb10cdb740 1 --2- 172.21.15.1:0/3103946716 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb10cdb740 1 --2- 172.21.15.1:0/3103946716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e6540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb10cdb740 1 --2- 172.21.15.1:0/3103946716 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 0x5610cf8cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb10cdb740 1 -- 172.21.15.1:0/3103946716 >> 172.21.15.1:0/3103946716 conn(0x5610cf8cc010 msgr2=0x5610cf8ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.442+0000 7feb10cdb740 1 -- 172.21.15.1:0/3103946716 shutdown_connections 2024-09-19T09:07:41.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 -- 172.21.15.1:0/3103946716 wait complete. 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 -- start start 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 Processor -- start 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 0x5610cf8e3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feb081a5630 con 0x5610cf8da780 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feb081a6aa0 con 0x5610cf8d56f0 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feb081a5d00 con 0x5610cf8d4db0 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb10cdb740 10 client.0 _ll_register_callbacks cb 0x7feafc0116b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb06ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8e4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50332/0 (socket says 172.21.15.1:50332) 2024-09-19T09:07:41.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb077fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:56190/0 (socket says 172.21.15.1:56190) 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.443+0000 7feb06ffd640 1 -- 172.21.15.1:0/708047145 learned_addr learned my addr 172.21.15.1:0/708047145 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb06ffd640 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 0x5610cf8e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb077fe640 1 -- 172.21.15.1:0/708047145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 msgr2=0x5610cf8e3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb077fe640 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 0x5610cf8e3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb077fe640 1 -- 172.21.15.1:0/708047145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 msgr2=0x5610cf8e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb077fe640 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8e4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb077fe640 1 -- 172.21.15.1:0/708047145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610cf8e5490 con 0x5610cf8d56f0 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb06ffd640 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb077fe640 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e3ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5610cf8e01a0 tx=0x7feaf8004570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64e7c2bdc3a6f306 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feae6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feae6ffd640 1 -- 172.21.15.1:0/708047145 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8054070 con 0x5610cf8d56f0 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb10cdb740 1 -- 172.21.15.1:0/708047145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf804b070 con 0x5610cf8d56f0 2024-09-19T09:07:41.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feae6ffd640 1 -- 172.21.15.1:0/708047145 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7feaf8005000 con 0x5610cf8d56f0 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feae6ffd640 1 -- 172.21.15.1:0/708047145 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feaf8035040 con 0x5610cf8d56f0 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb10cdb740 10 client.25967 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feb10cdb740 1 -- 172.21.15.1:0/708047145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5610cf8e6810 con 0x5610cf8d56f0 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.444+0000 7feae6ffd640 1 -- 172.21.15.1:0/708047145 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feaf804b070 con 0x5610cf8d56f0 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feae6ffd640 1 -- 172.21.15.1:0/708047145 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feaf80035f0 con 0x5610cf8d56f0 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feb10cdb740 10 client.25967 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feb10cdb740 10 client.25967 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feb10cdb740 20 client.25967 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feb10cdb740 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5610cf955f60 0x5610cf958380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feb10cdb740 4 client.25967 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feb10cdb740 1 -- 172.21.15.1:0/708047145 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5610cf83bd70 con 0x5610cf955f60 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feb06ffd640 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5610cf955f60 0x5610cf958380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feb06ffd640 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5610cf955f60 0x5610cf958380 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c59755068e44428c server_cookie=730ba6e037c76d3 in_seq=0 out_seq=0 2024-09-19T09:07:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:41.445+0000 7feae6ffd640 10 client.25967 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:41.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:41 smithi022 ceph-mon[35107]: pgmap v445: 97 pgs: 97 active+clean; 128 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 599 op/s 2024-09-19T09:07:42.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:41 smithi001 ceph-mon[30939]: pgmap v445: 97 pgs: 97 active+clean; 128 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 599 op/s 2024-09-19T09:07:42.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:41 smithi064 ceph-mon[35179]: pgmap v445: 97 pgs: 97 active+clean; 128 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 599 op/s 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.347+0000 7feae6ffd640 1 -- 172.21.15.1:0/708047145 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5610cf83bd70 con 0x5610cf955f60 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.347+0000 7feae6ffd640 10 client.25967 handle_command_reply: tid=0 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.347+0000 7feb10cdb740 1 client.25967 shutdown 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 -- 172.21.15.1:0/708047145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 msgr2=0x5610cf8e3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e3ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5610cf8e01a0 tx=0x7feaf8004570 comp rx=0 tx=0).stop 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 -- 172.21.15.1:0/708047145 shutdown_connections 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5610cf955f60 0x5610cf958380 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5610cf8da780 0x5610cf8e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5610cf8d56f0 0x5610cf8e3ec0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feae6ffd640 0 client.25967 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 --2- 172.21.15.1:0/708047145 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5610cf8d4db0 0x5610cf8e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 -- 172.21.15.1:0/708047145 >> 172.21.15.1:0/708047145 conn(0x5610cf8cc010 msgr2=0x5610cf8ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 -- 172.21.15.1:0/708047145 shutdown_connections 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 1 -- 172.21.15.1:0/708047145 wait complete. 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.348+0000 7feb10cdb740 20 client.25967 trim_cache size 0 max 16384 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:07:42.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:07:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 -- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feaf00a3240 msgr2=0x7feaf00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feaf00a3240 0x7feaf00a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb000cd980 tx=0x7feb000670c0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 -- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb081025f0 msgr2=0x7feb0819f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb081025f0 0x7feb0819f510 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7feb0000eaa0 tx=0x7feb0000ef60 comp rx=0 tx=0).stop 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 -- 172.21.15.1:0/2604527700 shutdown_connections 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feb081025f0 0x7feb0819f510 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb08101c30 0x7feb081984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feaf00a3240 0x7feaf00a5700 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 --2- 172.21.15.1:0/2604527700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb08100a40 0x7feb08197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 -- 172.21.15.1:0/2604527700 >> 172.21.15.1:0/2604527700 conn(0x7feb080fc1c0 msgr2=0x7feb08104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 -- 172.21.15.1:0/2604527700 shutdown_connections 2024-09-19T09:07:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:42.349+0000 7feb0df42640 1 -- 172.21.15.1:0/2604527700 wait complete. 2024-09-19T09:07:43.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:43 smithi022 ceph-mon[35107]: pgmap v446: 97 pgs: 97 active+clean; 128 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 414 op/s 2024-09-19T09:07:44.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:43 smithi001 ceph-mon[30939]: pgmap v446: 97 pgs: 97 active+clean; 128 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 414 op/s 2024-09-19T09:07:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:43 smithi064 ceph-mon[35179]: pgmap v446: 97 pgs: 97 active+clean; 128 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 414 op/s 2024-09-19T09:07:45.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:45 smithi022 ceph-mon[35107]: pgmap v447: 97 pgs: 97 active+clean; 118 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 762 op/s 2024-09-19T09:07:46.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:45 smithi001 ceph-mon[30939]: pgmap v447: 97 pgs: 97 active+clean; 118 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 762 op/s 2024-09-19T09:07:46.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:45 smithi064 ceph-mon[35179]: pgmap v447: 97 pgs: 97 active+clean; 118 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 762 op/s 2024-09-19T09:07:46.837 INFO:tasks.workunit.client.0.smithi001.stderr:+ sync 2024-09-19T09:07:47.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:47 smithi022 ceph-mon[35107]: pgmap v448: 97 pgs: 97 active+clean; 112 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.4 MiB/s wr, 794 op/s 2024-09-19T09:07:48.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:47 smithi001 ceph-mon[30939]: pgmap v448: 97 pgs: 97 active+clean; 112 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.4 MiB/s wr, 794 op/s 2024-09-19T09:07:48.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:47 smithi064 ceph-mon[35179]: pgmap v448: 97 pgs: 97 active+clean; 112 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.4 MiB/s wr, 794 op/s 2024-09-19T09:07:48.654 INFO:tasks.workunit.client.0.smithi001.stderr:+ tar c linux-4.0.5 2024-09-19T09:07:48.948 INFO:tasks.workunit.client.0.smithi001.stdout:Ok 2024-09-19T09:07:48.949 INFO:tasks.workunit.client.0.smithi001.stderr:+ echo Ok 2024-09-19T09:07:48.950 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:07:48.950 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:07:49.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:49 smithi022 ceph-mon[35107]: pgmap v449: 97 pgs: 97 active+clean; 112 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.9 MiB/s wr, 725 op/s 2024-09-19T09:07:50.024 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:07:50.046 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:49 smithi001 ceph-mon[30939]: pgmap v449: 97 pgs: 97 active+clean; 112 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.9 MiB/s wr, 725 op/s 2024-09-19T09:07:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:49 smithi064 ceph-mon[35179]: pgmap v449: 97 pgs: 97 active+clean; 112 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.9 MiB/s wr, 725 op/s 2024-09-19T09:07:50.301 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:50.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 -- 172.21.15.1:0/866044240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 msgr2=0x7fc8fc110ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 --2- 172.21.15.1:0/866044240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 0x7fc8fc110ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009ca0 tx=0x7fc8f402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 -- 172.21.15.1:0/866044240 shutdown_connections 2024-09-19T09:07:50.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 --2- 172.21.15.1:0/866044240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 0x7fc8fc110ea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 --2- 172.21.15.1:0/866044240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8fc100c70 0x7fc8fc106830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 --2- 172.21.15.1:0/866044240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc100350 0x7fc8fc100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 -- 172.21.15.1:0/866044240 >> 172.21.15.1:0/866044240 conn(0x7fc8fc077210 msgr2=0x7fc8fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:50.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 -- 172.21.15.1:0/866044240 shutdown_connections 2024-09-19T09:07:50.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.800+0000 7fc901550640 1 -- 172.21.15.1:0/866044240 wait complete. 2024-09-19T09:07:50.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.801+0000 7fc901550640 1 Processor -- start 2024-09-19T09:07:50.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc901550640 1 -- start start 2024-09-19T09:07:50.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc901550640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8fc100350 0x7fc8fc196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc901550640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc100c70 0x7fc8fc196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc901550640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 0x7fc8fc19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc901550640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc10ba70 con 0x7fc8fc100350 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc901550640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc10b8f0 con 0x7fc8fc100c70 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc901550640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc10bbf0 con 0x7fc8fc106e80 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc100c70 0x7fc8fc196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 0x7fc8fc19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc100c70 0x7fc8fc196840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:56734/0 (socket says 172.21.15.1:56734) 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/477441617 learned_addr learned my addr 172.21.15.1:0/477441617 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8faffd640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8fc100350 0x7fc8fc196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/477441617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 msgr2=0x7fc8fc19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 0x7fc8fc19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8fc100350 msgr2=0x7fc8fc196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8fc100350 0x7fc8fc196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.802+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/477441617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8fc19b2b0 con 0x7fc8fc100c70 2024-09-19T09:07:50.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.803+0000 7fc8faffd640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8fc100350 0x7fc8fc196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:50.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.803+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 0x7fc8fc19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:50.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.803+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc100c70 0x7fc8fc196840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000e9f0 tx=0x7fc8f000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:50.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.803+0000 7fc8e3fff640 1 -- 172.21.15.1:0/477441617 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000cac0 con 0x7fc8fc100c70 2024-09-19T09:07:50.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.803+0000 7fc8e3fff640 1 -- 172.21.15.1:0/477441617 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8f000cc60 con 0x7fc8fc100c70 2024-09-19T09:07:50.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.805+0000 7fc8e3fff640 1 -- 172.21.15.1:0/477441617 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0010690 con 0x7fc8fc100c70 2024-09-19T09:07:50.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.805+0000 7fc901550640 1 -- 172.21.15.1:0/477441617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8fc19b5a0 con 0x7fc8fc100c70 2024-09-19T09:07:50.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.805+0000 7fc901550640 1 -- 172.21.15.1:0/477441617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8fc1a2e80 con 0x7fc8fc100c70 2024-09-19T09:07:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.809+0000 7fc8e3fff640 1 -- 172.21.15.1:0/477441617 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fc8f00035f0 con 0x7fc8fc100c70 2024-09-19T09:07:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.809+0000 7fc903929740 1 Processor -- start 2024-09-19T09:07:50.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.809+0000 7fc903929740 1 -- start start 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc903929740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c282880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc903929740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c282dc0 0x558a2c28d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc903929740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c28d680 0x558a2c28fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc903929740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558a2c1e82e0 con 0x558a2c282dc0 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc903929740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558a2c18fce0 con 0x558a2c28d680 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc903929740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558a2c1e42a0 con 0x558a2c2824a0 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc8faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c282dc0 0x558a2c28d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc8faffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c282dc0 0x558a2c28d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40690/0 (socket says 172.21.15.1:40690) 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc8fb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c282880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc8faffd640 1 -- 172.21.15.1:0/1764868518 learned_addr learned my addr 172.21.15.1:0/1764868518 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:50.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.810+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c28d680 0x558a2c28fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.811+0000 7fc8e3fff640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc8e40a3260 0x7fc8e40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.811+0000 7fc8e3fff640 1 -- 172.21.15.1:0/477441617 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc8f00cfbb0 con 0x7fc8fc100c70 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.811+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/1764868518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c28d680 msgr2=0x558a2c28fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.811+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c28d680 0x558a2c28fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.811+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/1764868518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c282dc0 msgr2=0x558a2c28d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.811+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c282dc0 0x558a2c28d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.811+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/1764868518 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a2c174440 con 0x558a2c2824a0 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.811+0000 7fc8faffd640 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c282dc0 0x558a2c28d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.812+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c282880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4005e30 tx=0x7fc8f4009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f175acb40367d1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:50.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.812+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc8e40a3260 0x7fc8e40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.812+0000 7fc8e17fa640 1 -- 172.21.15.1:0/1764868518 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4042030 con 0x558a2c2824a0 2024-09-19T09:07:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.812+0000 7fc8e17fa640 1 -- 172.21.15.1:0/1764868518 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8f4036040 con 0x558a2c2824a0 2024-09-19T09:07:50.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.812+0000 7fc8e17fa640 1 -- 172.21.15.1:0/1764868518 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f402fd10 con 0x558a2c2824a0 2024-09-19T09:07:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.813+0000 7fc903929740 1 -- 172.21.15.1:0/1764868518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 msgr2=0x558a2c282880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.813+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc8e40a3260 0x7fc8e40a5720 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4006010 tx=0x7fc8f404c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.813+0000 7fc903929740 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c282880 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4005e30 tx=0x7fc8f4009800 comp rx=0 tx=0).stop 2024-09-19T09:07:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.813+0000 7fc903929740 1 -- 172.21.15.1:0/1764868518 shutdown_connections 2024-09-19T09:07:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.813+0000 7fc903929740 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c28d680 0x558a2c28fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.813+0000 7fc903929740 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c282dc0 0x558a2c28d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.813+0000 7fc903929740 1 --2- 172.21.15.1:0/1764868518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c282880 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.813+0000 7fc903929740 1 -- 172.21.15.1:0/1764868518 >> 172.21.15.1:0/1764868518 conn(0x558a2c27ea30 msgr2=0x558a2c27ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.814+0000 7fc903929740 1 -- 172.21.15.1:0/1764868518 shutdown_connections 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.814+0000 7fc903929740 1 -- 172.21.15.1:0/1764868518 wait complete. 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.814+0000 7fc903929740 1 -- start start 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.814+0000 7fc903929740 1 Processor -- start 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc903929740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c2824a0 0x558a2c28cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc903929740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c28a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc903929740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c28d680 0x558a2c28a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc903929740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558a2c290250 con 0x558a2c2824a0 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc903929740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558a2c1a3050 con 0x558a2c282dc0 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc903929740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558a2c2903d0 con 0x558a2c28d680 2024-09-19T09:07:50.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc903929740 10 client.0 _ll_register_callbacks cb 0x558a2c1e3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c28a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c28a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:56748/0 (socket says 172.21.15.1:56748) 2024-09-19T09:07:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/3573520504 learned_addr learned my addr 172.21.15.1:0/3573520504 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.815+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c28d680 0x558a2c28a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8faffd640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c2824a0 0x558a2c28cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/3573520504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 msgr2=0x558a2c28a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c28a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/3573520504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c2824a0 msgr2=0x558a2c28cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c2824a0 0x558a2c28cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/3573520504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a2bf593c0 con 0x558a2c28d680 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c28a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8faffd640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c2824a0 0x558a2c28cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c28d680 0x558a2c28a750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4031f80 tx=0x7fc8f40095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643c93eb7935f3a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.816+0000 7fc8deff5640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.817+0000 7fc8deff5640 1 -- 172.21.15.1:0/3573520504 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f405e060 con 0x558a2c28d680 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.817+0000 7fc903929740 1 -- 172.21.15.1:0/3573520504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f4036040 con 0x558a2c28d680 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.817+0000 7fc8deff5640 1 -- 172.21.15.1:0/3573520504 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc8f402fbc0 con 0x558a2c28d680 2024-09-19T09:07:50.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.817+0000 7fc8deff5640 1 -- 172.21.15.1:0/3573520504 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc8f4042050 con 0x558a2c28d680 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.817+0000 7fc903929740 10 client.25909 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.817+0000 7fc903929740 1 -- 172.21.15.1:0/3573520504 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a2c290250 con 0x558a2c28d680 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.818+0000 7fc8deff5640 1 -- 172.21.15.1:0/3573520504 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8f4036040 con 0x558a2c28d680 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.818+0000 7fc8deff5640 1 -- 172.21.15.1:0/3573520504 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc8f4030ac0 con 0x558a2c28d680 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.818+0000 7fc903929740 10 client.25909 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.818+0000 7fc903929740 10 client.25909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.819+0000 7fc903929740 20 client.25909 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.819+0000 7fc903929740 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558a2c29cd40 0x558a2c29f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.819+0000 7fc903929740 4 client.25909 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.819+0000 7fc903929740 1 -- 172.21.15.1:0/3573520504 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a2c1f5850 con 0x558a2c29cd40 2024-09-19T09:07:50.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.819+0000 7fc8faffd640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558a2c29cd40 0x558a2c29f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.819+0000 7fc8deff5640 10 client.25909 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.819+0000 7fc8faffd640 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558a2c29cd40 0x558a2c29f130 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1ec15f67da9349 server_cookie=4ffca2dae65e7cf3 in_seq=0 out_seq=0 2024-09-19T09:07:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.820+0000 7fc8deff5640 1 -- 172.21.15.1:0/3573520504 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a2c1f5850 con 0x558a2c29cd40 2024-09-19T09:07:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.821+0000 7fc8deff5640 10 client.25909 handle_command_reply: tid=0 2024-09-19T09:07:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.821+0000 7fc903929740 1 client.25909 shutdown 2024-09-19T09:07:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.821+0000 7fc903929740 1 -- 172.21.15.1:0/3573520504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c28d680 msgr2=0x558a2c28a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.821+0000 7fc903929740 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c28d680 0x558a2c28a750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4031f80 tx=0x7fc8f40095c0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.822+0000 7fc903929740 1 -- 172.21.15.1:0/3573520504 shutdown_connections 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.822+0000 7fc903929740 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558a2c29cd40 0x558a2c29f130 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.822+0000 7fc903929740 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c28d680 0x558a2c28a750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.823+0000 7fc8deff5640 0 client.25909 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.823+0000 7fc903929740 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c28a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.823+0000 7fc903929740 1 --2- 172.21.15.1:0/3573520504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c2824a0 0x558a2c28cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.823+0000 7fc903929740 1 -- 172.21.15.1:0/3573520504 >> 172.21.15.1:0/3573520504 conn(0x558a2c27ea30 msgr2=0x558a2c27db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.823+0000 7fc903929740 1 -- 172.21.15.1:0/3573520504 shutdown_connections 2024-09-19T09:07:50.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.823+0000 7fc903929740 1 -- 172.21.15.1:0/3573520504 wait complete. 2024-09-19T09:07:50.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.823+0000 7fc903929740 20 client.25909 trim_cache size 0 max 16384 2024-09-19T09:07:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc903929740 1 Processor -- start 2024-09-19T09:07:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc903929740 1 -- start start 2024-09-19T09:07:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc903929740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c27db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc903929740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c2a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc903929740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c2a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc903929740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc1adc10 con 0x558a2c28d680 2024-09-19T09:07:50.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc903929740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc1ab420 con 0x558a2c282dc0 2024-09-19T09:07:50.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc903929740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc1a9270 con 0x558a2c2824a0 2024-09-19T09:07:50.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc8fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c2a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc8fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c2a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40704/0 (socket says 172.21.15.1:40704) 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/514159784 learned_addr learned my addr 172.21.15.1:0/514159784 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc8faffd640 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c27db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.846+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c2a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/514159784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 msgr2=0x558a2c27db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c27db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/514159784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 msgr2=0x558a2c2a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c2a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8fb7fe640 1 -- 172.21.15.1:0/514159784 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a2c28d2d0 con 0x558a2c28d680 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c2a4e20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc8f402ade0 tx=0x7fc8f402b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad2dc6f67c49a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8e0ff9640 1 -- 172.21.15.1:0/514159784 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4068070 con 0x558a2c28d680 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8e0ff9640 1 -- 172.21.15.1:0/514159784 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8f4043040 con 0x558a2c28d680 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.847+0000 7fc8e0ff9640 1 -- 172.21.15.1:0/514159784 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f405e070 con 0x558a2c28d680 2024-09-19T09:07:50.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 -- 172.21.15.1:0/514159784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 msgr2=0x558a2c2a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c2a4e20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc8f402ade0 tx=0x7fc8f402b040 comp rx=0 tx=0).stop 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 -- 172.21.15.1:0/514159784 shutdown_connections 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c2a4e20 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c282dc0 0x558a2c2a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 --2- 172.21.15.1:0/514159784 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c2824a0 0x558a2c27db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 -- 172.21.15.1:0/514159784 >> 172.21.15.1:0/514159784 conn(0x558a2c27ea30 msgr2=0x558a2c28c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 -- 172.21.15.1:0/514159784 shutdown_connections 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 -- 172.21.15.1:0/514159784 wait complete. 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 -- start start 2024-09-19T09:07:50.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.848+0000 7fc903929740 1 Processor -- start 2024-09-19T09:07:50.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc903929740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c2824a0 0x558a2c293300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc903929740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c282dc0 0x558a2c293840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc903929740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c293d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc903929740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc1a98e0 con 0x558a2c28d680 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc903929740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc1aad50 con 0x558a2c2824a0 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc903929740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc8fc1a9fb0 con 0x558a2c282dc0 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc903929740 10 client.0 _ll_register_callbacks cb 0x7fc8ec0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c282dc0 0x558a2c293840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fa7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c282dc0 0x558a2c293840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:37180/0 (socket says 172.21.15.1:37180) 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/821294968 learned_addr learned my addr 172.21.15.1:0/821294968 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c293d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8faffd640 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c2824a0 0x558a2c293300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/821294968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c2824a0 msgr2=0x558a2c293300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c2824a0 0x558a2c293300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/821294968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 msgr2=0x558a2c293d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:50.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c293d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fa7fc640 1 -- 172.21.15.1:0/821294968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a2c3068c0 con 0x558a2c282dc0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.849+0000 7fc8fb7fe640 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c293d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc8fa7fc640 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c282dc0 0x558a2c293840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c6a0 tx=0x7fc8f00d3290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2649d3e8d8f33be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc8deff5640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc8deff5640 1 -- 172.21.15.1:0/821294968 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00038e0 con 0x558a2c282dc0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc8deff5640 1 -- 172.21.15.1:0/821294968 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc8f0098820 con 0x558a2c282dc0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 1 -- 172.21.15.1:0/821294968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f4043040 con 0x558a2c282dc0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc8deff5640 1 -- 172.21.15.1:0/821294968 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc8f009c8b0 con 0x558a2c282dc0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 10 client.25915 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 1 -- 172.21.15.1:0/821294968 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a2c307ba0 con 0x558a2c282dc0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc8deff5640 1 -- 172.21.15.1:0/821294968 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc8f4043040 con 0x558a2c282dc0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc8deff5640 1 -- 172.21.15.1:0/821294968 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc8f00bc0b0 con 0x558a2c282dc0 2024-09-19T09:07:50.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 10 client.25915 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 10 client.25915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 20 client.25915 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558a2c29cd40 0x558a2c30a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 4 client.25915 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.850+0000 7fc903929740 1 -- 172.21.15.1:0/821294968 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558a2c1efd60 con 0x558a2c29cd40 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.851+0000 7fc8faffd640 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558a2c29cd40 0x558a2c30a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.851+0000 7fc8faffd640 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558a2c29cd40 0x558a2c30a370 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffaa0fd36d45a605 server_cookie=12fdcaae5c143713 in_seq=0 out_seq=0 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.851+0000 7fc8deff5640 10 client.25915 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.851+0000 7fc8deff5640 1 -- 172.21.15.1:0/821294968 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558a2c1efd60 con 0x558a2c29cd40 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.851+0000 7fc8deff5640 10 client.25915 handle_command_reply: tid=0 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.851+0000 7fc903929740 1 client.25915 shutdown 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.851+0000 7fc903929740 1 -- 172.21.15.1:0/821294968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c282dc0 msgr2=0x558a2c293840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.851+0000 7fc903929740 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c282dc0 0x558a2c293840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c6a0 tx=0x7fc8f00d3290 comp rx=0 tx=0).stop 2024-09-19T09:07:50.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 1 -- 172.21.15.1:0/821294968 shutdown_connections 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x558a2c29cd40 0x558a2c30a370 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558a2c28d680 0x558a2c293d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558a2c282dc0 0x558a2c293840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 1 --2- 172.21.15.1:0/821294968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a2c2824a0 0x558a2c293300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 1 -- 172.21.15.1:0/821294968 >> 172.21.15.1:0/821294968 conn(0x558a2c27ea30 msgr2=0x558a2c27db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc8deff5640 0 client.25915 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 1 -- 172.21.15.1:0/821294968 shutdown_connections 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 1 -- 172.21.15.1:0/821294968 wait complete. 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc903929740 20 client.25915 trim_cache size 0 max 16384 2024-09-19T09:07:50.859 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:07:50.860 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:07:50.860 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:07:50.860 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:07:50.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 -- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc8e40a3260 msgr2=0x7fc8e40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc8e40a3260 0x7fc8e40a5720 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4006010 tx=0x7fc8f404c000 comp rx=0 tx=0).stop 2024-09-19T09:07:50.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 -- 172.21.15.1:0/477441617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc100c70 msgr2=0x7fc8fc196840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:50.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc100c70 0x7fc8fc196840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000e9f0 tx=0x7fc8f000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 -- 172.21.15.1:0/477441617 shutdown_connections 2024-09-19T09:07:50.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc8e40a3260 0x7fc8e40a5720 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8fc106e80 0x7fc8fc19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8fc100c70 0x7fc8fc196840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 --2- 172.21.15.1:0/477441617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8fc100350 0x7fc8fc196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:50.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 -- 172.21.15.1:0/477441617 >> 172.21.15.1:0/477441617 conn(0x7fc8fc077210 msgr2=0x7fc8fc106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:50.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.852+0000 7fc901550640 1 -- 172.21.15.1:0/477441617 shutdown_connections 2024-09-19T09:07:50.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:50.853+0000 7fc901550640 1 -- 172.21.15.1:0/477441617 wait complete. 2024-09-19T09:07:51.716 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:07:51.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:07:51.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:51 smithi022 ceph-mon[35107]: pgmap v450: 97 pgs: 97 active+clean; 146 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.9 MiB/s wr, 1.06k op/s 2024-09-19T09:07:52.039 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:51 smithi001 ceph-mon[30939]: pgmap v450: 97 pgs: 97 active+clean; 146 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.9 MiB/s wr, 1.06k op/s 2024-09-19T09:07:52.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:51 smithi064 ceph-mon[35179]: pgmap v450: 97 pgs: 97 active+clean; 146 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.9 MiB/s wr, 1.06k op/s 2024-09-19T09:07:52.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 -- 172.21.15.1:0/396528584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 msgr2=0x7feefc103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:52.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 --2- 172.21.15.1:0/396528584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 0x7feefc103170 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7feeec009930 tx=0x7feeec02a420 comp rx=0 tx=0).stop 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 -- 172.21.15.1:0/396528584 shutdown_connections 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 --2- 172.21.15.1:0/396528584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feefc108290 0x7feefc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 --2- 172.21.15.1:0/396528584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feefc103740 0x7feefc107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 --2- 172.21.15.1:0/396528584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 0x7feefc103170 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 -- 172.21.15.1:0/396528584 >> 172.21.15.1:0/396528584 conn(0x7feefc0fc7d0 msgr2=0x7feefc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 -- 172.21.15.1:0/396528584 shutdown_connections 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.476+0000 7fef0289a640 1 -- 172.21.15.1:0/396528584 wait complete. 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.477+0000 7fef0289a640 1 Processor -- start 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.477+0000 7fef0289a640 1 -- start start 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.477+0000 7fef0289a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 0x7feefc1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:52.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.477+0000 7fef0289a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feefc103740 0x7feefc100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7fef0289a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feefc108290 0x7feefc101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7fef0289a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feefc1121b0 con 0x7feefc102d90 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7fef0289a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feefc112030 con 0x7feefc103740 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7fef0289a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feefc112330 con 0x7feefc108290 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 0x7feefc1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 0x7feefc1009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40230/0 (socket says 172.21.15.1:40230) 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feefc103740 0x7feefc100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefbfff640 1 -- 172.21.15.1:0/3591478279 learned_addr learned my addr 172.21.15.1:0/3591478279 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7fef00e37640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feefc108290 0x7feefc101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefb7fe640 1 -- 172.21.15.1:0/3591478279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feefc108290 msgr2=0x7feefc101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefb7fe640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feefc108290 0x7feefc101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefb7fe640 1 -- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 msgr2=0x7feefc1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:52.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefb7fe640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 0x7feefc1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefb7fe640 1 -- 172.21.15.1:0/3591478279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc1a6af0 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefbfff640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 0x7feefc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feefb7fe640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feefc103740 0x7feefc100f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feef0005fd0 tx=0x7feef000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7feef97fa640 1 -- 172.21.15.1:0/3591478279 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0009c00 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.478+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc1a6de0 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.479+0000 7feef97fa640 1 -- 172.21.15.1:0/3591478279 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feef0009da0 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.479+0000 7feef97fa640 1 -- 172.21.15.1:0/3591478279 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0010460 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.479+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc1a72e0 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.479+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc06a7f0 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.481+0000 7feef97fa640 1 -- 172.21.15.1:0/3591478279 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7feef0003fb0 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.481+0000 7feef97fa640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feee40a3240 0x7feee40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.482+0000 7feef97fa640 1 -- 172.21.15.1:0/3591478279 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7feef00cf720 con 0x7feefc103740 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.482+0000 7feefbfff640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feee40a3240 0x7feee40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:52.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.482+0000 7feefbfff640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feee40a3240 0x7feee40a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feeec000c00 tx=0x7feeec009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:52.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.485+0000 7feef97fa640 1 -- 172.21.15.1:0/3591478279 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feef0017020 con 0x7feefc103740 2024-09-19T09:07:52.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.740+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feefc1a7510 con 0x7feefc103740 2024-09-19T09:07:52.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.740+0000 7feef97fa640 1 -- 172.21.15.1:0/3591478279 <== mon.2 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11887 (secure 0 0 0) 0x7feef009bd70 con 0x7feefc103740 2024-09-19T09:07:52.742 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:07:52.742 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-19T09:07:36:672566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:07:36.432120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:07:52.743 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-19T09:07:52.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feee40a3240 msgr2=0x7feee40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:52.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feee40a3240 0x7feee40a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feeec000c00 tx=0x7feeec009560 comp rx=0 tx=0).stop 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feefc103740 msgr2=0x7feefc100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feefc103740 0x7feefc100f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feef0005fd0 tx=0x7feef000dde0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 shutdown_connections 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7feee40a3240 0x7feee40a5700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feefc108290 0x7feefc101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feefc103740 0x7feefc100f30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 --2- 172.21.15.1:0/3591478279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feefc102d90 0x7feefc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 >> 172.21.15.1:0/3591478279 conn(0x7feefc0fc7d0 msgr2=0x7feefc105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 shutdown_connections 2024-09-19T09:07:52.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:52.743+0000 7fef0289a640 1 -- 172.21.15.1:0/3591478279 wait complete. 2024-09-19T09:07:53.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:07:53.928 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:53 smithi022 ceph-mon[35107]: pgmap v451: 97 pgs: 97 active+clean; 146 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 848 op/s 2024-09-19T09:07:53.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:53 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3591478279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:53 smithi001 ceph-mon[30939]: pgmap v451: 97 pgs: 97 active+clean; 146 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 848 op/s 2024-09-19T09:07:54.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:53 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3591478279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:54.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:53 smithi064 ceph-mon[35179]: pgmap v451: 97 pgs: 97 active+clean; 146 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 848 op/s 2024-09-19T09:07:54.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:53 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3591478279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:07:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 -- 172.21.15.1:0/1768155600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f159410c170 msgr2=0x7f159410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 --2- 172.21.15.1:0/1768155600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f159410c170 0x7f159410e610 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f158c009ca0 tx=0x7f158c02a950 comp rx=0 tx=0).stop 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 -- 172.21.15.1:0/1768155600 shutdown_connections 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 --2- 172.21.15.1:0/1768155600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f159410c170 0x7f159410e610 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 --2- 172.21.15.1:0/1768155600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1594103660 0x7f159410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 --2- 172.21.15.1:0/1768155600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1594102d40 0x7f1594103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 -- 172.21.15.1:0/1768155600 >> 172.21.15.1:0/1768155600 conn(0x7f15940fc7a0 msgr2=0x7f15940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 -- 172.21.15.1:0/1768155600 shutdown_connections 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.421+0000 7f159bacc640 1 -- 172.21.15.1:0/1768155600 wait complete. 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159bacc640 1 Processor -- start 2024-09-19T09:07:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159bacc640 1 -- start start 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159bacc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1594102d40 0x7f15941984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159bacc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1594103660 0x7f15941989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159bacc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f159410c170 0x7f159419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159bacc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1594112070 con 0x7f1594103660 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159bacc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1594111ef0 con 0x7f159410c170 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159bacc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15941121f0 con 0x7f1594102d40 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f1599067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1594103660 0x7f15941989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f1599868640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1594102d40 0x7f15941984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f1599067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1594103660 0x7f15941989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40246/0 (socket says 172.21.15.1:40246) 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f1599868640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1594102d40 0x7f15941984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:39526/0 (socket says 172.21.15.1:39526) 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f1599868640 1 -- 172.21.15.1:0/2733529942 learned_addr learned my addr 172.21.15.1:0/2733529942 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.422+0000 7f159a069640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f159410c170 0x7f159419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f1599868640 1 -- 172.21.15.1:0/2733529942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f159410c170 msgr2=0x7f159419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f1599868640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f159410c170 0x7f159419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f1599868640 1 -- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1594103660 msgr2=0x7f15941989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f1599868640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1594103660 0x7f15941989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f1599868640 1 -- 172.21.15.1:0/2733529942 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159419d460 con 0x7f1594102d40 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f159a069640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f159410c170 0x7f159419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f1599868640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1594102d40 0x7f15941984b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f159000e9f0 tx=0x7f159000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f158affd640 1 -- 172.21.15.1:0/2733529942 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159000cd80 con 0x7f1594102d40 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f158affd640 1 -- 172.21.15.1:0/2733529942 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1590010930 con 0x7f1594102d40 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f159bacc640 1 -- 172.21.15.1:0/2733529942 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159419d750 con 0x7f1594102d40 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f158affd640 1 -- 172.21.15.1:0/2733529942 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590018b00 con 0x7f1594102d40 2024-09-19T09:07:54.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.423+0000 7f159bacc640 1 -- 172.21.15.1:0/2733529942 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15941a5030 con 0x7f1594102d40 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.425+0000 7f158affd640 1 -- 172.21.15.1:0/2733529942 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1590018ca0 con 0x7f1594102d40 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159dea5740 1 Processor -- start 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159dea5740 1 -- start start 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159dea5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee49090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159dea5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 0x557d8ee49a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159dea5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee56760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159dea5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557d8edaf2f0 con 0x557d8ee4ab40 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159dea5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557d8ed56cf0 con 0x557d8ee54370 2024-09-19T09:07:54.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159dea5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557d8edab2b0 con 0x557d8ee495d0 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159a069640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee49090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f1599868640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 0x557d8ee49a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159a069640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee49090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40258/0 (socket says 172.21.15.1:40258) 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f159a069640 1 -- 172.21.15.1:0/3666137908 learned_addr learned my addr 172.21.15.1:0/3666137908 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.426+0000 7f1599067640 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee56760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f158affd640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f15800a3240 0x7f15800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f1599067640 1 -- 172.21.15.1:0/3666137908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 msgr2=0x557d8ee49a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f1599067640 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 0x557d8ee49a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f1599067640 1 -- 172.21.15.1:0/3666137908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 msgr2=0x557d8ee49090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f1599067640 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee49090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f1599067640 1 -- 172.21.15.1:0/3666137908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d8ed3b3a0 con 0x557d8ee54370 2024-09-19T09:07:54.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f159a069640 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee49090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f159a069640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f15800a3240 0x7f15800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f158affd640 1 -- 172.21.15.1:0/2733529942 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f15900cfd50 con 0x7f1594102d40 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f1599067640 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee56760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f158400bb30 tx=0x7f15840103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c3b9bcb09f70a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f157ffff640 1 -- 172.21.15.1:0/3666137908 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584004030 con 0x557d8ee54370 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f157ffff640 1 -- 172.21.15.1:0/3666137908 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15840041d0 con 0x557d8ee54370 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.427+0000 7f157ffff640 1 -- 172.21.15.1:0/3666137908 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840116a0 con 0x557d8ee54370 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 -- 172.21.15.1:0/3666137908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 msgr2=0x557d8ee56760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159a069640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f15800a3240 0x7f15800a5700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f158c02fe50 tx=0x7f158c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee56760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f158400bb30 tx=0x7f15840103d0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 -- 172.21.15.1:0/3666137908 shutdown_connections 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee56760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 0x557d8ee49a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 --2- 172.21.15.1:0/3666137908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee49090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 -- 172.21.15.1:0/3666137908 >> 172.21.15.1:0/3666137908 conn(0x557d8ee12310 msgr2=0x557d8ee45c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 -- 172.21.15.1:0/3666137908 shutdown_connections 2024-09-19T09:07:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.428+0000 7f159dea5740 1 -- 172.21.15.1:0/3666137908 wait complete. 2024-09-19T09:07:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 1 -- start start 2024-09-19T09:07:54.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 1 Processor -- start 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8ee53d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee4ab40 0x557d8ee50fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee54370 0x557d8ee51530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557d8ee57070 con 0x557d8ee54370 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557d8ed6a060 con 0x557d8ee495d0 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557d8ee571f0 con 0x557d8ee4ab40 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159dea5740 10 client.0 _ll_register_callbacks cb 0x557d8eabd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f1599868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8ee53d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f159a069640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee54370 0x557d8ee51530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f1599868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8ee53d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:37078/0 (socket says 172.21.15.1:37078) 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f1599868640 1 -- 172.21.15.1:0/350778133 learned_addr learned my addr 172.21.15.1:0/350778133 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.429+0000 7f1599067640 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee4ab40 0x557d8ee50fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f1599868640 1 -- 172.21.15.1:0/350778133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee4ab40 msgr2=0x557d8ee50fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f1599868640 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee4ab40 0x557d8ee50fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f1599868640 1 -- 172.21.15.1:0/350778133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee54370 msgr2=0x557d8ee51530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f1599868640 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee54370 0x557d8ee51530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f1599868640 1 -- 172.21.15.1:0/350778133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d8eb203c0 con 0x557d8ee495d0 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f1599868640 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8ee53d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1590098800 tx=0x7f159000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d870858524dd5798 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f157d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f157d7fa640 1 -- 172.21.15.1:0/350778133 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159009bd00 con 0x557d8ee495d0 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f159dea5740 1 -- 172.21.15.1:0/350778133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15840041d0 con 0x557d8ee495d0 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f157d7fa640 1 -- 172.21.15.1:0/350778133 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f15900a4ad0 con 0x557d8ee495d0 2024-09-19T09:07:54.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f157d7fa640 1 -- 172.21.15.1:0/350778133 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1590010ce0 con 0x557d8ee495d0 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f159dea5740 10 client.26003 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f159dea5740 1 -- 172.21.15.1:0/350778133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d8ee62b80 con 0x557d8ee495d0 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f157d7fa640 1 -- 172.21.15.1:0/350778133 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15840041d0 con 0x557d8ee495d0 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f157d7fa640 1 -- 172.21.15.1:0/350778133 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f159009b7f0 con 0x557d8ee495d0 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f159dea5740 10 client.26003 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.430+0000 7f159dea5740 10 client.26003 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.431+0000 7f159dea5740 20 client.26003 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.431+0000 7f159dea5740 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x557d8ee63f90 0x557d8ee663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.431+0000 7f159dea5740 4 client.26003 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.431+0000 7f159dea5740 1 -- 172.21.15.1:0/350778133 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d8edbc860 con 0x557d8ee63f90 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.431+0000 7f1599067640 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x557d8ee63f90 0x557d8ee663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.431+0000 7f1599067640 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x557d8ee63f90 0x557d8ee663a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d6d566c54d6dd7a server_cookie=a707436e7f9dc1f6 in_seq=0 out_seq=0 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.431+0000 7f157d7fa640 10 client.26003 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:07:54.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f157d7fa640 1 -- 172.21.15.1:0/350778133 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d8edbc860 con 0x557d8ee63f90 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f157d7fa640 10 client.26003 handle_command_reply: tid=0 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 client.26003 shutdown 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 -- 172.21.15.1:0/350778133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 msgr2=0x557d8ee53d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8ee53d00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1590098800 tx=0x7f159000cf20 comp rx=0 tx=0).stop 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 -- 172.21.15.1:0/350778133 shutdown_connections 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x557d8ee63f90 0x557d8ee663a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee54370 0x557d8ee51530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee4ab40 0x557d8ee50fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 --2- 172.21.15.1:0/350778133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8ee53d00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f157d7fa640 0 client.26003 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 -- 172.21.15.1:0/350778133 >> 172.21.15.1:0/350778133 conn(0x557d8ee12310 msgr2=0x557d8ee4b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 -- 172.21.15.1:0/350778133 shutdown_connections 2024-09-19T09:07:54.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 1 -- 172.21.15.1:0/350778133 wait complete. 2024-09-19T09:07:54.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.432+0000 7f159dea5740 20 client.26003 trim_cache size 0 max 16384 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.445+0000 7f159dea5740 1 Processor -- start 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f159dea5740 1 -- start start 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f159dea5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 0x557d8ee45e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f159dea5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee60340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f159dea5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee5c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f159dea5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f15941b0090 con 0x557d8ee4ab40 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f159dea5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15941ad8a0 con 0x557d8ee54370 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f159dea5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15941ab6f0 con 0x557d8ee495d0 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee60340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee60340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40276/0 (socket says 172.21.15.1:40276) 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 -- 172.21.15.1:0/3063193454 learned_addr learned my addr 172.21.15.1:0/3063193454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599868640 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 0x557d8ee45e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f159a069640 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee5c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 -- 172.21.15.1:0/3063193454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 msgr2=0x557d8ee45e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 0x557d8ee45e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 -- 172.21.15.1:0/3063193454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 msgr2=0x557d8ee5c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee5c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 -- 172.21.15.1:0/3063193454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d8ee4f500 con 0x557d8ee4ab40 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.446+0000 7f1599067640 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee60340 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f158400bb30 tx=0x7f1584003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb839d752dbc6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f157f7fe640 1 -- 172.21.15.1:0/3063193454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584004100 con 0x557d8ee4ab40 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f157f7fe640 1 -- 172.21.15.1:0/3063193454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f158402d070 con 0x557d8ee4ab40 2024-09-19T09:07:54.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f157f7fe640 1 -- 172.21.15.1:0/3063193454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584004540 con 0x557d8ee4ab40 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 -- 172.21.15.1:0/3063193454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 msgr2=0x557d8ee60340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee60340 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f158400bb30 tx=0x7f1584003e50 comp rx=0 tx=0).stop 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 -- 172.21.15.1:0/3063193454 shutdown_connections 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee54370 0x557d8ee5c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8ee60340 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 --2- 172.21.15.1:0/3063193454 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee495d0 0x557d8ee45e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 -- 172.21.15.1:0/3063193454 >> 172.21.15.1:0/3063193454 conn(0x557d8ee12310 msgr2=0x557d8ee45700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 -- 172.21.15.1:0/3063193454 shutdown_connections 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.447+0000 7f159dea5740 1 -- 172.21.15.1:0/3063193454 wait complete. 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 1 -- start start 2024-09-19T09:07:54.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 1 Processor -- start 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8eecbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8eecc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee54370 0x557d8eec6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f15941abd60 con 0x557d8ee4ab40 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15941ad1d0 con 0x557d8ee495d0 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f15941ac430 con 0x557d8ee54370 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159dea5740 10 client.0 _ll_register_callbacks cb 0x7f159000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f1599067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8eecc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f1599868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8eecbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f1599067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8eecc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40284/0 (socket says 172.21.15.1:40284) 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f1599067640 1 -- 172.21.15.1:0/1049197647 learned_addr learned my addr 172.21.15.1:0/1049197647 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.448+0000 7f159a069640 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee54370 0x557d8eec6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f1599868640 1 -- 172.21.15.1:0/1049197647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee54370 msgr2=0x557d8eec6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f1599868640 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee54370 0x557d8eec6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f1599868640 1 -- 172.21.15.1:0/1049197647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 msgr2=0x557d8eecc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f1599868640 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8eecc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f1599868640 1 -- 172.21.15.1:0/1049197647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d8eec73e0 con 0x557d8ee495d0 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f1599067640 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8eecc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f1599868640 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8eecbf70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1590000c00 tx=0x7f1590009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a043799ddabf719b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f157d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f157d7fa640 1 -- 172.21.15.1:0/1049197647 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159009bd00 con 0x557d8ee495d0 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f157d7fa640 1 -- 172.21.15.1:0/1049197647 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f15900b51b0 con 0x557d8ee495d0 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f159dea5740 1 -- 172.21.15.1:0/1049197647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f158402d070 con 0x557d8ee495d0 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f157d7fa640 1 -- 172.21.15.1:0/1049197647 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f159009c170 con 0x557d8ee495d0 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f159dea5740 10 client.26009 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f159dea5740 1 -- 172.21.15.1:0/1049197647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d8eed37a0 con 0x557d8ee495d0 2024-09-19T09:07:54.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.449+0000 7f157d7fa640 1 -- 172.21.15.1:0/1049197647 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f158402d070 con 0x557d8ee495d0 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.450+0000 7f157d7fa640 1 -- 172.21.15.1:0/1049197647 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f15900a0100 con 0x557d8ee495d0 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.450+0000 7f159dea5740 10 client.26009 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.450+0000 7f159dea5740 10 client.26009 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.450+0000 7f159dea5740 20 client.26009 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.450+0000 7f159dea5740 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x557d8eed3f20 0x557d8eed6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.450+0000 7f159dea5740 4 client.26009 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.450+0000 7f159dea5740 1 -- 172.21.15.1:0/1049197647 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d8edb6d70 con 0x557d8eed3f20 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.450+0000 7f1599067640 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x557d8eed3f20 0x557d8eed6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f1599067640 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x557d8eed3f20 0x557d8eed6340 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f9bd0c65ee04ef4 server_cookie=1b87ba93e9b608ac in_seq=0 out_seq=0 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f157d7fa640 10 client.26009 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f157d7fa640 1 -- 172.21.15.1:0/1049197647 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d8edb6d70 con 0x557d8eed3f20 2024-09-19T09:07:54.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f157d7fa640 10 client.26009 handle_command_reply: tid=0 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 client.26009 shutdown 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 -- 172.21.15.1:0/1049197647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 msgr2=0x557d8eecbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8eecbf70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1590000c00 tx=0x7f1590009700 comp rx=0 tx=0).stop 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 -- 172.21.15.1:0/1049197647 shutdown_connections 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x557d8eed3f20 0x557d8eed6340 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557d8ee54370 0x557d8eec6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557d8ee4ab40 0x557d8eecc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 --2- 172.21.15.1:0/1049197647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d8ee495d0 0x557d8eecbf70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f157d7fa640 0 client.26009 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 -- 172.21.15.1:0/1049197647 >> 172.21.15.1:0/1049197647 conn(0x557d8ee12310 msgr2=0x557d8ee444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 -- 172.21.15.1:0/1049197647 shutdown_connections 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 1 -- 172.21.15.1:0/1049197647 wait complete. 2024-09-19T09:07:54.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.451+0000 7f159dea5740 20 client.26009 trim_cache size 0 max 16384 2024-09-19T09:07:54.458 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:07:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 -- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f15800a3240 msgr2=0x7f15800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f15800a3240 0x7f15800a5700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f158c02fe50 tx=0x7f158c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 -- 172.21.15.1:0/2733529942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1594102d40 msgr2=0x7f15941984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1594102d40 0x7f15941984b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f159000e9f0 tx=0x7f159000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 -- 172.21.15.1:0/2733529942 shutdown_connections 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f159410c170 0x7f159419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1594103660 0x7f15941989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f15800a3240 0x7f15800a5700 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 --2- 172.21.15.1:0/2733529942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1594102d40 0x7f15941984b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 -- 172.21.15.1:0/2733529942 >> 172.21.15.1:0/2733529942 conn(0x7f15940fc7a0 msgr2=0x7f15940fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 -- 172.21.15.1:0/2733529942 shutdown_connections 2024-09-19T09:07:54.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:54.452+0000 7f159bacc640 1 -- 172.21.15.1:0/2733529942 wait complete. 2024-09-19T09:07:55.301 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:07:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2891605969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0102610 msgr2=0x7fa8f0104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2891605969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0102610 0x7fa8f0104a00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009900 tx=0x7fa8e002a410 comp rx=0 tx=0).stop 2024-09-19T09:07:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2891605969 shutdown_connections 2024-09-19T09:07:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2891605969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8f0107870 0x7fa8f0109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2891605969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f0104f40 0x7fa8f0107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2891605969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0102610 0x7fa8f0104a00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2891605969 >> 172.21.15.1:0/2891605969 conn(0x7fa8f00fc190 msgr2=0x7fa8f00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2891605969 shutdown_connections 2024-09-19T09:07:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2891605969 wait complete. 2024-09-19T09:07:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 Processor -- start 2024-09-19T09:07:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.443+0000 7fa8f4c9b640 1 -- start start 2024-09-19T09:07:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8f4c9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8f0102610 0x7fa8f0197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8f4c9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0104f40 0x7fa8f01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8f4c9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f0107870 0x7fa8f019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8f4c9b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f010d940 con 0x7fa8f0104f40 2024-09-19T09:07:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8f4c9b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f010d7c0 con 0x7fa8f0107870 2024-09-19T09:07:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8f4c9b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f010dac0 con 0x7fa8f0102610 2024-09-19T09:07:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8edd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0104f40 0x7fa8f01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8f0102610 0x7fa8f0197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8f0102610 0x7fa8f0197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:39586/0 (socket says 172.21.15.1:39586) 2024-09-19T09:07:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8eed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f0107870 0x7fa8f019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 -- 172.21.15.1:0/2912236120 learned_addr learned my addr 172.21.15.1:0/2912236120 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8edd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0104f40 0x7fa8f01984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40302/0 (socket says 172.21.15.1:40302) 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 -- 172.21.15.1:0/2912236120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f0107870 msgr2=0x7fa8f019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f0107870 0x7fa8f019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 -- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0104f40 msgr2=0x7fa8f01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0104f40 0x7fa8f01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 -- 172.21.15.1:0/2912236120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f019fb90 con 0x7fa8f0102610 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.444+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8f0102610 0x7fa8f0197f70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009a20 tx=0x7fa8e00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.445+0000 7fa8df7fe640 1 -- 172.21.15.1:0/2912236120 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e003f030 con 0x7fa8f0102610 2024-09-19T09:07:55.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.445+0000 7fa8df7fe640 1 -- 172.21.15.1:0/2912236120 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8e0003d00 con 0x7fa8f0102610 2024-09-19T09:07:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.445+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2912236120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f019fe20 con 0x7fa8f0102610 2024-09-19T09:07:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.445+0000 7fa8df7fe640 1 -- 172.21.15.1:0/2912236120 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0035070 con 0x7fa8f0102610 2024-09-19T09:07:55.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.445+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2912236120 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f01a0230 con 0x7fa8f0102610 2024-09-19T09:07:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.447+0000 7fa8df7fe640 1 -- 172.21.15.1:0/2912236120 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fa8e0042030 con 0x7fa8f0102610 2024-09-19T09:07:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.447+0000 7fa8f7a34740 1 Processor -- start 2024-09-19T09:07:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.447+0000 7fa8f7a34740 1 -- start start 2024-09-19T09:07:55.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ef370 0x5644e96f1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5644e964d2f0 con 0x5644e96ea2e0 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644e95f5270 con 0x5644e96ef370 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5644e96492b0 con 0x5644e96e99a0 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8ee59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ef370 0x5644e96f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ef370 0x5644e96f1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:37140/0 (socket says 172.21.15.1:37140) 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 -- 172.21.15.1:0/386399417 learned_addr learned my addr 172.21.15.1:0/386399417 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8df7fe640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8d80a3240 0x7fa8d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8d80a3240 0x7fa8d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 -- 172.21.15.1:0/386399417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 msgr2=0x5644e96e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 -- 172.21.15.1:0/386399417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 msgr2=0x5644e96eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 -- 172.21.15.1:0/386399417 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644e95f4340 con 0x5644e96ef370 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8df7fe640 1 -- 172.21.15.1:0/2912236120 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa8e00efe30 con 0x7fa8f0102610 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.448+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ef370 0x5644e96f1830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009c60 tx=0x7fa8e4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72bd3b378002427b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8d80a3240 0x7fa8d80a5700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8005c40 tx=0x7fa8e8004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8dcff9640 1 -- 172.21.15.1:0/386399417 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4004230 con 0x5644e96ef370 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8dcff9640 1 -- 172.21.15.1:0/386399417 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8e4009e10 con 0x5644e96ef370 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8dcff9640 1 -- 172.21.15.1:0/386399417 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40198e0 con 0x5644e96ef370 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8f7a34740 1 -- 172.21.15.1:0/386399417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ef370 msgr2=0x5644e96f1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ef370 0x5644e96f1830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009c60 tx=0x7fa8e4011810 comp rx=0 tx=0).stop 2024-09-19T09:07:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8f7a34740 1 -- 172.21.15.1:0/386399417 shutdown_connections 2024-09-19T09:07:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ef370 0x5644e96f1830 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/386399417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.449+0000 7fa8f7a34740 1 -- 172.21.15.1:0/386399417 >> 172.21.15.1:0/386399417 conn(0x5644e96e5010 msgr2=0x5644e96e5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 -- 172.21.15.1:0/386399417 shutdown_connections 2024-09-19T09:07:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 -- 172.21.15.1:0/386399417 wait complete. 2024-09-19T09:07:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 -- start start 2024-09-19T09:07:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 Processor -- start 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ef370 0x5644e96fb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5644e96f2340 con 0x5644e96ef370 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5644e95d6290 con 0x5644e96ea2e0 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5644e96f24c0 con 0x5644e96e99a0 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8f7a34740 10 client.0 _ll_register_callbacks cb 0x5644e9607140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8eed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ef370 0x5644e96fb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8eed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ef370 0x5644e96fb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40308/0 (socket says 172.21.15.1:40308) 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8eed9d640 1 -- 172.21.15.1:0/3578995079 learned_addr learned my addr 172.21.15.1:0/3578995079 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.450+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8eed9d640 1 -- 172.21.15.1:0/3578995079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 msgr2=0x5644e96f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8eed9d640 1 -- 172.21.15.1:0/3578995079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 msgr2=0x5644e96f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8eed9d640 1 -- 172.21.15.1:0/3578995079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644e9360210 con 0x5644e96ef370 2024-09-19T09:07:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ef370 0x5644e96fb150 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8003cc0 tx=0x7fa8e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b58331c09a77e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/3578995079 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8025070 con 0x5644e96ef370 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/3578995079 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa8e80047d0 con 0x5644e96ef370 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8f7a34740 1 -- 172.21.15.1:0/3578995079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8e4009e10 con 0x5644e96ef370 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/3578995079 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa8e8031050 con 0x5644e96ef370 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8f7a34740 10 client.16533 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8f7a34740 1 -- 172.21.15.1:0/3578995079 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5644e942c620 con 0x5644e96ef370 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.451+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/3578995079 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8e4009e10 con 0x5644e96ef370 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/3578995079 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa8e801f040 con 0x5644e96ef370 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8f7a34740 10 client.16533 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8f7a34740 10 client.16533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8f7a34740 20 client.16533 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5644e96ff980 0x5644e9701d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8f7a34740 4 client.16533 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8f7a34740 1 -- 172.21.15.1:0/3578995079 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644e965aa20 con 0x5644e96ff980 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5644e96ff980 0x5644e9701d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5644e96ff980 0x5644e9701d70 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73b7e2268be2d192 server_cookie=2ec0fad64424b71d in_seq=0 out_seq=0 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.452+0000 7fa8d5ffb640 10 client.16533 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/3578995079 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644e965aa20 con 0x5644e96ff980 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8d5ffb640 10 client.16533 handle_command_reply: tid=0 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 client.16533 shutdown 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 -- 172.21.15.1:0/3578995079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ef370 msgr2=0x5644e96fb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ef370 0x5644e96fb150 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8003cc0 tx=0x7fa8e8004a40 comp rx=0 tx=0).stop 2024-09-19T09:07:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 -- 172.21.15.1:0/3578995079 shutdown_connections 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5644e96ff980 0x5644e9701d70 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ef370 0x5644e96fb150 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/3578995079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96e99a0 0x5644e96f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 -- 172.21.15.1:0/3578995079 >> 172.21.15.1:0/3578995079 conn(0x5644e96e5010 msgr2=0x5644e96e6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8d5ffb640 0 client.16533 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 -- 172.21.15.1:0/3578995079 shutdown_connections 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 1 -- 172.21.15.1:0/3578995079 wait complete. 2024-09-19T09:07:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.453+0000 7fa8f7a34740 20 client.16533 trim_cache size 0 max 16384 2024-09-19T09:07:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8f7a34740 1 Processor -- start 2024-09-19T09:07:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8f7a34740 1 -- start start 2024-09-19T09:07:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96e99a0 0x5644e96e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96fb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 0x5644e96e6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f01abac0 con 0x5644e96ea2e0 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f01a92d0 con 0x5644e96e99a0 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f01a7120 con 0x5644e96ef370 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8edd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8edd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96fb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40316/0 (socket says 172.21.15.1:40316) 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8edd9b640 1 -- 172.21.15.1:0/1149800181 learned_addr learned my addr 172.21.15.1:0/1149800181 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96e99a0 0x5644e96e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 0x5644e96e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8edd9b640 1 -- 172.21.15.1:0/1149800181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 msgr2=0x5644e96e6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 0x5644e96e6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8edd9b640 1 -- 172.21.15.1:0/1149800181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96e99a0 msgr2=0x5644e96e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96e99a0 0x5644e96e5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8edd9b640 1 -- 172.21.15.1:0/1149800181 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644e96f2600 con 0x5644e96ea2e0 2024-09-19T09:07:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.484+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96e99a0 0x5644e96e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.485+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96fb110 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009c60 tx=0x7fa8e40193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7654794f6e8394f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.485+0000 7fa8d7fff640 1 -- 172.21.15.1:0/1149800181 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e401f040 con 0x5644e96ea2e0 2024-09-19T09:07:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.485+0000 7fa8d7fff640 1 -- 172.21.15.1:0/1149800181 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8e402a070 con 0x5644e96ea2e0 2024-09-19T09:07:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.485+0000 7fa8d7fff640 1 -- 172.21.15.1:0/1149800181 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4019590 con 0x5644e96ea2e0 2024-09-19T09:07:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.485+0000 7fa8f7a34740 1 -- 172.21.15.1:0/1149800181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 msgr2=0x5644e96fb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.485+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96fb110 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009c60 tx=0x7fa8e40193e0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 -- 172.21.15.1:0/1149800181 shutdown_connections 2024-09-19T09:07:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 0x5644e96e6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96ea2e0 0x5644e96fb110 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/1149800181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96e99a0 0x5644e96e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 -- 172.21.15.1:0/1149800181 >> 172.21.15.1:0/1149800181 conn(0x5644e96e5010 msgr2=0x5644e97016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 -- 172.21.15.1:0/1149800181 shutdown_connections 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 -- 172.21.15.1:0/1149800181 wait complete. 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 -- start start 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 Processor -- start 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96e99a0 0x5644e96f8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 0x5644e96f9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f01a7790 con 0x5644e96e99a0 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f01a8c00 con 0x5644e96ea2e0 2024-09-19T09:07:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.486+0000 7fa8f7a34740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f01a7e60 con 0x5644e96ef370 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8f7a34740 10 client.0 _ll_register_callbacks cb 0x7fa8e8009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96e99a0 0x5644e96f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96e99a0 0x5644e96f8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40328/0 (socket says 172.21.15.1:40328) 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 -- 172.21.15.1:0/4170086124 learned_addr learned my addr 172.21.15.1:0/4170086124 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8eed9d640 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 0x5644e96f9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 -- 172.21.15.1:0/4170086124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 msgr2=0x5644e96f9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 0x5644e96f9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 -- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 msgr2=0x5644e96f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 -- 172.21.15.1:0/4170086124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644e96e02d0 con 0x5644e96e99a0 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8ee59c640 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96e99a0 0x5644e96f8810 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00edc80 tx=0x7fa8e003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2c1d79e1d95636 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/4170086124 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0049040 con 0x5644e96e99a0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/4170086124 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa8e003bd00 con 0x5644e96e99a0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8f7a34740 1 -- 172.21.15.1:0/4170086124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8e402a070 con 0x5644e96e99a0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/4170086124 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa8e00bc2b0 con 0x5644e96e99a0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8f7a34740 10 client.16539 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.487+0000 7fa8f7a34740 1 -- 172.21.15.1:0/4170086124 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5644e976a650 con 0x5644e96e99a0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/4170086124 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8e402a070 con 0x5644e96e99a0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/4170086124 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa8e00d51f0 con 0x5644e96e99a0 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8f7a34740 10 client.16539 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8f7a34740 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8f7a34740 20 client.16539 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5644e976abc0 0x5644e976cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8f7a34740 4 client.16539 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:07:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8f7a34740 1 -- 172.21.15.1:0/4170086124 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5644e9654d70 con 0x5644e976abc0 2024-09-19T09:07:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5644e976abc0 0x5644e976cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8edd9b640 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5644e976abc0 0x5644e976cfd0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f34c8d56808a60f server_cookie=9d21e764c537feeb in_seq=0 out_seq=0 2024-09-19T09:07:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.488+0000 7fa8d5ffb640 10 client.16539 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:55.623 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.708+0000 7fa8d5ffb640 1 -- 172.21.15.1:0/4170086124 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5644e9654d70 con 0x5644e976abc0 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.708+0000 7fa8d5ffb640 10 client.16539 handle_command_reply: tid=0 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.708+0000 7fa8f7a34740 1 client.16539 shutdown 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.708+0000 7fa8f7a34740 1 -- 172.21.15.1:0/4170086124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96e99a0 msgr2=0x5644e96f8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.708+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96e99a0 0x5644e96f8810 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00edc80 tx=0x7fa8e003e000 comp rx=0 tx=0).stop 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 1 -- 172.21.15.1:0/4170086124 shutdown_connections 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5644e976abc0 0x5644e976cfd0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5644e96ef370 0x5644e96f9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8d5ffb640 0 client.16539 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5644e96ea2e0 0x5644e96f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 1 --2- 172.21.15.1:0/4170086124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644e96e99a0 0x5644e96f8810 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 1 -- 172.21.15.1:0/4170086124 >> 172.21.15.1:0/4170086124 conn(0x5644e96e5010 msgr2=0x5644e96e39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 1 -- 172.21.15.1:0/4170086124 shutdown_connections 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 1 -- 172.21.15.1:0/4170086124 wait complete. 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f7a34740 20 client.16539 trim_cache size 0 max 16384 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:07:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:07:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8d80a3240 msgr2=0x7fa8d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8d80a3240 0x7fa8d80a5700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8005c40 tx=0x7fa8e8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2912236120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8f0102610 msgr2=0x7fa8f0197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8f0102610 0x7fa8f0197f70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009a20 tx=0x7fa8e00042f0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2912236120 shutdown_connections 2024-09-19T09:07:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8f0107870 0x7fa8f019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f0104f40 0x7fa8f01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fa8d80a3240 0x7fa8d80a5700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 --2- 172.21.15.1:0/2912236120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa8f0102610 0x7fa8f0197f70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.709+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2912236120 >> 172.21.15.1:0/2912236120 conn(0x7fa8f00fc190 msgr2=0x7fa8f0102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.710+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2912236120 shutdown_connections 2024-09-19T09:07:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:07:55.710+0000 7fa8f4c9b640 1 -- 172.21.15.1:0/2912236120 wait complete. 2024-09-19T09:07:55.958 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:55 smithi001 ceph-mon[30939]: pgmap v452: 97 pgs: 97 active+clean; 81 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 951 op/s 2024-09-19T09:07:55.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:55 smithi022 ceph-mon[35107]: pgmap v452: 97 pgs: 97 active+clean; 81 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 951 op/s 2024-09-19T09:07:56.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:55 smithi064 ceph-mon[35179]: pgmap v452: 97 pgs: 97 active+clean; 81 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 951 op/s 2024-09-19T09:07:56.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.168+0000 7f660559a640 1 -- 172.21.15.1:0/1797775130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc031a00 con 0x7f6608108e00 2024-09-19T09:07:56.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 -- 172.21.15.1:0/1797775130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6608108e00 msgr2=0x7f660810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 --2- 172.21.15.1:0/1797775130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6608108e00 0x7f660810ce00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009900 tx=0x7f65fc02a410 comp rx=0 tx=0).stop 2024-09-19T09:07:56.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 -- 172.21.15.1:0/1797775130 shutdown_connections 2024-09-19T09:07:56.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 --2- 172.21.15.1:0/1797775130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660810d530 0x7f66081150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 --2- 172.21.15.1:0/1797775130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6608108e00 0x7f660810ce00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 --2- 172.21.15.1:0/1797775130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6608108450 0x7f6608108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 -- 172.21.15.1:0/1797775130 >> 172.21.15.1:0/1797775130 conn(0x7f6608077ba0 msgr2=0x7f6608079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 -- 172.21.15.1:0/1797775130 shutdown_connections 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.169+0000 7f660c8d4640 1 -- 172.21.15.1:0/1797775130 wait complete. 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.170+0000 7f660c8d4640 1 Processor -- start 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.170+0000 7f660c8d4640 1 -- start start 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f660c8d4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6608108450 0x7f660819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f660c8d4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6608108e00 0x7f660819f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f660c8d4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660810d530 0x7f66081a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f660c8d4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f66081186b0 con 0x7f6608108450 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f660c8d4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6608118530 con 0x7f6608108e00 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f660c8d4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6608118830 con 0x7f660810d530 2024-09-19T09:07:56.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f6606d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660810d530 0x7f66081a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f6606d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660810d530 0x7f66081a3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:39634/0 (socket says 172.21.15.1:39634) 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f6606d9d640 1 -- 172.21.15.1:0/56283841 learned_addr learned my addr 172.21.15.1:0/56283841 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.171+0000 7f660659c640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6608108450 0x7f660819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f6606d9d640 1 -- 172.21.15.1:0/56283841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6608108e00 msgr2=0x7f660819f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f6606d9d640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6608108e00 0x7f660819f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f6606d9d640 1 -- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6608108450 msgr2=0x7f660819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f6606d9d640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6608108450 0x7f660819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f6606d9d640 1 -- 172.21.15.1:0/56283841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66081a3bc0 con 0x7f660810d530 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f6606d9d640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660810d530 0x7f66081a3490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f660000ea60 tx=0x7f660000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f65f77fe640 1 -- 172.21.15.1:0/56283841 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660000ce40 con 0x7f660810d530 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f65f77fe640 1 -- 172.21.15.1:0/56283841 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6600004b20 con 0x7f660810d530 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f65f77fe640 1 -- 172.21.15.1:0/56283841 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600010740 con 0x7f660810d530 2024-09-19T09:07:56.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.172+0000 7f660c8d4640 1 -- 172.21.15.1:0/56283841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66081a3eb0 con 0x7f660810d530 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.173+0000 7f660c8d4640 1 -- 172.21.15.1:0/56283841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66081ab740 con 0x7f660810d530 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.176+0000 7f65f77fe640 1 -- 172.21.15.1:0/56283841 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f6600004cd0 con 0x7f660810d530 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.176+0000 7f660ecad740 1 Processor -- start 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.177+0000 7f660ecad740 1 -- start start 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.177+0000 7f660ecad740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.177+0000 7f660ecad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.177+0000 7f660ecad740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 0x55a4a47dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.177+0000 7f660ecad740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4a47352f0 con 0x55a4a47da370 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.177+0000 7f660ecad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4a46dccf0 con 0x55a4a47cf5d0 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.177+0000 7f660ecad740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a4a47312b0 con 0x55a4a47d0b40 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.177+0000 7f65f77fe640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f65f00a3240 0x7f65f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:39636/0 (socket says 172.21.15.1:39636) 2024-09-19T09:07:56.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 -- 172.21.15.1:0/3059392434 learned_addr learned my addr 172.21.15.1:0/3059392434 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f65f77fe640 1 -- 172.21.15.1:0/56283841 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f66000cfe00 con 0x7f660810d530 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6606d9d640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f65f00a3240 0x7f65f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 --2- 172.21.15.1:0/3059392434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 0x55a4a47dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 -- 172.21.15.1:0/3059392434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 msgr2=0x55a4a47cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 --2- 172.21.15.1:0/3059392434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 -- 172.21.15.1:0/3059392434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 msgr2=0x55a4a47dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 --2- 172.21.15.1:0/3059392434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 0x55a4a47dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6605d9b640 1 -- 172.21.15.1:0/3059392434 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a46c13a0 con 0x55a4a47d0b40 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.178+0000 7f6606d9d640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f65f00a3240 0x7f65f00a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f660000c760 tx=0x7f66000bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.179+0000 7f6605d9b640 1 --2- 172.21.15.1:0/3059392434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47cf090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f65fc005ab0 tx=0x7f65fc005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bedf8e6992d44a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.180+0000 7f65f4ff9640 1 -- 172.21.15.1:0/3059392434 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc044070 con 0x55a4a47d0b40 2024-09-19T09:07:56.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.180+0000 7f65f4ff9640 1 -- 172.21.15.1:0/3059392434 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65fc0319c0 con 0x55a4a47d0b40 2024-09-19T09:07:56.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.180+0000 7f65f4ff9640 1 -- 172.21.15.1:0/3059392434 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc035030 con 0x55a4a47d0b40 2024-09-19T09:07:56.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.181+0000 7f660ecad740 1 -- 172.21.15.1:0/3059392434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 msgr2=0x55a4a47cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.181+0000 7f660ecad740 1 --2- 172.21.15.1:0/3059392434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47cf090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f65fc005ab0 tx=0x7f65fc005a20 comp rx=0 tx=0).stop 2024-09-19T09:07:56.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.181+0000 7f660ecad740 1 -- 172.21.15.1:0/3059392434 shutdown_connections 2024-09-19T09:07:56.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.181+0000 7f660ecad740 1 --2- 172.21.15.1:0/3059392434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 0x55a4a47dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.181+0000 7f660ecad740 1 --2- 172.21.15.1:0/3059392434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.181+0000 7f660ecad740 1 --2- 172.21.15.1:0/3059392434 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47cf090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.181+0000 7f660ecad740 1 -- 172.21.15.1:0/3059392434 >> 172.21.15.1:0/3059392434 conn(0x55a4a4798310 msgr2=0x55a4a47cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.182+0000 7f660ecad740 1 -- 172.21.15.1:0/3059392434 shutdown_connections 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.182+0000 7f660ecad740 1 -- 172.21.15.1:0/3059392434 wait complete. 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 1 -- start start 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 1 Processor -- start 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47d0b40 0x55a4a47d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47da370 0x55a4a47d7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4a47dd0b0 con 0x55a4a47cf5d0 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4a46f0060 con 0x55a4a47d0b40 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a4a47dd230 con 0x55a4a47da370 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.183+0000 7f660ecad740 10 client.0 _ll_register_callbacks cb 0x55a4a44438c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:56.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.184+0000 7f6605d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.184+0000 7f6605d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40352/0 (socket says 172.21.15.1:40352) 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.184+0000 7f6605d9b640 1 -- 172.21.15.1:0/553113848 learned_addr learned my addr 172.21.15.1:0/553113848 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.184+0000 7f6605d9b640 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47da370 0x55a4a47d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.184+0000 7f660659c640 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47d0b40 0x55a4a47d6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f660659c640 1 -- 172.21.15.1:0/553113848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47da370 msgr2=0x55a4a47d7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f660659c640 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47da370 0x55a4a47d7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f660659c640 1 -- 172.21.15.1:0/553113848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 msgr2=0x55a4a47d9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f660659c640 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f660659c640 1 -- 172.21.15.1:0/553113848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a44a63c0 con 0x55a4a47d0b40 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f660659c640 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47d0b40 0x55a4a47d6fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65f800bd90 tx=0x7f65f80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d2005ab4e29cc32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f65edffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f65edffb640 1 -- 172.21.15.1:0/553113848 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8004230 con 0x55a4a47d0b40 2024-09-19T09:07:56.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f65edffb640 1 -- 172.21.15.1:0/553113848 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f65f80043d0 con 0x55a4a47d0b40 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.185+0000 7f660ecad740 1 -- 172.21.15.1:0/553113848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc0319c0 con 0x55a4a47d0b40 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.186+0000 7f65edffb640 1 -- 172.21.15.1:0/553113848 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65f80035f0 con 0x55a4a47d0b40 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.186+0000 7f660ecad740 10 client.26033 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.186+0000 7f660ecad740 1 -- 172.21.15.1:0/553113848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a4a47e8bb0 con 0x55a4a47d0b40 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.186+0000 7f65edffb640 1 -- 172.21.15.1:0/553113848 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65fc0319c0 con 0x55a4a47d0b40 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.187+0000 7f65edffb640 1 -- 172.21.15.1:0/553113848 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f65f8011aa0 con 0x55a4a47d0b40 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.187+0000 7f660ecad740 10 client.26033 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.187+0000 7f660ecad740 10 client.26033 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.187+0000 7f660ecad740 20 client.26033 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.187+0000 7f660ecad740 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4a47ea110 0x55a4a47ec530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.187+0000 7f660ecad740 4 client.26033 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.187+0000 7f660ecad740 1 -- 172.21.15.1:0/553113848 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4a4742860 con 0x55a4a47ea110 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.187+0000 7f6605d9b640 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4a47ea110 0x55a4a47ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.188+0000 7f6605d9b640 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4a47ea110 0x55a4a47ec530 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5ffb8d2b782d1fe server_cookie=2a1dbcdee43f63f6 in_seq=0 out_seq=0 2024-09-19T09:07:56.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.188+0000 7f65edffb640 10 client.26033 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f65edffb640 1 -- 172.21.15.1:0/553113848 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4a4742860 con 0x55a4a47ea110 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f65edffb640 10 client.26033 handle_command_reply: tid=0 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 client.26033 shutdown 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 -- 172.21.15.1:0/553113848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47d0b40 msgr2=0x55a4a47d6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47d0b40 0x55a4a47d6fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f65f800bd90 tx=0x7f65f80107a0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 -- 172.21.15.1:0/553113848 shutdown_connections 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4a47ea110 0x55a4a47ec530 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47da370 0x55a4a47d7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47d0b40 0x55a4a47d6fd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 --2- 172.21.15.1:0/553113848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f660ecad740 1 -- 172.21.15.1:0/553113848 >> 172.21.15.1:0/553113848 conn(0x55a4a4798310 msgr2=0x55a4a47d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:56.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.189+0000 7f65edffb640 0 client.26033 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:07:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.190+0000 7f660ecad740 1 -- 172.21.15.1:0/553113848 shutdown_connections 2024-09-19T09:07:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.190+0000 7f660ecad740 1 -- 172.21.15.1:0/553113848 wait complete. 2024-09-19T09:07:56.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.190+0000 7f660ecad740 20 client.26033 trim_cache size 0 max 16384 2024-09-19T09:07:56.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.215+0000 7f660ecad740 1 Processor -- start 2024-09-19T09:07:56.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.215+0000 7f660ecad740 1 -- start start 2024-09-19T09:07:56.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f660ecad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f660ecad740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f660ecad740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 0x55a4a47d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f660ecad740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b6640 con 0x55a4a47da370 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f660ecad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b3e50 con 0x55a4a47cf5d0 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f660ecad740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b1ca0 con 0x55a4a47d0b40 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f660659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f6605d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f6605d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:37224/0 (socket says 172.21.15.1:37224) 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f6605d9b640 1 -- 172.21.15.1:0/3902759465 learned_addr learned my addr 172.21.15.1:0/3902759465 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.216+0000 7f6605d9b640 1 --2- 172.21.15.1:0/3902759465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 0x55a4a47d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.217+0000 7f6605d9b640 1 -- 172.21.15.1:0/3902759465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 msgr2=0x55a4a47d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.217+0000 7f6605d9b640 1 --2- 172.21.15.1:0/3902759465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.217+0000 7f6605d9b640 1 -- 172.21.15.1:0/3902759465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 msgr2=0x55a4a47d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.217+0000 7f6605d9b640 1 --2- 172.21.15.1:0/3902759465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 0x55a4a47d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.217+0000 7f6605d9b640 1 -- 172.21.15.1:0/3902759465 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a47d2ba0 con 0x55a4a47cf5d0 2024-09-19T09:07:56.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.217+0000 7f6605d9b640 1 --2- 172.21.15.1:0/3902759465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d8f40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65fc005ab0 tx=0x7f65fc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b436b36c15a2e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:56.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.218+0000 7f65effff640 1 -- 172.21.15.1:0/3902759465 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc044040 con 0x55a4a47cf5d0 2024-09-19T09:07:56.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.218+0000 7f65effff640 1 -- 172.21.15.1:0/3902759465 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65fc045040 con 0x55a4a47cf5d0 2024-09-19T09:07:56.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.218+0000 7f65effff640 1 -- 172.21.15.1:0/3902759465 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc035040 con 0x55a4a47cf5d0 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 -- 172.21.15.1:0/3902759465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 msgr2=0x55a4a47d8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 --2- 172.21.15.1:0/3902759465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d8f40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65fc005ab0 tx=0x7f65fc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 -- 172.21.15.1:0/3902759465 shutdown_connections 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 --2- 172.21.15.1:0/3902759465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47da370 0x55a4a47d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 --2- 172.21.15.1:0/3902759465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 --2- 172.21.15.1:0/3902759465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47cf5d0 0x55a4a47d8f40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 -- 172.21.15.1:0/3902759465 >> 172.21.15.1:0/3902759465 conn(0x55a4a4798310 msgr2=0x55a4a47d8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 -- 172.21.15.1:0/3902759465 shutdown_connections 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.219+0000 7f660ecad740 1 -- 172.21.15.1:0/3902759465 wait complete. 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.220+0000 7f660ecad740 1 -- start start 2024-09-19T09:07:56.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.220+0000 7f660ecad740 1 Processor -- start 2024-09-19T09:07:56.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f660ecad740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47e2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f660ecad740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f660ecad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47da370 0x55a4a47ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f660ecad740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b2310 con 0x55a4a47cf5d0 2024-09-19T09:07:56.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f660ecad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b3780 con 0x55a4a47da370 2024-09-19T09:07:56.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f660ecad740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b29e0 con 0x55a4a47d0b40 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f660ecad740 10 client.0 _ll_register_callbacks cb 0x7f65f800b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f6605d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f6605d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47e2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40376/0 (socket says 172.21.15.1:40376) 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f6605d9b640 1 -- 172.21.15.1:0/2641132855 learned_addr learned my addr 172.21.15.1:0/2641132855 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f6605d9b640 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47da370 0x55a4a47ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.221+0000 7f660659c640 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.222+0000 7f660659c640 1 -- 172.21.15.1:0/2641132855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47da370 msgr2=0x55a4a47ddbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.222+0000 7f660659c640 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47da370 0x55a4a47ddbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.222+0000 7f660659c640 1 -- 172.21.15.1:0/2641132855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 msgr2=0x55a4a47e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.222+0000 7f660659c640 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.222+0000 7f660659c640 1 -- 172.21.15.1:0/2641132855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a47de410 con 0x55a4a47d0b40 2024-09-19T09:07:56.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.222+0000 7f6605d9b640 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:56.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.222+0000 7f660659c640 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47e2d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f65f8026510 tx=0x7f65f8011c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac5f47e19555e9af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:56.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.223+0000 7f65edffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:07:56.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.223+0000 7f65edffb640 1 -- 172.21.15.1:0/2641132855 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8032020 con 0x55a4a47d0b40 2024-09-19T09:07:56.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.223+0000 7f65edffb640 1 -- 172.21.15.1:0/2641132855 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f65f80052e0 con 0x55a4a47d0b40 2024-09-19T09:07:56.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.223+0000 7f660ecad740 1 -- 172.21.15.1:0/2641132855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc045040 con 0x55a4a47d0b40 2024-09-19T09:07:56.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.224+0000 7f65edffb640 1 -- 172.21.15.1:0/2641132855 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65f8005b90 con 0x55a4a47d0b40 2024-09-19T09:07:56.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.224+0000 7f660ecad740 10 client.25975 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:56.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.224+0000 7f660ecad740 1 -- 172.21.15.1:0/2641132855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a4a48659a0 con 0x55a4a47d0b40 2024-09-19T09:07:56.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.224+0000 7f65edffb640 1 -- 172.21.15.1:0/2641132855 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65fc045040 con 0x55a4a47d0b40 2024-09-19T09:07:56.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.224+0000 7f65edffb640 1 -- 172.21.15.1:0/2641132855 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f65f80265c0 con 0x55a4a47d0b40 2024-09-19T09:07:56.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.225+0000 7f660ecad740 10 client.25975 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:56.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.225+0000 7f660ecad740 10 client.25975 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:07:56.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.225+0000 7f660ecad740 20 client.25975 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:56.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.225+0000 7f660ecad740 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4a48660d0 0x55a4a48684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.225+0000 7f660ecad740 4 client.25975 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.225+0000 7f660ecad740 1 -- 172.21.15.1:0/2641132855 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4a473cd70 con 0x55a4a48660d0 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.225+0000 7f6605d9b640 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4a48660d0 0x55a4a48684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f6605d9b640 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4a48660d0 0x55a4a48684f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8bf857448aab068 server_cookie=120e56eb0e9fb51a in_seq=0 out_seq=0 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f65edffb640 10 client.25975 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f65edffb640 1 -- 172.21.15.1:0/2641132855 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4a473cd70 con 0x55a4a48660d0 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f65edffb640 10 client.25975 handle_command_reply: tid=0 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 client.25975 shutdown 2024-09-19T09:07:56.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 -- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 msgr2=0x55a4a47e2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47e2d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f65f8026510 tx=0x7f65f8011c10 comp rx=0 tx=0).stop 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 -- 172.21.15.1:0/2641132855 shutdown_connections 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4a48660d0 0x55a4a48684f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4a47da370 0x55a4a47ddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f65edffb640 0 client.25975 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4a47d0b40 0x55a4a47e2d40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 --2- 172.21.15.1:0/2641132855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4a47cf5d0 0x55a4a47e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.226+0000 7f660ecad740 1 -- 172.21.15.1:0/2641132855 >> 172.21.15.1:0/2641132855 conn(0x55a4a4798310 msgr2=0x55a4a47ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.227+0000 7f660ecad740 1 -- 172.21.15.1:0/2641132855 shutdown_connections 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.227+0000 7f660ecad740 1 -- 172.21.15.1:0/2641132855 wait complete. 2024-09-19T09:07:56.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.227+0000 7f660ecad740 20 client.25975 trim_cache size 0 max 16384 2024-09-19T09:07:56.230 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 -- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f65f00a3240 msgr2=0x7f65f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f65f00a3240 0x7f65f00a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f660000c760 tx=0x7f66000bc040 comp rx=0 tx=0).stop 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 -- 172.21.15.1:0/56283841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660810d530 msgr2=0x7f66081a3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660810d530 0x7f66081a3490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f660000ea60 tx=0x7f660000ef20 comp rx=0 tx=0).stop 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 -- 172.21.15.1:0/56283841 shutdown_connections 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f65f00a3240 0x7f65f00a5700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f660810d530 0x7f66081a3490 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6608108e00 0x7f660819f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 --2- 172.21.15.1:0/56283841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6608108450 0x7f660819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:56.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 -- 172.21.15.1:0/56283841 >> 172.21.15.1:0/56283841 conn(0x7f6608077ba0 msgr2=0x7f6608078e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:56.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 -- 172.21.15.1:0/56283841 shutdown_connections 2024-09-19T09:07:56.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:56.228+0000 7f660c8d4640 1 -- 172.21.15.1:0/56283841 wait complete. 2024-09-19T09:07:57.098 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:07:57.378 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:57.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:57 smithi001 ceph-mon[30939]: pgmap v453: 97 pgs: 97 active+clean; 51 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 672 op/s 2024-09-19T09:07:57.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.881+0000 7fadce6fa640 1 -- 172.21.15.1:0/73468198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8102790 msgr2=0x7fadc81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.881+0000 7fadce6fa640 1 --2- 172.21.15.1:0/73468198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8102790 0x7fadc81067e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009900 tx=0x7fadbc02a410 comp rx=0 tx=0).stop 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 -- 172.21.15.1:0/73468198 shutdown_connections 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 --2- 172.21.15.1:0/73468198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc8106f10 0x7fadc810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 --2- 172.21.15.1:0/73468198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8102790 0x7fadc81067e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 --2- 172.21.15.1:0/73468198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc8101de0 0x7fadc81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 -- 172.21.15.1:0/73468198 >> 172.21.15.1:0/73468198 conn(0x7fadc80fd8c0 msgr2=0x7fadc80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 -- 172.21.15.1:0/73468198 shutdown_connections 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 -- 172.21.15.1:0/73468198 wait complete. 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 Processor -- start 2024-09-19T09:07:57.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.882+0000 7fadce6fa640 1 -- start start 2024-09-19T09:07:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadce6fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8101de0 0x7fadc80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadce6fa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc8102790 0x7fadc8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadce6fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc8106f10 0x7fadc8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadce6fa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8112090 con 0x7fadc8101de0 2024-09-19T09:07:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadce6fa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8111f10 con 0x7fadc8106f10 2024-09-19T09:07:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadce6fa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8112210 con 0x7fadc8102790 2024-09-19T09:07:57.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8101de0 0x7fadc80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadccc97640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc8106f10 0x7fadc8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8101de0 0x7fadc80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40392/0 (socket says 172.21.15.1:40392) 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadc7fff640 1 -- 172.21.15.1:0/3479848218 learned_addr learned my addr 172.21.15.1:0/3479848218 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadc77fe640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc8102790 0x7fadc8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadccc97640 1 -- 172.21.15.1:0/3479848218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc8102790 msgr2=0x7fadc8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadccc97640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc8102790 0x7fadc8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadccc97640 1 -- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8101de0 msgr2=0x7fadc80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadccc97640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8101de0 0x7fadc80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadccc97640 1 -- 172.21.15.1:0/3479848218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc81a6990 con 0x7fadc8106f10 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadc77fe640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc8102790 0x7fadc8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.883+0000 7fadccc97640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc8106f10 0x7fadc8074f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009fd0 tx=0x7fadc000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.884+0000 7fadc57fa640 1 -- 172.21.15.1:0/3479848218 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc000ce20 con 0x7fadc8106f10 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.884+0000 7fadc57fa640 1 -- 172.21.15.1:0/3479848218 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadc0004b20 con 0x7fadc8106f10 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.884+0000 7fadce6fa640 1 -- 172.21.15.1:0/3479848218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc81a6c80 con 0x7fadc8106f10 2024-09-19T09:07:57.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.884+0000 7fadc57fa640 1 -- 172.21.15.1:0/3479848218 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0010790 con 0x7fadc8106f10 2024-09-19T09:07:57.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.884+0000 7fadce6fa640 1 -- 172.21.15.1:0/3479848218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc81a71c0 con 0x7fadc8106f10 2024-09-19T09:07:57.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.886+0000 7fadc57fa640 1 -- 172.21.15.1:0/3479848218 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fadc0005020 con 0x7fadc8106f10 2024-09-19T09:07:57.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.886+0000 7fadd0ad3740 1 Processor -- start 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.886+0000 7fadd0ad3740 1 -- start start 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f64090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f6f370 0x559995f71760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559995eca2f0 con 0x559995f645d0 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559995e71cf0 con 0x559995f65b40 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559995ec62b0 con 0x559995f6f370 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f64090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f64090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:37260/0 (socket says 172.21.15.1:37260) 2024-09-19T09:07:57.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 -- 172.21.15.1:0/90126005 learned_addr learned my addr 172.21.15.1:0/90126005 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc7fff640 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f6f370 0x559995f71760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc57fa640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fadb00a3240 0x7fadb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 -- 172.21.15.1:0/90126005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f6f370 msgr2=0x559995f71760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f6f370 0x559995f71760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 -- 172.21.15.1:0/90126005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 msgr2=0x559995f64a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f64a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadccc97640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fadb00a3240 0x7fadb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc77fe640 1 -- 172.21.15.1:0/90126005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559995e563a0 con 0x559995f65b40 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc7fff640 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.887+0000 7fadc57fa640 1 -- 172.21.15.1:0/3479848218 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fadc00d00b0 con 0x7fadc8106f10 2024-09-19T09:07:57.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.888+0000 7fadc77fe640 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f64090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0096c0 tx=0x7fadbc005b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6390d3e5e4aab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.888+0000 7fadae7fc640 1 -- 172.21.15.1:0/90126005 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc035040 con 0x559995f65b40 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.888+0000 7fadccc97640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fadb00a3240 0x7fadb00a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fadc0017000 tx=0x7fadc0067480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.888+0000 7fadae7fc640 1 -- 172.21.15.1:0/90126005 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadbc031a60 con 0x559995f65b40 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.888+0000 7fadae7fc640 1 -- 172.21.15.1:0/90126005 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc03d440 con 0x559995f65b40 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.888+0000 7fadd0ad3740 1 -- 172.21.15.1:0/90126005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 msgr2=0x559995f64090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.888+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f64090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0096c0 tx=0x7fadbc005b70 comp rx=0 tx=0).stop 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 -- 172.21.15.1:0/90126005 shutdown_connections 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f6f370 0x559995f71760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/90126005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f64090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 -- 172.21.15.1:0/90126005 >> 172.21.15.1:0/90126005 conn(0x559995f2d310 msgr2=0x559995f60c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 -- 172.21.15.1:0/90126005 shutdown_connections 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 -- 172.21.15.1:0/90126005 wait complete. 2024-09-19T09:07:57.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 -- start start 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.889+0000 7fadd0ad3740 1 Processor -- start 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f645d0 0x559995f6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f6c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f6c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559995f72010 con 0x559995f6f370 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559995e85060 con 0x559995f65b40 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x559995f72190 con 0x559995f645d0 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadd0ad3740 10 client.0 _ll_register_callbacks cb 0x559995bd88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f645d0 0x559995f6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f645d0 0x559995f6ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:39694/0 (socket says 172.21.15.1:39694) 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 -- 172.21.15.1:0/1052531042 learned_addr learned my addr 172.21.15.1:0/1052531042 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:57.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f6c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc7fff640 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f6c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 -- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 msgr2=0x559995f6c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f6c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 -- 172.21.15.1:0/1052531042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 msgr2=0x559995f6c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f6c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 -- 172.21.15.1:0/1052531042 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559995c3b3c0 con 0x559995f645d0 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc7fff640 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f6c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fadc77fe640 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f645d0 0x559995f6ed50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadbc004b90 tx=0x7fadbc004a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35cf8d1e433620d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.890+0000 7fada77fe640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fada77fe640 1 -- 172.21.15.1:0/1052531042 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc035040 con 0x559995f645d0 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fada77fe640 1 -- 172.21.15.1:0/1052531042 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fadbc004250 con 0x559995f645d0 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 1 -- 172.21.15.1:0/1052531042 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559995ed7860 con 0x559995f645d0 2024-09-19T09:07:57.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fada77fe640 1 -- 172.21.15.1:0/1052531042 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fadbc004450 con 0x559995f645d0 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 10 client.25987 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 1 -- 172.21.15.1:0/1052531042 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559995f72010 con 0x559995f645d0 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fada77fe640 1 -- 172.21.15.1:0/1052531042 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x559995ed7860 con 0x559995f645d0 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fada77fe640 1 -- 172.21.15.1:0/1052531042 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fadbc03a040 con 0x559995f645d0 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 10 client.25987 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 10 client.25987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 20 client.25987 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559995f7ec40 0x559995f81030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 4 client.25987 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadd0ad3740 1 -- 172.21.15.1:0/1052531042 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559995ed1d70 con 0x559995f7ec40 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.891+0000 7fadc7fff640 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559995f7ec40 0x559995f81030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.892+0000 7fadc7fff640 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559995f7ec40 0x559995f81030 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7eb4611cf0d840 server_cookie=cba5c5c63222de9d in_seq=0 out_seq=0 2024-09-19T09:07:57.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.892+0000 7fada77fe640 10 client.25987 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:57.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fada77fe640 1 -- 172.21.15.1:0/1052531042 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559995ed1d70 con 0x559995f7ec40 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fada77fe640 10 client.25987 handle_command_reply: tid=0 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 client.25987 shutdown 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 -- 172.21.15.1:0/1052531042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f645d0 msgr2=0x559995f6ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f645d0 0x559995f6ed50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fadbc004b90 tx=0x7fadbc004a90 comp rx=0 tx=0).stop 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 -- 172.21.15.1:0/1052531042 shutdown_connections 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559995f7ec40 0x559995f81030 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f6c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fada77fe640 0 client.25987 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f65b40 0x559995f6c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/1052531042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f645d0 0x559995f6ed50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 -- 172.21.15.1:0/1052531042 >> 172.21.15.1:0/1052531042 conn(0x559995f2d310 msgr2=0x559995f66930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 -- 172.21.15.1:0/1052531042 shutdown_connections 2024-09-19T09:07:57.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.893+0000 7fadd0ad3740 1 -- 172.21.15.1:0/1052531042 wait complete. 2024-09-19T09:07:57.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.894+0000 7fadd0ad3740 20 client.25987 trim_cache size 0 max 16384 2024-09-19T09:07:57.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.908+0000 7fadd0ad3740 1 Processor -- start 2024-09-19T09:07:57.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.908+0000 7fadd0ad3740 1 -- start start 2024-09-19T09:07:57.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f645d0 0x559995f67120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f67660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f86720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadc81b21d0 con 0x559995f6f370 2024-09-19T09:07:57.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadc81af9e0 con 0x559995f645d0 2024-09-19T09:07:57.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fadc81ad830 con 0x559995f65b40 2024-09-19T09:07:57.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f86720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f67660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f86720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40416/0 (socket says 172.21.15.1:40416) 2024-09-19T09:07:57.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 -- 172.21.15.1:0/2315310645 learned_addr learned my addr 172.21.15.1:0/2315310645 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:57.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 --2- 172.21.15.1:0/2315310645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f645d0 0x559995f67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 -- 172.21.15.1:0/2315310645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 msgr2=0x559995f67660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 --2- 172.21.15.1:0/2315310645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f67660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 -- 172.21.15.1:0/2315310645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f645d0 msgr2=0x559995f67120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 --2- 172.21.15.1:0/2315310645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f645d0 0x559995f67120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 -- 172.21.15.1:0/2315310645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559995f6a550 con 0x559995f6f370 2024-09-19T09:07:57.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadc77fe640 1 --2- 172.21.15.1:0/2315310645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f86720 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fadbc04a500 tx=0x7fadbc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deaee66d5e7c190f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.909+0000 7fadadffb640 1 -- 172.21.15.1:0/2315310645 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc035040 con 0x559995f6f370 2024-09-19T09:07:57.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadadffb640 1 -- 172.21.15.1:0/2315310645 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadbc032e80 con 0x559995f6f370 2024-09-19T09:07:57.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadadffb640 1 -- 172.21.15.1:0/2315310645 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc003f10 con 0x559995f6f370 2024-09-19T09:07:57.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 -- 172.21.15.1:0/2315310645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 msgr2=0x559995f86720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/2315310645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f86720 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fadbc04a500 tx=0x7fadbc001e70 comp rx=0 tx=0).stop 2024-09-19T09:07:57.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 -- 172.21.15.1:0/2315310645 shutdown_connections 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/2315310645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f6f370 0x559995f86720 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/2315310645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f67660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/2315310645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f645d0 0x559995f67120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 -- 172.21.15.1:0/2315310645 >> 172.21.15.1:0/2315310645 conn(0x559995f2d310 msgr2=0x559995f5fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 -- 172.21.15.1:0/2315310645 shutdown_connections 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.910+0000 7fadd0ad3740 1 -- 172.21.15.1:0/2315310645 wait complete. 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 1 -- start start 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 1 Processor -- start 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f77d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f73030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f6f370 0x559995f737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadc81adea0 con 0x559995f645d0 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadc81af310 con 0x559995f6f370 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fadc81ae570 con 0x559995f65b40 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadd0ad3740 10 client.0 _ll_register_callbacks cb 0x7fadb8009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadc77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f77d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadc77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f77d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40428/0 (socket says 172.21.15.1:40428) 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadc77fe640 1 -- 172.21.15.1:0/3498028229 learned_addr learned my addr 172.21.15.1:0/3498028229 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:07:57.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.911+0000 7fadc7fff640 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f73030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadc77fe640 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f6f370 0x559995f737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadc7fff640 1 -- 172.21.15.1:0/3498028229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f6f370 msgr2=0x559995f737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadc7fff640 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f6f370 0x559995f737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadc7fff640 1 -- 172.21.15.1:0/3498028229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 msgr2=0x559995f77d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadc7fff640 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f77d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadc7fff640 1 -- 172.21.15.1:0/3498028229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559995fe86f0 con 0x559995f65b40 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadc77fe640 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f77d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadc7fff640 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f73030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x559995f81690 tx=0x7fadb8010b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1597ec08fbeeed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fada77fe640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:07:57.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fada77fe640 1 -- 172.21.15.1:0/3498028229 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8010e60 con 0x559995f65b40 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadd0ad3740 1 -- 172.21.15.1:0/3498028229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadbc032e80 con 0x559995f65b40 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fada77fe640 1 -- 172.21.15.1:0/3498028229 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fadb8004460 con 0x559995f65b40 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fada77fe640 1 -- 172.21.15.1:0/3498028229 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fadb802d070 con 0x559995f65b40 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadd0ad3740 10 client.25993 fetch_fsmap learned FSMap version 28 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.912+0000 7fadd0ad3740 1 -- 172.21.15.1:0/3498028229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559995fe98b0 con 0x559995f65b40 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fada77fe640 1 -- 172.21.15.1:0/3498028229 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadbc032e80 con 0x559995f65b40 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fada77fe640 1 -- 172.21.15.1:0/3498028229 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fadb8003c70 con 0x559995f65b40 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fadd0ad3740 10 client.25993 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fadd0ad3740 10 client.25993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fadd0ad3740 20 client.25993 populate_metadata read hostname 'smithi001' 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559995f7ec40 0x559995fec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:07:57.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fadd0ad3740 4 client.25993 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fadd0ad3740 1 -- 172.21.15.1:0/3498028229 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559995e4e170 con 0x559995f7ec40 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fadc77fe640 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559995f7ec40 0x559995fec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fada77fe640 10 client.25993 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.913+0000 7fadc77fe640 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559995f7ec40 0x559995fec120 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31096a8e7e406e4a server_cookie=de669b664b31d3bf in_seq=0 out_seq=0 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fada77fe640 1 -- 172.21.15.1:0/3498028229 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559995e4e170 con 0x559995f7ec40 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fada77fe640 10 client.25993 handle_command_reply: tid=0 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 client.25993 shutdown 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 -- 172.21.15.1:0/3498028229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 msgr2=0x559995f73030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f73030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x559995f81690 tx=0x7fadb8010b50 comp rx=0 tx=0).stop 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 -- 172.21.15.1:0/3498028229 shutdown_connections 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x559995f7ec40 0x559995fec120 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559995f6f370 0x559995f737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559995f65b40 0x559995f73030 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fada77fe640 0 client.25993 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 --2- 172.21.15.1:0/3498028229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559995f645d0 0x559995f77d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 -- 172.21.15.1:0/3498028229 >> 172.21.15.1:0/3498028229 conn(0x559995f2d310 msgr2=0x559995f6d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 -- 172.21.15.1:0/3498028229 shutdown_connections 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 1 -- 172.21.15.1:0/3498028229 wait complete. 2024-09-19T09:07:57.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.914+0000 7fadd0ad3740 20 client.25993 trim_cache size 0 max 16384 2024-09-19T09:07:57.923 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:07:57.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 -- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fadb00a3240 msgr2=0x7fadb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fadb00a3240 0x7fadb00a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fadc0017000 tx=0x7fadc0067480 comp rx=0 tx=0).stop 2024-09-19T09:07:57.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 -- 172.21.15.1:0/3479848218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc8106f10 msgr2=0x7fadc8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:07:57.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc8106f10 0x7fadc8074f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009fd0 tx=0x7fadc000ef10 comp rx=0 tx=0).stop 2024-09-19T09:07:57.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 -- 172.21.15.1:0/3479848218 shutdown_connections 2024-09-19T09:07:57.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc8106f10 0x7fadc8074f70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fadb00a3240 0x7fadb00a5700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadc8102790 0x7fadc8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 --2- 172.21.15.1:0/3479848218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadc8101de0 0x7fadc80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:07:57.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 -- 172.21.15.1:0/3479848218 >> 172.21.15.1:0/3479848218 conn(0x7fadc80fd8c0 msgr2=0x7fadc80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:07:57.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 -- 172.21.15.1:0/3479848218 shutdown_connections 2024-09-19T09:07:57.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:07:57.915+0000 7fadce6fa640 1 -- 172.21.15.1:0/3479848218 wait complete. 2024-09-19T09:07:57.958 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:57 smithi022 ceph-mon[35107]: pgmap v453: 97 pgs: 97 active+clean; 51 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 672 op/s 2024-09-19T09:07:58.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:57 smithi064 ceph-mon[35179]: pgmap v453: 97 pgs: 97 active+clean; 51 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 672 op/s 2024-09-19T09:07:59.374 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-19T09:07:59.374 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:07:59.411 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:07:59.411 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:07:59.411 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:07:59.681 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:07:59.700 DEBUG:teuthology.parallel:result is None 2024-09-19T09:07:59.700 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:07:59.737 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:07:59.738 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T09:07:59.748 INFO:tasks.quiescer:joining Quiescers 2024-09-19T09:07:59.748 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T09:07:59.749 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:07:59.825 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:07:59.826 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:07:59.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:07:59 smithi022 ceph-mon[35107]: pgmap v454: 97 pgs: 97 active+clean; 51 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 503 op/s 2024-09-19T09:07:59.967 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:07:59 smithi001 ceph-mon[30939]: pgmap v454: 97 pgs: 97 active+clean; 51 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 503 op/s 2024-09-19T09:08:00.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:07:59 smithi064 ceph-mon[35179]: pgmap v454: 97 pgs: 97 active+clean; 51 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 503 op/s 2024-09-19T09:08:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 -- 172.21.15.1:0/1168655546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74100aa0 msgr2=0x7f9b7410ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 --2- 172.21.15.1:0/1168655546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74100aa0 0x7f9b7410ea20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009900 tx=0x7f9b6c02a410 comp rx=0 tx=0).stop 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 -- 172.21.15.1:0/1168655546 shutdown_connections 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 --2- 172.21.15.1:0/1168655546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74100aa0 0x7f9b7410ea20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 --2- 172.21.15.1:0/1168655546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b74100100 0x7f9b74100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 --2- 172.21.15.1:0/1168655546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b74106b80 0x7f9b74106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 -- 172.21.15.1:0/1168655546 >> 172.21.15.1:0/1168655546 conn(0x7f9b74077230 msgr2=0x7f9b740fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 -- 172.21.15.1:0/1168655546 shutdown_connections 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.197+0000 7f9b79928640 1 -- 172.21.15.1:0/1168655546 wait complete. 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.198+0000 7f9b79928640 1 Processor -- start 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.198+0000 7f9b79928640 1 -- start start 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.198+0000 7f9b79928640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b74100100 0x7f9b741984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.198+0000 7f9b79928640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b74100aa0 0x7f9b74198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.198+0000 7f9b79928640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74106b80 0x7f9b7419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:00.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.198+0000 7f9b72ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b74100100 0x7f9b741984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.198+0000 7f9b72ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b74100100 0x7f9b741984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40458/0 (socket says 172.21.15.1:40458) 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b72ffd640 1 -- 172.21.15.1:0/1700523509 learned_addr learned my addr 172.21.15.1:0/1700523509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74112170 con 0x7f9b74100100 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74111ff0 con 0x7f9b74106b80 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741122f0 con 0x7f9b74100aa0 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b727fc640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b74100aa0 0x7f9b74198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b737fe640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74106b80 0x7f9b7419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b737fe640 1 -- 172.21.15.1:0/1700523509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b74100aa0 msgr2=0x7f9b74198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b737fe640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b74100aa0 0x7f9b74198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b737fe640 1 -- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b74100100 msgr2=0x7f9b741984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b737fe640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b74100100 0x7f9b741984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b737fe640 1 -- 172.21.15.1:0/1700523509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7419d4a0 con 0x7f9b74106b80 2024-09-19T09:08:00.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b727fc640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b74100aa0 0x7f9b74198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:00.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b737fe640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74106b80 0x7f9b7419cdc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009230 tx=0x7f9b6c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:00.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b78926640 1 -- 172.21.15.1:0/1700523509 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c03f030 con 0x7f9b74106b80 2024-09-19T09:08:00.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b78926640 1 -- 172.21.15.1:0/1700523509 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b6c004440 con 0x7f9b74106b80 2024-09-19T09:08:00.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7419d730 con 0x7f9b74106b80 2024-09-19T09:08:00.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b78926640 1 -- 172.21.15.1:0/1700523509 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c035070 con 0x7f9b74106b80 2024-09-19T09:08:00.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.199+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b741a5070 con 0x7f9b74106b80 2024-09-19T09:08:00.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.200+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b74103420 con 0x7f9b74106b80 2024-09-19T09:08:00.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.202+0000 7f9b78926640 1 -- 172.21.15.1:0/1700523509 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f9b6c042030 con 0x7f9b74106b80 2024-09-19T09:08:00.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.202+0000 7f9b78926640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9b5c0a3240 0x7f9b5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:00.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.202+0000 7f9b72ffd640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9b5c0a3240 0x7f9b5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:00.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.203+0000 7f9b78926640 1 -- 172.21.15.1:0/1700523509 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9b6c0efd70 con 0x7f9b74106b80 2024-09-19T09:08:00.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.203+0000 7f9b72ffd640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9b5c0a3240 0x7f9b5c0a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009c90 tx=0x7f9b68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:00.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.206+0000 7f9b78926640 1 -- 172.21.15.1:0/1700523509 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b6c0bc3c0 con 0x7f9b74106b80 2024-09-19T09:08:00.264 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:00.312 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:00.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.459+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b741a5240 con 0x7f9b74106b80 2024-09-19T09:08:00.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.460+0000 7f9b78926640 1 -- 172.21.15.1:0/1700523509 <== mon.2 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11887 (secure 0 0 0) 0x7f9b6c0c06c0 con 0x7f9b74106b80 2024-09-19T09:08:00.461 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:08:00.461 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-19T09:07:36:672566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:07:36.432120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:08:00.461 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-19T09:08:00.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9b5c0a3240 msgr2=0x7f9b5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:00.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9b5c0a3240 0x7f9b5c0a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009c90 tx=0x7f9b68005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:00.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74106b80 msgr2=0x7f9b7419cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:00.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74106b80 0x7f9b7419cdc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009230 tx=0x7f9b6c004040 comp rx=0 tx=0).stop 2024-09-19T09:08:00.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 shutdown_connections 2024-09-19T09:08:00.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b74106b80 0x7f9b7419cdc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f9b5c0a3240 0x7f9b5c0a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b74100aa0 0x7f9b74198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 --2- 172.21.15.1:0/1700523509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9b74100100 0x7f9b741984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:00.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 >> 172.21.15.1:0/1700523509 conn(0x7f9b74077230 msgr2=0x7f9b74104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:00.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 shutdown_connections 2024-09-19T09:08:00.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:00.463+0000 7f9b79928640 1 -- 172.21.15.1:0/1700523509 wait complete. 2024-09-19T09:08:00.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:00 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1700523509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:01.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:00 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1700523509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:01.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:00 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1700523509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:01.251 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:08:01.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:08:01.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 -- 172.21.15.1:0/38665052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 msgr2=0x7f751c1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 --2- 172.21.15.1:0/38665052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 0x7f751c1031e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7510009900 tx=0x7f751002a480 comp rx=0 tx=0).stop 2024-09-19T09:08:01.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 -- 172.21.15.1:0/38665052 shutdown_connections 2024-09-19T09:08:01.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 --2- 172.21.15.1:0/38665052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f751c10c1a0 0x7f751c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 --2- 172.21.15.1:0/38665052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751c103720 0x7f751c10bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 --2- 172.21.15.1:0/38665052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 0x7f751c1031e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 -- 172.21.15.1:0/38665052 >> 172.21.15.1:0/38665052 conn(0x7f751c0fc7a0 msgr2=0x7f751c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:01.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 -- 172.21.15.1:0/38665052 shutdown_connections 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.669+0000 7f7522b05640 1 -- 172.21.15.1:0/38665052 wait complete. 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f7522b05640 1 Processor -- start 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f7522b05640 1 -- start start 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f7522b05640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 0x7f751c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f7522b05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751c103720 0x7f751c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f7522b05640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f751c10c1a0 0x7f751c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f7522b05640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1120f0 con 0x7f751c102e00 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f7522b05640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f751c111f70 con 0x7f751c103720 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f7522b05640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f751c112270 con 0x7f751c10c1a0 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f75208a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 0x7f751c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f75208a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 0x7f751c1984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40480/0 (socket says 172.21.15.1:40480) 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f75208a1640 1 -- 172.21.15.1:0/3459092569 learned_addr learned my addr 172.21.15.1:0/3459092569 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:01.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f751bfff640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751c103720 0x7f751c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f75208a1640 1 -- 172.21.15.1:0/3459092569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f751c10c1a0 msgr2=0x7f751c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f75208a1640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f751c10c1a0 0x7f751c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f75208a1640 1 -- 172.21.15.1:0/3459092569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751c103720 msgr2=0x7f751c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f75208a1640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751c103720 0x7f751c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.670+0000 7f75208a1640 1 -- 172.21.15.1:0/3459092569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c19d480 con 0x7f751c102e00 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.671+0000 7f75208a1640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 0x7f751c1984d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7510006010 tx=0x7f75100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.671+0000 7f7519ffb640 1 -- 172.21.15.1:0/3459092569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751003f030 con 0x7f751c102e00 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.671+0000 7f7519ffb640 1 -- 172.21.15.1:0/3459092569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7510003d00 con 0x7f751c102e00 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.671+0000 7f7522b05640 1 -- 172.21.15.1:0/3459092569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c19d710 con 0x7f751c102e00 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.671+0000 7f7519ffb640 1 -- 172.21.15.1:0/3459092569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510035070 con 0x7f751c102e00 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.671+0000 7f7522b05640 1 -- 172.21.15.1:0/3459092569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c1a5050 con 0x7f751c102e00 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.673+0000 7f7519ffb640 1 -- 172.21.15.1:0/3459092569 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f7510042030 con 0x7f751c102e00 2024-09-19T09:08:01.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7524ede740 1 Processor -- start 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7524ede740 1 -- start start 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7524ede740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 0x56481511cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7524ede740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 0x564815127800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7524ede740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564815127d40 0x56481512a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7524ede740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564815082280 con 0x564815127d40 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7524ede740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564815029b10 con 0x56481511d480 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7524ede740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56481507e240 con 0x56481511cb60 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f751bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564815127d40 0x56481512a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f751bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564815127d40 0x56481512a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40490/0 (socket says 172.21.15.1:40490) 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f751bfff640 1 -- 172.21.15.1:0/4101408045 learned_addr learned my addr 172.21.15.1:0/4101408045 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f7519ffb640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f750c0a3240 0x7f750c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f75208a1640 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 0x564815127800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f75210a2640 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 0x56481511cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.674+0000 7f75210a2640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f750c0a3240 0x7f750c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f751bfff640 1 -- 172.21.15.1:0/4101408045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 msgr2=0x56481511cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f751bfff640 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 0x56481511cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f751bfff640 1 -- 172.21.15.1:0/4101408045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 msgr2=0x564815127800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f7519ffb640 1 -- 172.21.15.1:0/3459092569 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f75100f03e0 con 0x7f751c102e00 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f751bfff640 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 0x564815127800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f751bfff640 1 -- 172.21.15.1:0/4101408045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648150361f0 con 0x564815127d40 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f75210a2640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f750c0a3240 0x7f750c0a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7514008fd0 tx=0x7f7514006ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f751bfff640 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564815127d40 0x56481512a130 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f750800bb10 tx=0x7f750800d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a77be1e2ce8562f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f7506ffd640 1 -- 172.21.15.1:0/4101408045 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508017420 con 0x564815127d40 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f7506ffd640 1 -- 172.21.15.1:0/4101408045 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7508017ac0 con 0x564815127d40 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.675+0000 7f7506ffd640 1 -- 172.21.15.1:0/4101408045 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750800fbe0 con 0x564815127d40 2024-09-19T09:08:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 -- 172.21.15.1:0/4101408045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564815127d40 msgr2=0x56481512a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564815127d40 0x56481512a130 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f750800bb10 tx=0x7f750800d340 comp rx=0 tx=0).stop 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 -- 172.21.15.1:0/4101408045 shutdown_connections 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564815127d40 0x56481512a130 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 0x564815127800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 --2- 172.21.15.1:0/4101408045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 0x56481511cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 -- 172.21.15.1:0/4101408045 >> 172.21.15.1:0/4101408045 conn(0x5648151190f0 msgr2=0x5648151194d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 -- 172.21.15.1:0/4101408045 shutdown_connections 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 -- 172.21.15.1:0/4101408045 wait complete. 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 -- start start 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.676+0000 7f7524ede740 1 Processor -- start 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f7524ede740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x564815124b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f7524ede740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511d480 0x5648151250d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f7524ede740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 0x564815125610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f7524ede740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56481512a910 con 0x56481511cb60 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f7524ede740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56481503cf10 con 0x564815127d40 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f7524ede740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56481512aa90 con 0x56481511d480 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f7524ede740 10 client.0 _ll_register_callbacks cb 0x564815005a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x564815124b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x564815124b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40492/0 (socket says 172.21.15.1:40492) 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 -- 172.21.15.1:0/3528717774 learned_addr learned my addr 172.21.15.1:0/3528717774 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f751bfff640 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511d480 0x5648151250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75210a2640 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 0x564815125610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 -- 172.21.15.1:0/3528717774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511d480 msgr2=0x5648151250d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511d480 0x5648151250d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 -- 172.21.15.1:0/3528717774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 msgr2=0x564815125610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 0x564815125610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 -- 172.21.15.1:0/3528717774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564814df36a0 con 0x56481511cb60 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f75208a1640 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x564815124b90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f75100bc910 tx=0x7f751002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed7809cf11e5554 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.677+0000 7f74fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f74fbfff640 1 -- 172.21.15.1:0/3528717774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510049030 con 0x56481511cb60 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f74fbfff640 1 -- 172.21.15.1:0/3528717774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f75100b8ff0 con 0x56481511cb60 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 1 -- 172.21.15.1:0/3528717774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7508017ac0 con 0x56481511cb60 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f74fbfff640 1 -- 172.21.15.1:0/3528717774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f75100bd080 con 0x56481511cb60 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 10 client.16593 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 1 -- 172.21.15.1:0/3528717774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648151364a0 con 0x56481511cb60 2024-09-19T09:08:01.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f74fbfff640 1 -- 172.21.15.1:0/3528717774 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7508017ac0 con 0x56481511cb60 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f74fbfff640 1 -- 172.21.15.1:0/3528717774 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f75100db140 con 0x56481511cb60 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 10 client.16593 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 20 client.16593 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564815137890 0x564815139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 4 client.16593 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.678+0000 7f7524ede740 1 -- 172.21.15.1:0/3528717774 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56481508f7f0 con 0x564815137890 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.679+0000 7f751bfff640 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564815137890 0x564815139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.679+0000 7f751bfff640 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564815137890 0x564815139cc0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3526654502ec4ec3 server_cookie=874a8fb24317f5c5 in_seq=0 out_seq=0 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.679+0000 7f74fbfff640 10 client.16593 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f74fbfff640 1 -- 172.21.15.1:0/3528717774 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56481508f7f0 con 0x564815137890 2024-09-19T09:08:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f74fbfff640 10 client.16593 handle_command_reply: tid=0 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 client.16593 shutdown 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 -- 172.21.15.1:0/3528717774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 msgr2=0x564815124b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x564815124b90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f75100bc910 tx=0x7f751002a480 comp rx=0 tx=0).stop 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 -- 172.21.15.1:0/3528717774 shutdown_connections 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564815137890 0x564815139cc0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 0x564815125610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f74fbfff640 0 client.16593 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511d480 0x5648151250d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 --2- 172.21.15.1:0/3528717774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x564815124b90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 -- 172.21.15.1:0/3528717774 >> 172.21.15.1:0/3528717774 conn(0x5648151190f0 msgr2=0x564815118270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 -- 172.21.15.1:0/3528717774 shutdown_connections 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 1 -- 172.21.15.1:0/3528717774 wait complete. 2024-09-19T09:08:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.680+0000 7f7524ede740 20 client.16593 trim_cache size 0 max 16384 2024-09-19T09:08:01.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.698+0000 7f7524ede740 1 Processor -- start 2024-09-19T09:08:01.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.698+0000 7f7524ede740 1 -- start start 2024-09-19T09:08:01.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.698+0000 7f7524ede740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x5648151269f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.698+0000 7f7524ede740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 0x56481513f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.698+0000 7f7524ede740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564815127d40 0x56481513fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.698+0000 7f7524ede740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1b0090 con 0x56481511cb60 2024-09-19T09:08:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.698+0000 7f7524ede740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1ad8a0 con 0x56481511d480 2024-09-19T09:08:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.698+0000 7f7524ede740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1ab6f0 con 0x564815127d40 2024-09-19T09:08:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x5648151269f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x5648151269f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40500/0 (socket says 172.21.15.1:40500) 2024-09-19T09:08:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 -- 172.21.15.1:0/2249273951 learned_addr learned my addr 172.21.15.1:0/2249273951 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75210a2640 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564815127d40 0x56481513fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f751bfff640 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 0x56481513f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 -- 172.21.15.1:0/2249273951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564815127d40 msgr2=0x56481513fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564815127d40 0x56481513fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 -- 172.21.15.1:0/2249273951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 msgr2=0x56481513f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 0x56481513f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 -- 172.21.15.1:0/2249273951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564815134150 con 0x56481511cb60 2024-09-19T09:08:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75208a1640 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x5648151269f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f75100bac30 tx=0x7f75100a72c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ea8f98934aefe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75067fc640 1 -- 172.21.15.1:0/2249273951 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510049040 con 0x56481511cb60 2024-09-19T09:08:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75067fc640 1 -- 172.21.15.1:0/2249273951 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75100bce60 con 0x56481511cb60 2024-09-19T09:08:01.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.699+0000 7f75067fc640 1 -- 172.21.15.1:0/2249273951 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75100db140 con 0x56481511cb60 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 -- 172.21.15.1:0/2249273951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 msgr2=0x5648151269f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x5648151269f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f75100bac30 tx=0x7f75100a72c0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 -- 172.21.15.1:0/2249273951 shutdown_connections 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x564815127d40 0x56481513fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56481511d480 0x56481513f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 --2- 172.21.15.1:0/2249273951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511cb60 0x5648151269f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 -- 172.21.15.1:0/2249273951 >> 172.21.15.1:0/2249273951 conn(0x5648151190f0 msgr2=0x5648151262e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 -- 172.21.15.1:0/2249273951 shutdown_connections 2024-09-19T09:08:01.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 -- 172.21.15.1:0/2249273951 wait complete. 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 -- start start 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.700+0000 7f7524ede740 1 Processor -- start 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f7524ede740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 0x56481512ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f7524ede740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511d480 0x56481512bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f7524ede740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 0x56481512c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f7524ede740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1abd60 con 0x56481511d480 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f7524ede740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1ad1d0 con 0x564815127d40 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f7524ede740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1ac430 con 0x56481511cb60 2024-09-19T09:08:01.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f7524ede740 10 client.0 _ll_register_callbacks cb 0x7f7510009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f751bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511d480 0x56481512bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f751bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511d480 0x56481512bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40516/0 (socket says 172.21.15.1:40516) 2024-09-19T09:08:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f751bfff640 1 -- 172.21.15.1:0/576696207 learned_addr learned my addr 172.21.15.1:0/576696207 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f75208a1640 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 0x56481512ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f75210a2640 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 0x56481512c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f751bfff640 1 -- 172.21.15.1:0/576696207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 msgr2=0x56481512ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:01.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f751bfff640 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 0x56481512ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f751bfff640 1 -- 172.21.15.1:0/576696207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 msgr2=0x56481512c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f751bfff640 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 0x56481512c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.701+0000 7f751bfff640 1 -- 172.21.15.1:0/576696207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648151a15a0 con 0x56481511d480 2024-09-19T09:08:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f751bfff640 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511d480 0x56481512bf80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f750800f870 tx=0x7f750800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83f97bdcd0df4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f74fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f74fbfff640 1 -- 172.21.15.1:0/576696207 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750800b710 con 0x56481511d480 2024-09-19T09:08:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f74fbfff640 1 -- 172.21.15.1:0/576696207 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f750800f910 con 0x56481511d480 2024-09-19T09:08:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 1 -- 172.21.15.1:0/576696207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75100bce60 con 0x56481511d480 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f74fbfff640 1 -- 172.21.15.1:0/576696207 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f750800fb10 con 0x56481511d480 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 10 client.16599 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 1 -- 172.21.15.1:0/576696207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648151a2950 con 0x56481511d480 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f74fbfff640 1 -- 172.21.15.1:0/576696207 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75100bce60 con 0x56481511d480 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f74fbfff640 1 -- 172.21.15.1:0/576696207 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7508034030 con 0x56481511d480 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 10 client.16599 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 20 client.16599 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:01.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564815137890 0x5648151a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:01.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 4 client.16599 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:08:01.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.702+0000 7f7524ede740 1 -- 172.21.15.1:0/576696207 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564815089d00 con 0x564815137890 2024-09-19T09:08:01.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.703+0000 7f75208a1640 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564815137890 0x5648151a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:01.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.703+0000 7f74fbfff640 10 client.16599 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:01.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.703+0000 7f75208a1640 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564815137890 0x5648151a4f30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ec84f2aa69df0e server_cookie=77ba51e9f3c82eb2 in_seq=0 out_seq=0 2024-09-19T09:08:01.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f74fbfff640 1 -- 172.21.15.1:0/576696207 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564815089d00 con 0x564815137890 2024-09-19T09:08:01.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f74fbfff640 10 client.16599 handle_command_reply: tid=0 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 client.16599 shutdown 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 -- 172.21.15.1:0/576696207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511d480 msgr2=0x56481512bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511d480 0x56481512bf80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f750800f870 tx=0x7f750800f740 comp rx=0 tx=0).stop 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 -- 172.21.15.1:0/576696207 shutdown_connections 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x564815137890 0x5648151a4f30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564815127d40 0x56481512c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f74fbfff640 0 client.16599 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56481511d480 0x56481512bf80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 --2- 172.21.15.1:0/576696207 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56481511cb60 0x56481512ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.704+0000 7f7524ede740 1 -- 172.21.15.1:0/576696207 >> 172.21.15.1:0/576696207 conn(0x5648151190f0 msgr2=0x564815125370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7524ede740 1 -- 172.21.15.1:0/576696207 shutdown_connections 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7524ede740 1 -- 172.21.15.1:0/576696207 wait complete. 2024-09-19T09:08:01.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7524ede740 20 client.16599 trim_cache size 0 max 16384 2024-09-19T09:08:01.715 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:08:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "9e95bf98-913a-4b45-ba10-baa2cc786003", 2024-09-19T09:08:01.715 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:08:01.715 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:01.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 -- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f750c0a3240 msgr2=0x7f750c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f750c0a3240 0x7f750c0a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7514008fd0 tx=0x7f7514006ce0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 -- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 msgr2=0x7f751c1984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 0x7f751c1984d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7510006010 tx=0x7f75100042f0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 -- 172.21.15.1:0/3459092569 shutdown_connections 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f750c0a3240 0x7f750c0a5700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f751c10c1a0 0x7f751c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f751c103720 0x7f751c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 --2- 172.21.15.1:0/3459092569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f751c102e00 0x7f751c1984d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 -- 172.21.15.1:0/3459092569 >> 172.21.15.1:0/3459092569 conn(0x7f751c0fc7a0 msgr2=0x7f751c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 -- 172.21.15.1:0/3459092569 shutdown_connections 2024-09-19T09:08:01.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.705+0000 7f7522b05640 1 -- 172.21.15.1:0/3459092569 wait complete. 2024-09-19T09:08:01.792 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:01 smithi001 ceph-mon[30939]: pgmap v455: 97 pgs: 97 active+clean; 32 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 891 op/s 2024-09-19T09:08:02.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:01 smithi064 ceph-mon[35179]: pgmap v455: 97 pgs: 97 active+clean; 32 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 891 op/s 2024-09-19T09:08:02.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:01 smithi022 ceph-mon[35107]: pgmap v455: 97 pgs: 97 active+clean; 32 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 891 op/s 2024-09-19T09:08:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.874+0000 7fe92edb8640 1 -- 172.21.15.1:0/645460516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928103660 msgr2=0x7fe92810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.874+0000 7fe92edb8640 1 --2- 172.21.15.1:0/645460516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928103660 0x7fe92810bb50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe914009900 tx=0x7fe91402a480 comp rx=0 tx=0).stop 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.874+0000 7fe92edb8640 1 -- 172.21.15.1:0/645460516 shutdown_connections 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.874+0000 7fe92edb8640 1 --2- 172.21.15.1:0/645460516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe92810c170 0x7fe92810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.874+0000 7fe92edb8640 1 --2- 172.21.15.1:0/645460516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928103660 0x7fe92810bb50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.874+0000 7fe92edb8640 1 --2- 172.21.15.1:0/645460516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe928102d40 0x7fe928103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.874+0000 7fe92edb8640 1 -- 172.21.15.1:0/645460516 >> 172.21.15.1:0/645460516 conn(0x7fe9280fc7a0 msgr2=0x7fe9280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.874+0000 7fe92edb8640 1 -- 172.21.15.1:0/645460516 shutdown_connections 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.875+0000 7fe92edb8640 1 -- 172.21.15.1:0/645460516 wait complete. 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.875+0000 7fe92edb8640 1 Processor -- start 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.875+0000 7fe92edb8640 1 -- start start 2024-09-19T09:08:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92edb8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928102d40 0x7fe928198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92edb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe928103660 0x7fe928198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92edb8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe92810c170 0x7fe92819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92edb8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe928112090 con 0x7fe928102d40 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92edb8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe928111f10 con 0x7fe928103660 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92edb8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe928112210 con 0x7fe92810c170 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928102d40 0x7fe928198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928102d40 0x7fe928198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40532/0 (socket says 172.21.15.1:40532) 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 -- 172.21.15.1:0/2911782751 learned_addr learned my addr 172.21.15.1:0/2911782751 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe927fff640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe928103660 0x7fe928198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92d355640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe92810c170 0x7fe92819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 -- 172.21.15.1:0/2911782751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe92810c170 msgr2=0x7fe92819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe92810c170 0x7fe92819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 -- 172.21.15.1:0/2911782751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe928103660 msgr2=0x7fe928198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe928103660 0x7fe928198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 -- 172.21.15.1:0/2911782751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92819d500 con 0x7fe928102d40 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92d355640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe92810c170 0x7fe92819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe927fff640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe928103660 0x7fe928198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92cb54640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928102d40 0x7fe928198550 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00d770 tx=0x7fe91c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe925ffb640 1 -- 172.21.15.1:0/2911782751 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c017070 con 0x7fe928102d40 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe925ffb640 1 -- 172.21.15.1:0/2911782751 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe91c005520 con 0x7fe928102d40 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92819d7f0 con 0x7fe928102d40 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.876+0000 7fe925ffb640 1 -- 172.21.15.1:0/2911782751 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c010460 con 0x7fe928102d40 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.877+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9281a50d0 con 0x7fe928102d40 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.878+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe928103120 con 0x7fe928102d40 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.879+0000 7fe925ffb640 1 -- 172.21.15.1:0/2911782751 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fe91c004ea0 con 0x7fe928102d40 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.880+0000 7fe925ffb640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9180a3240 0x7fe9180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.880+0000 7fe927fff640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9180a3240 0x7fe9180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.880+0000 7fe925ffb640 1 -- 172.21.15.1:0/2911782751 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe91c0cf510 con 0x7fe928102d40 2024-09-19T09:08:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.880+0000 7fe927fff640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9180a3240 0x7fe9180a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe914000c00 tx=0x7fe914032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:02.331 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:08:02.331 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-19T09:07:36:672566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:07:36.432120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:08:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:01.884+0000 7fe925ffb640 1 -- 172.21.15.1:0/2911782751 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe91c09c210 con 0x7fe928102d40 2024-09-19T09:08:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.099+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9281071e0 con 0x7fe928102d40 2024-09-19T09:08:02.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.100+0000 7fe925ffb640 1 -- 172.21.15.1:0/2911782751 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11887 (secure 0 0 0) 0x7fe91c09bb10 con 0x7fe928102d40 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9180a3240 msgr2=0x7fe9180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9180a3240 0x7fe9180a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe914000c00 tx=0x7fe914032c80 comp rx=0 tx=0).stop 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928102d40 msgr2=0x7fe928198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928102d40 0x7fe928198550 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00d770 tx=0x7fe91c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 shutdown_connections 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fe9180a3240 0x7fe9180a5700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe92810c170 0x7fe92819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe928103660 0x7fe928198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 --2- 172.21.15.1:0/2911782751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe928102d40 0x7fe928198550 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 >> 172.21.15.1:0/2911782751 conn(0x7fe9280fc7a0 msgr2=0x7fe9280fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 shutdown_connections 2024-09-19T09:08:02.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:02.102+0000 7fe92edb8640 1 -- 172.21.15.1:0/2911782751 wait complete. 2024-09-19T09:08:03.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:02 smithi001 ceph-mon[30939]: scrub queued for path: / 2024-09-19T09:08:03.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:02 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:03.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:02 smithi001 ceph-mon[30939]: scrub summary: active paths [/] 2024-09-19T09:08:03.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:02 smithi001 ceph-mon[30939]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:03.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:02 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2911782751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:03.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:02 smithi001 ceph-mon[30939]: scrub summary: idle 2024-09-19T09:08:03.039 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24500 quiesce db --cancel --all' 2024-09-19T09:08:03.039 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24500 quiesce db --cancel --all 2024-09-19T09:08:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:02 smithi064 ceph-mon[35179]: scrub queued for path: / 2024-09-19T09:08:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:02 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:02 smithi064 ceph-mon[35179]: scrub summary: active paths [/] 2024-09-19T09:08:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:02 smithi064 ceph-mon[35179]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:02 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2911782751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:03.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:02 smithi064 ceph-mon[35179]: scrub summary: idle 2024-09-19T09:08:03.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:02 smithi022 ceph-mon[35107]: scrub queued for path: / 2024-09-19T09:08:03.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:02 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:03.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:02 smithi022 ceph-mon[35107]: scrub summary: active paths [/] 2024-09-19T09:08:03.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:02 smithi022 ceph-mon[35107]: scrub summary: idle+waiting paths [/] 2024-09-19T09:08:03.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:02 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2911782751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:03.210 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:02 smithi022 ceph-mon[35107]: scrub summary: idle 2024-09-19T09:08:03.390 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:08:03.434 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:03.440 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:03.965 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:03 smithi001 ceph-mon[30939]: pgmap v456: 97 pgs: 97 active+clean; 32 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 559 op/s 2024-09-19T09:08:04.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:03 smithi064 ceph-mon[35179]: pgmap v456: 97 pgs: 97 active+clean; 32 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 559 op/s 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 -- 172.21.15.1:0/3934629405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c10c170 msgr2=0x7f278c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 --2- 172.21.15.1:0/3934629405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c10c170 0x7f278c10e610 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2784009ca0 tx=0x7f278402a950 comp rx=0 tx=0).stop 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 -- 172.21.15.1:0/3934629405 shutdown_connections 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 --2- 172.21.15.1:0/3934629405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c10c170 0x7f278c10e610 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 --2- 172.21.15.1:0/3934629405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f278c103660 0x7f278c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 --2- 172.21.15.1:0/3934629405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f278c102d40 0x7f278c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 -- 172.21.15.1:0/3934629405 >> 172.21.15.1:0/3934629405 conn(0x7f278c0fc7a0 msgr2=0x7f278c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 -- 172.21.15.1:0/3934629405 shutdown_connections 2024-09-19T09:08:04.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.142+0000 7f27942cb640 1 -- 172.21.15.1:0/3934629405 wait complete. 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.143+0000 7f27942cb640 1 Processor -- start 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.143+0000 7f27942cb640 1 -- start start 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.143+0000 7f27942cb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f278c102d40 0x7f278c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.143+0000 7f27942cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c103660 0x7f278c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.143+0000 7f27942cb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f278c10c170 0x7f278c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.143+0000 7f27942cb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f278c112090 con 0x7f278c103660 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.143+0000 7f27942cb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f278c111f10 con 0x7f278c102d40 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.143+0000 7f27942cb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f278c112210 con 0x7f278c10c170 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2791866640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c103660 0x7f278c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2791866640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c103660 0x7f278c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43282/0 (socket says 172.21.15.1:43282) 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2792067640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f278c102d40 0x7f278c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2791866640 1 -- 172.21.15.1:0/2707237271 learned_addr learned my addr 172.21.15.1:0/2707237271 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2792868640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f278c10c170 0x7f278c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2792067640 1 -- 172.21.15.1:0/2707237271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f278c10c170 msgr2=0x7f278c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2792067640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f278c10c170 0x7f278c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2792067640 1 -- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c103660 msgr2=0x7f278c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2792067640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c103660 0x7f278c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2792067640 1 -- 172.21.15.1:0/2707237271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c19d480 con 0x7f278c102d40 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f2792067640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f278c102d40 0x7f278c1984d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2788009b50 tx=0x7f278800b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.144+0000 7f27837fe640 1 -- 172.21.15.1:0/2707237271 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788009e50 con 0x7f278c102d40 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.145+0000 7f27837fe640 1 -- 172.21.15.1:0/2707237271 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2788005520 con 0x7f278c102d40 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.145+0000 7f27942cb640 1 -- 172.21.15.1:0/2707237271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c19d770 con 0x7f278c102d40 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.145+0000 7f27837fe640 1 -- 172.21.15.1:0/2707237271 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788019670 con 0x7f278c102d40 2024-09-19T09:08:04.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.145+0000 7f27942cb640 1 -- 172.21.15.1:0/2707237271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c1008d0 con 0x7f278c102d40 2024-09-19T09:08:04.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.147+0000 7f27837fe640 1 -- 172.21.15.1:0/2707237271 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f2788020020 con 0x7f278c102d40 2024-09-19T09:08:04.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.147+0000 7f27966a4740 1 Processor -- start 2024-09-19T09:08:04.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.147+0000 7f27966a4740 1 -- start start 2024-09-19T09:08:04.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f27966a4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3edfcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f27966a4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee07400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f27966a4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee09d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f27966a4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562d3ed622a0 con 0x562d3edfd080 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f27966a4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562d3ed09b10 con 0x562d3ee07940 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f27966a4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562d3ed5e260 con 0x562d3edfc760 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f2792067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee07400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f2792868640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3edfcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f2792868640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3edfcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:34710/0 (socket says 172.21.15.1:34710) 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f2792067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee07400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43284/0 (socket says 172.21.15.1:43284) 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f2792868640 1 -- 172.21.15.1:0/2004903231 learned_addr learned my addr 172.21.15.1:0/2004903231 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.148+0000 7f2791866640 1 --2- 172.21.15.1:0/2004903231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee09d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2792067640 1 -- 172.21.15.1:0/2004903231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 msgr2=0x562d3edfcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f27837fe640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27780a3460 0x7f27780a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2792067640 1 --2- 172.21.15.1:0/2004903231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3edfcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2792067640 1 -- 172.21.15.1:0/2004903231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 msgr2=0x562d3ee09d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2792067640 1 --2- 172.21.15.1:0/2004903231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee09d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2792067640 1 -- 172.21.15.1:0/2004903231 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3ead3b90 con 0x562d3edfd080 2024-09-19T09:08:04.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2792868640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27780a3460 0x7f27780a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f27837fe640 1 -- 172.21.15.1:0/2707237271 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f27880d3300 con 0x7f278c102d40 2024-09-19T09:08:04.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2792868640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27780a3460 0x7f27780a5920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2784035000 tx=0x7f278403c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2792067640 1 --2- 172.21.15.1:0/2004903231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee07400 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f27880d0d20 tx=0x7f278809b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96326713357aa9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.149+0000 7f2780dea640 1 -- 172.21.15.1:0/2004903231 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278809f670 con 0x562d3edfd080 2024-09-19T09:08:04.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f2780dea640 1 -- 172.21.15.1:0/2004903231 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f278809ffa0 con 0x562d3edfd080 2024-09-19T09:08:04.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f2780dea640 1 -- 172.21.15.1:0/2004903231 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278809f200 con 0x562d3edfd080 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f27966a4740 1 -- 172.21.15.1:0/2004903231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 msgr2=0x562d3ee07400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f27966a4740 1 --2- 172.21.15.1:0/2004903231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee07400 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f27880d0d20 tx=0x7f278809b970 comp rx=0 tx=0).stop 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f27966a4740 1 -- 172.21.15.1:0/2004903231 shutdown_connections 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f27966a4740 1 --2- 172.21.15.1:0/2004903231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee09d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f27966a4740 1 --2- 172.21.15.1:0/2004903231 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee07400 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f27966a4740 1 --2- 172.21.15.1:0/2004903231 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3edfcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f27966a4740 1 -- 172.21.15.1:0/2004903231 >> 172.21.15.1:0/2004903231 conn(0x562d3edf8cf0 msgr2=0x562d3edf90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.150+0000 7f27966a4740 1 -- 172.21.15.1:0/2004903231 shutdown_connections 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.151+0000 7f27966a4740 1 -- 172.21.15.1:0/2004903231 wait complete. 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.151+0000 7f27966a4740 1 -- start start 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.151+0000 7f27966a4740 1 Processor -- start 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.151+0000 7f27966a4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.151+0000 7f27966a4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 0x562d3ee04d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.151+0000 7f27966a4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee05250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f27966a4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562d3ee0a510 con 0x562d3edfc760 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f27966a4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562d3ecea6e0 con 0x562d3ee07940 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f27966a4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562d3ee0a690 con 0x562d3edfd080 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f27966a4740 10 client.0 _ll_register_callbacks cb 0x562d3ed0ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee05250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee05250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:55484/0 (socket says 172.21.15.1:55484) 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43286/0 (socket says 172.21.15.1:43286) 2024-09-19T09:08:04.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 -- 172.21.15.1:0/3307942740 learned_addr learned my addr 172.21.15.1:0/3307942740 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2791866640 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 0x562d3ee04d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 -- 172.21.15.1:0/3307942740 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 msgr2=0x562d3ee04d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 0x562d3ee04d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 -- 172.21.15.1:0/3307942740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 msgr2=0x562d3ee047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 -- 172.21.15.1:0/3307942740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3ee139b0 con 0x562d3ee07940 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2792868640 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee05250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f278402fd50 tx=0x7f2784005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4117473d3a3017ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.152+0000 7f2775ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.153+0000 7f2775ffb640 1 -- 172.21.15.1:0/3307942740 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784034040 con 0x562d3ee07940 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.153+0000 7f27966a4740 1 -- 172.21.15.1:0/3307942740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f278809ffa0 con 0x562d3ee07940 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.153+0000 7f2775ffb640 1 -- 172.21.15.1:0/3307942740 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2784004050 con 0x562d3ee07940 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.153+0000 7f2775ffb640 1 -- 172.21.15.1:0/3307942740 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2784003e40 con 0x562d3ee07940 2024-09-19T09:08:04.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.153+0000 7f27966a4740 10 client.26084 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:04.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.153+0000 7f27966a4740 1 -- 172.21.15.1:0/3307942740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d3ee16320 con 0x562d3ee07940 2024-09-19T09:08:04.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.153+0000 7f2775ffb640 1 -- 172.21.15.1:0/3307942740 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f278809ffa0 con 0x562d3ee07940 2024-09-19T09:08:04.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.153+0000 7f2775ffb640 1 -- 172.21.15.1:0/3307942740 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2784030b40 con 0x562d3ee07940 2024-09-19T09:08:04.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f27966a4740 10 client.26084 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:04.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f27966a4740 10 client.26084 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f27966a4740 20 client.26084 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f27966a4740 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d3ee17860 0x562d3ee19c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f27966a4740 4 client.26084 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f27966a4740 1 -- 172.21.15.1:0/3307942740 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d3ed6f9d0 con 0x562d3ee17860 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f2792067640 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d3ee17860 0x562d3ee19c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f2775ffb640 10 client.26084 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.154+0000 7f2792067640 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d3ee17860 0x562d3ee19c80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f460fb81c4c00663 server_cookie=68162f8970c0da8 in_seq=0 out_seq=0 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f2775ffb640 1 -- 172.21.15.1:0/3307942740 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d3ed6f9d0 con 0x562d3ee17860 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f2775ffb640 10 client.26084 handle_command_reply: tid=0 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 client.26084 shutdown 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 -- 172.21.15.1:0/3307942740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 msgr2=0x562d3ee05250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee05250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f278402fd50 tx=0x7f2784005ef0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 -- 172.21.15.1:0/3307942740 shutdown_connections 2024-09-19T09:08:04.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d3ee17860 0x562d3ee19c80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee05250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 0x562d3ee04d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f2775ffb640 0 client.26084 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 --2- 172.21.15.1:0/3307942740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.155+0000 7f27966a4740 1 -- 172.21.15.1:0/3307942740 >> 172.21.15.1:0/3307942740 conn(0x562d3edf8cf0 msgr2=0x562d3edfe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.156+0000 7f27966a4740 1 -- 172.21.15.1:0/3307942740 shutdown_connections 2024-09-19T09:08:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.156+0000 7f27966a4740 1 -- 172.21.15.1:0/3307942740 wait complete. 2024-09-19T09:08:04.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.156+0000 7f27966a4740 20 client.26084 trim_cache size 0 max 16384 2024-09-19T09:08:04.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f27966a4740 1 Processor -- start 2024-09-19T09:08:04.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f27966a4740 1 -- start start 2024-09-19T09:08:04.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f27966a4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee1f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f27966a4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 0x562d3ee1fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f27966a4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee01a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f27966a4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f278c1ade60 con 0x562d3edfc760 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f27966a4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f278c1ab670 con 0x562d3ee07940 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f27966a4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f278c1a94c0 con 0x562d3edfd080 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee1f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee1f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43292/0 (socket says 172.21.15.1:43292) 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792067640 1 -- 172.21.15.1:0/1274757171 learned_addr learned my addr 172.21.15.1:0/1274757171 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2791866640 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 0x562d3ee1fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792868640 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee01a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792067640 1 -- 172.21.15.1:0/1274757171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 msgr2=0x562d3ee1fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792067640 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 0x562d3ee1fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792067640 1 -- 172.21.15.1:0/1274757171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 msgr2=0x562d3ee01a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792067640 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee01a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792067640 1 -- 172.21.15.1:0/1274757171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3edf8b20 con 0x562d3edfc760 2024-09-19T09:08:04.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.174+0000 7f2792868640 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee01a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:04.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.175+0000 7f2792067640 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee1f590 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f278809bd00 tx=0x7f27880107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea5321d84674ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.175+0000 7f2777fff640 1 -- 172.21.15.1:0/1274757171 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27880b8070 con 0x562d3edfc760 2024-09-19T09:08:04.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.175+0000 7f2777fff640 1 -- 172.21.15.1:0/1274757171 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f278809ffa0 con 0x562d3edfc760 2024-09-19T09:08:04.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.175+0000 7f2777fff640 1 -- 172.21.15.1:0/1274757171 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278809f3e0 con 0x562d3edfc760 2024-09-19T09:08:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- 172.21.15.1:0/1274757171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 msgr2=0x562d3ee1f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee1f590 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f278809bd00 tx=0x7f27880107d0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- 172.21.15.1:0/1274757171 shutdown_connections 2024-09-19T09:08:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee01a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfd080 0x562d3ee1fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 --2- 172.21.15.1:0/1274757171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfc760 0x562d3ee1f590 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- 172.21.15.1:0/1274757171 >> 172.21.15.1:0/1274757171 conn(0x562d3edf8cf0 msgr2=0x562d3ee06850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- 172.21.15.1:0/1274757171 shutdown_connections 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- 172.21.15.1:0/1274757171 wait complete. 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- start start 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 Processor -- start 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3ee0fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee0c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee0cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f278c1a9b30 con 0x562d3edfd080 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f278c1aafa0 con 0x562d3ee07940 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.176+0000 7f27966a4740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f278c1aa200 con 0x562d3edfc760 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f27966a4740 10 client.0 _ll_register_callbacks cb 0x7f2784009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2792067640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3ee0fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2791866640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee0c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2792067640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3ee0fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:34750/0 (socket says 172.21.15.1:34750) 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2791866640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee0c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43302/0 (socket says 172.21.15.1:43302) 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2792067640 1 -- 172.21.15.1:0/2391085967 learned_addr learned my addr 172.21.15.1:0/2391085967 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2792868640 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee0cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2791866640 1 -- 172.21.15.1:0/2391085967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 msgr2=0x562d3ee0fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2791866640 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3ee0fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2791866640 1 -- 172.21.15.1:0/2391085967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 msgr2=0x562d3ee0cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2791866640 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee0cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2791866640 1 -- 172.21.15.1:0/2391085967 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3edf9980 con 0x562d3edfd080 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2791866640 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee0c8b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x562d3ee04060 tx=0x7f277c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f33ce0c47adea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2775ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:04.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2775ffb640 1 -- 172.21.15.1:0/2391085967 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c022020 con 0x562d3edfd080 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f2775ffb640 1 -- 172.21.15.1:0/2391085967 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f277c005020 con 0x562d3edfd080 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.177+0000 7f27966a4740 1 -- 172.21.15.1:0/2391085967 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f278809ffa0 con 0x562d3edfd080 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f2775ffb640 1 -- 172.21.15.1:0/2391085967 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f277c009e20 con 0x562d3edfd080 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f27966a4740 10 client.16623 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f27966a4740 1 -- 172.21.15.1:0/2391085967 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d3edf4260 con 0x562d3edfd080 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f2775ffb640 1 -- 172.21.15.1:0/2391085967 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f278809ffa0 con 0x562d3edfd080 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f2775ffb640 1 -- 172.21.15.1:0/2391085967 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f277c01e440 con 0x562d3edfd080 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f27966a4740 10 client.16623 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f27966a4740 10 client.16623 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f27966a4740 20 client.16623 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f27966a4740 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d3ee837c0 0x562d3ee85be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f27966a4740 4 client.16623 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f27966a4740 1 -- 172.21.15.1:0/2391085967 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x562d3ed69d20 con 0x562d3ee837c0 2024-09-19T09:08:04.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.178+0000 7f2792067640 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d3ee837c0 0x562d3ee85be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.179+0000 7f2792067640 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d3ee837c0 0x562d3ee85be0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2b878ceef274b4a server_cookie=249484e092edf337 in_seq=0 out_seq=0 2024-09-19T09:08:04.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.179+0000 7f2775ffb640 10 client.16623 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f2775ffb640 1 -- 172.21.15.1:0/2391085967 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562d3ed69d20 con 0x562d3ee837c0 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f2775ffb640 10 client.16623 handle_command_reply: tid=0 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 client.16623 shutdown 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 -- 172.21.15.1:0/2391085967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 msgr2=0x562d3ee0c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee0c8b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x562d3ee04060 tx=0x7f277c00f790 comp rx=0 tx=0).stop 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 -- 172.21.15.1:0/2391085967 shutdown_connections 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x562d3ee837c0 0x562d3ee85be0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562d3ee07940 0x562d3ee0cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562d3edfd080 0x562d3ee0c8b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f2775ffb640 0 client.16623 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 --2- 172.21.15.1:0/2391085967 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562d3edfc760 0x562d3ee0fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 -- 172.21.15.1:0/2391085967 >> 172.21.15.1:0/2391085967 conn(0x562d3edf8cf0 msgr2=0x562d3ee04790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 -- 172.21.15.1:0/2391085967 shutdown_connections 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 1 -- 172.21.15.1:0/2391085967 wait complete. 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.184+0000 7f27966a4740 20 client.16623 trim_cache size 0 max 16384 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 28, 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 18, 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "b6c3296d": { 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 18, 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:08:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:04.189 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 -- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27780a3460 msgr2=0x7f27780a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27780a3460 0x7f27780a5920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2784035000 tx=0x7f278403c040 comp rx=0 tx=0).stop 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 -- 172.21.15.1:0/2707237271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f278c102d40 msgr2=0x7f278c1984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f278c102d40 0x7f278c1984d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2788009b50 tx=0x7f278800b690 comp rx=0 tx=0).stop 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 -- 172.21.15.1:0/2707237271 shutdown_connections 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27780a3460 0x7f27780a5920 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f278c10c170 0x7f278c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f278c103660 0x7f278c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 --2- 172.21.15.1:0/2707237271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f278c102d40 0x7f278c1984d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 -- 172.21.15.1:0/2707237271 >> 172.21.15.1:0/2707237271 conn(0x7f278c0fc7a0 msgr2=0x7f278c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 -- 172.21.15.1:0/2707237271 shutdown_connections 2024-09-19T09:08:04.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.185+0000 7f27942cb640 1 -- 172.21.15.1:0/2707237271 wait complete. 2024-09-19T09:08:04.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:03 smithi022 ceph-mon[35107]: pgmap v456: 97 pgs: 97 active+clean; 32 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.4 MiB/s wr, 559 op/s 2024-09-19T09:08:04.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 -- 172.21.15.1:0/1604762081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4102ef0 msgr2=0x7efdb410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 --2- 172.21.15.1:0/1604762081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4102ef0 0x7efdb410da40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efdac009ca0 tx=0x7efdac02a950 comp rx=0 tx=0).stop 2024-09-19T09:08:04.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 -- 172.21.15.1:0/1604762081 shutdown_connections 2024-09-19T09:08:04.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 --2- 172.21.15.1:0/1604762081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4102ef0 0x7efdb410da40 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 --2- 172.21.15.1:0/1604762081 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdb4102570 0x7efdb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 --2- 172.21.15.1:0/1604762081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdb4100e20 0x7efdb4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 -- 172.21.15.1:0/1604762081 >> 172.21.15.1:0/1604762081 conn(0x7efdb40fc7d0 msgr2=0x7efdb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 -- 172.21.15.1:0/1604762081 shutdown_connections 2024-09-19T09:08:04.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 -- 172.21.15.1:0/1604762081 wait complete. 2024-09-19T09:08:04.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.337+0000 7efdb95e2640 1 Processor -- start 2024-09-19T09:08:04.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb95e2640 1 -- start start 2024-09-19T09:08:04.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb95e2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4100e20 0x7efdb4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb95e2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdb4102570 0x7efdb4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb95e2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdb4102ef0 0x7efdb419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb95e2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41110a0 con 0x7efdb4100e20 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb95e2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efdb4110f20 con 0x7efdb4102ef0 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb95e2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efdb4111220 con 0x7efdb4102570 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4100e20 0x7efdb4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4100e20 0x7efdb4198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43316/0 (socket says 172.21.15.1:43316) 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb2ffd640 1 -- 172.21.15.1:0/3344878601 learned_addr learned my addr 172.21.15.1:0/3344878601 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb27fc640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdb4102570 0x7efdb4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.338+0000 7efdb37fe640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdb4102ef0 0x7efdb419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb2ffd640 1 -- 172.21.15.1:0/3344878601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdb4102570 msgr2=0x7efdb4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdb4102570 0x7efdb4198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb2ffd640 1 -- 172.21.15.1:0/3344878601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdb4102ef0 msgr2=0x7efdb419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdb4102ef0 0x7efdb419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb2ffd640 1 -- 172.21.15.1:0/3344878601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb419d4e0 con 0x7efdb4100e20 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb27fc640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdb4102570 0x7efdb4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb37fe640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdb4102ef0 0x7efdb419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4100e20 0x7efdb4198530 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efda400c890 tx=0x7efda400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efd9bfff640 1 -- 172.21.15.1:0/3344878601 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda4004220 con 0x7efdb4100e20 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efd9bfff640 1 -- 172.21.15.1:0/3344878601 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efda40043c0 con 0x7efdb4100e20 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb95e2640 1 -- 172.21.15.1:0/3344878601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb419d7d0 con 0x7efdb4100e20 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efd9bfff640 1 -- 172.21.15.1:0/3344878601 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda4004b10 con 0x7efdb4100e20 2024-09-19T09:08:04.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.339+0000 7efdb95e2640 1 -- 172.21.15.1:0/3344878601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb41a50b0 con 0x7efdb4100e20 2024-09-19T09:08:04.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efd9bfff640 1 -- 172.21.15.1:0/3344878601 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7efda40051b0 con 0x7efdb4100e20 2024-09-19T09:08:04.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdbb9bb740 1 Processor -- start 2024-09-19T09:08:04.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdbb9bb740 1 -- start start 2024-09-19T09:08:04.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdba00 0x5599e7bdbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7be8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5599e7b40200 con 0x5599e7bdba00 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5599e7ae6dc0 con 0x5599e7be6be0 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5599e7b3c1c0 con 0x5599e7bdc320 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdb37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdba00 0x5599e7bdbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdb37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdba00 0x5599e7bdbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43324/0 (socket says 172.21.15.1:43324) 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.342+0000 7efdb37fe640 1 -- 172.21.15.1:0/3979806618 learned_addr learned my addr 172.21.15.1:0/3979806618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efd9bfff640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efd9c0a32c0 0x7efd9c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb27fc640 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7be8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb37fe640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efd9c0a32c0 0x7efd9c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efd9bfff640 1 -- 172.21.15.1:0/3344878601 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7efda40cf900 con 0x7efdb4100e20 2024-09-19T09:08:04.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb37fe640 1 -- 172.21.15.1:0/3979806618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 msgr2=0x5599e7be66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb37fe640 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb37fe640 1 -- 172.21.15.1:0/3979806618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 msgr2=0x5599e7be8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb37fe640 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7be8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb37fe640 1 -- 172.21.15.1:0/3979806618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e78b1620 con 0x5599e7bdba00 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb27fc640 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7be8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.343+0000 7efdb37fe640 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdba00 0x5599e7bdbde0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efdac02fe40 tx=0x7efdac02f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80586c51d8ff5340 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efdb37fe640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efd9c0a32c0 0x7efd9c0a5780 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efdac02f650 tx=0x7efdac049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efd997fa640 1 -- 172.21.15.1:0/3979806618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac04f070 con 0x5599e7bdba00 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efd997fa640 1 -- 172.21.15.1:0/3979806618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdac0043f0 con 0x5599e7bdba00 2024-09-19T09:08:04.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efd997fa640 1 -- 172.21.15.1:0/3979806618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac034040 con 0x5599e7bdba00 2024-09-19T09:08:04.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efdbb9bb740 1 -- 172.21.15.1:0/3979806618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdba00 msgr2=0x5599e7bdbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdba00 0x5599e7bdbde0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efdac02fe40 tx=0x7efdac02f5e0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efdbb9bb740 1 -- 172.21.15.1:0/3979806618 shutdown_connections 2024-09-19T09:08:04.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7be8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/3979806618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdba00 0x5599e7bdbde0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.344+0000 7efdbb9bb740 1 -- 172.21.15.1:0/3979806618 >> 172.21.15.1:0/3979806618 conn(0x5599e7bd7f90 msgr2=0x5599e7bd8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.345+0000 7efdbb9bb740 1 -- 172.21.15.1:0/3979806618 shutdown_connections 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.345+0000 7efdbb9bb740 1 -- 172.21.15.1:0/3979806618 wait complete. 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.345+0000 7efdbb9bb740 1 -- start start 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.345+0000 7efdbb9bb740 1 Processor -- start 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.346+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdba00 0x5599e7be64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.346+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.346+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7be3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.346+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5599e7be97b0 con 0x5599e7be6be0 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.346+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5599e7adac50 con 0x5599e7bdba00 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdba00 0x5599e7be64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.346+0000 7efdb27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.346+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5599e7be9930 con 0x5599e7bdc320 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.346+0000 7efdb37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7be3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:34780/0 (socket says 172.21.15.1:34780) 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7be3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43338/0 (socket says 172.21.15.1:43338) 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb27fc640 1 -- 172.21.15.1:0/2524279656 learned_addr learned my addr 172.21.15.1:0/2524279656 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdbb9bb740 10 client.0 _ll_register_callbacks cb 0x5599e7aecba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb37fe640 1 -- 172.21.15.1:0/2524279656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 msgr2=0x5599e7be3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb37fe640 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb37fe640 1 -- 172.21.15.1:0/2524279656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdba00 msgr2=0x5599e7be64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb37fe640 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdba00 0x5599e7be64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb37fe640 1 -- 172.21.15.1:0/2524279656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e7be44c0 con 0x5599e7be6be0 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdba00 0x5599e7be64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.347+0000 7efdb37fe640 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7be3c90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efdac009a60 tx=0x7efdac049470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db493e0fde048c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efd96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efd96ff5640 1 -- 172.21.15.1:0/2524279656 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac04f030 con 0x5599e7be6be0 2024-09-19T09:08:04.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efd96ff5640 1 -- 172.21.15.1:0/2524279656 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7efdac049940 con 0x5599e7be6be0 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2524279656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdac0043f0 con 0x5599e7be6be0 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efd96ff5640 1 -- 172.21.15.1:0/2524279656 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efdac0047d0 con 0x5599e7be6be0 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efdbb9bb740 10 client.16635 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2524279656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5599e7be97b0 con 0x5599e7be6be0 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efd96ff5640 1 -- 172.21.15.1:0/2524279656 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdac0043f0 con 0x5599e7be6be0 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efd96ff5640 1 -- 172.21.15.1:0/2524279656 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7efdac039a50 con 0x5599e7be6be0 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efdbb9bb740 10 client.16635 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efdbb9bb740 10 client.16635 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.348+0000 7efdbb9bb740 20 client.16635 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.349+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599e7bfeba0 0x5599e7c00f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.349+0000 7efdbb9bb740 4 client.16635 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.349+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2524279656 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599e7b4d770 con 0x5599e7bfeba0 2024-09-19T09:08:04.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.349+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599e7bfeba0 0x5599e7c00f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.349+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599e7bfeba0 0x5599e7c00f90 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e01872354c0cda server_cookie=34028688d393b740 in_seq=0 out_seq=0 2024-09-19T09:08:04.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.349+0000 7efd96ff5640 10 client.16635 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efd96ff5640 1 -- 172.21.15.1:0/2524279656 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599e7b4d770 con 0x5599e7bfeba0 2024-09-19T09:08:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efd96ff5640 10 client.16635 handle_command_reply: tid=0 2024-09-19T09:08:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 client.16635 shutdown 2024-09-19T09:08:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2524279656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 msgr2=0x5599e7be3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7be3c90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efdac009a60 tx=0x7efdac049470 comp rx=0 tx=0).stop 2024-09-19T09:08:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2524279656 shutdown_connections 2024-09-19T09:08:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599e7bfeba0 0x5599e7c00f90 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7be3c90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdc320 0x5599e7be3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2524279656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdba00 0x5599e7be64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efd96ff5640 0 client.16635 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.350+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2524279656 >> 172.21.15.1:0/2524279656 conn(0x5599e7bd7f90 msgr2=0x5599e7bd71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.351+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2524279656 shutdown_connections 2024-09-19T09:08:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.351+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2524279656 wait complete. 2024-09-19T09:08:04.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.351+0000 7efdbb9bb740 20 client.16635 trim_cache size 0 max 16384 2024-09-19T09:08:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdbb9bb740 1 Processor -- start 2024-09-19T09:08:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdbb9bb740 1 -- start start 2024-09-19T09:08:04.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7bf2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdc320 0x5599e7be56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7c06700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41adf30 con 0x5599e7bdc320 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41ab740 con 0x5599e7be6be0 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41a9590 con 0x5599e7bdba00 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdb27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdc320 0x5599e7be56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdb27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdc320 0x5599e7be56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43344/0 (socket says 172.21.15.1:43344) 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdb27fc640 1 -- 172.21.15.1:0/2585083123 learned_addr learned my addr 172.21.15.1:0/2585083123 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7bf2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdb37fe640 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7c06700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.368+0000 7efdb27fc640 1 -- 172.21.15.1:0/2585083123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 msgr2=0x5599e7bf2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efdb27fc640 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7bf2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efdb27fc640 1 -- 172.21.15.1:0/2585083123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 msgr2=0x5599e7c06700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efdb27fc640 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7c06700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efdb27fc640 1 -- 172.21.15.1:0/2585083123 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e7bdc150 con 0x5599e7bdc320 2024-09-19T09:08:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7bf2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efdb27fc640 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdc320 0x5599e7be56c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7efda8004170 tx=0x7efda80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5ff0f156090328 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efd98ff9640 1 -- 172.21.15.1:0/2585083123 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8003da0 con 0x5599e7bdc320 2024-09-19T09:08:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efd98ff9640 1 -- 172.21.15.1:0/2585083123 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efda8005520 con 0x5599e7bdc320 2024-09-19T09:08:04.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.369+0000 7efd98ff9640 1 -- 172.21.15.1:0/2585083123 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda801c6d0 con 0x5599e7bdc320 2024-09-19T09:08:04.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2585083123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdc320 msgr2=0x5599e7be56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdc320 0x5599e7be56c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7efda8004170 tx=0x7efda80035f0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2585083123 shutdown_connections 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7be6be0 0x5599e7c06700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7bdc320 0x5599e7be56c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/2585083123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7bf2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2585083123 >> 172.21.15.1:0/2585083123 conn(0x5599e7bd7f90 msgr2=0x5599e7be4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2585083123 shutdown_connections 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- 172.21.15.1:0/2585083123 wait complete. 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- start start 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 Processor -- start 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7beaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdc320 0x5599e7beaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7beb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41a9c00 con 0x5599e7be6be0 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41ab070 con 0x5599e7bdc320 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41aa2d0 con 0x5599e7bdba00 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.370+0000 7efdbb9bb740 10 client.0 _ll_register_callbacks cb 0x7efdac009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7beb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7beb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43350/0 (socket says 172.21.15.1:43350) 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 -- 172.21.15.1:0/1024098882 learned_addr learned my addr 172.21.15.1:0/1024098882 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7beaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb27fc640 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdc320 0x5599e7beaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 -- 172.21.15.1:0/1024098882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 msgr2=0x5599e7beaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7beaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 -- 172.21.15.1:0/1024098882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdc320 msgr2=0x5599e7beaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:04.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdc320 0x5599e7beaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 -- 172.21.15.1:0/1024098882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e7c68830 con 0x5599e7be6be0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdb37fe640 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7beb4a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efdac039e70 tx=0x7efdac02fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba1fb456068972e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efd96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efd96ff5640 1 -- 172.21.15.1:0/1024098882 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac04f070 con 0x5599e7be6be0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efd96ff5640 1 -- 172.21.15.1:0/1024098882 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7efdac049810 con 0x5599e7be6be0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdbb9bb740 1 -- 172.21.15.1:0/1024098882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efda8005520 con 0x5599e7be6be0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efd96ff5640 1 -- 172.21.15.1:0/1024098882 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efdac049a10 con 0x5599e7be6be0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdbb9bb740 10 client.16641 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.371+0000 7efdbb9bb740 1 -- 172.21.15.1:0/1024098882 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5599e7c69ad0 con 0x5599e7be6be0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efd96ff5640 1 -- 172.21.15.1:0/1024098882 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efda8005520 con 0x5599e7be6be0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efd96ff5640 1 -- 172.21.15.1:0/1024098882 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7efdac0304d0 con 0x5599e7be6be0 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efdbb9bb740 10 client.16641 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efdbb9bb740 10 client.16641 resolve_mds: validated gid 24500 aka daemon mds.b 2024-09-19T09:08:04.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efdbb9bb740 20 client.16641 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599e7c6a1b0 0x5599e7c6c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efdbb9bb740 4 client.16641 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efdbb9bb740 1 -- 172.21.15.1:0/1024098882 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5599e7b47c80 con 0x5599e7c6a1b0 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.372+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599e7c6a1b0 0x5599e7c6c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efd96ff5640 10 client.16641 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdb2ffd640 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599e7c6a1b0 0x5599e7c6c5d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf44967be2d7c53a server_cookie=dc7b49b2d25d5964 in_seq=0 out_seq=0 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efd96ff5640 1 -- 172.21.15.1:0/1024098882 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5599e7b47c80 con 0x5599e7c6a1b0 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efd96ff5640 10 client.16641 handle_command_reply: tid=0 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 client.16641 shutdown 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 -- 172.21.15.1:0/1024098882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 msgr2=0x5599e7beb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7beb4a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7efdac039e70 tx=0x7efdac02fe20 comp rx=0 tx=0).stop 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 -- 172.21.15.1:0/1024098882 shutdown_connections 2024-09-19T09:08:04.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5599e7c6a1b0 0x5599e7c6c5d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efd96ff5640 0 client.16641 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5599e7be6be0 0x5599e7beb4a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5599e7bdc320 0x5599e7beaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 --2- 172.21.15.1:0/1024098882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5599e7bdba00 0x5599e7beaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 -- 172.21.15.1:0/1024098882 >> 172.21.15.1:0/1024098882 conn(0x5599e7bd7f90 msgr2=0x5599e7bd71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 -- 172.21.15.1:0/1024098882 shutdown_connections 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 1 -- 172.21.15.1:0/1024098882 wait complete. 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.373+0000 7efdbb9bb740 20 client.16641 trim_cache size 0 max 16384 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 28, 2024-09-19T09:08:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24500, 2024-09-19T09:08:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 19, 2024-09-19T09:08:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": {} 2024-09-19T09:08:04.380 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:04.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 -- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efd9c0a32c0 msgr2=0x7efd9c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efd9c0a32c0 0x7efd9c0a5780 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efdac02f650 tx=0x7efdac049000 comp rx=0 tx=0).stop 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 -- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4100e20 msgr2=0x7efdb4198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4100e20 0x7efdb4198530 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efda400c890 tx=0x7efda400cd50 comp rx=0 tx=0).stop 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 -- 172.21.15.1:0/3344878601 shutdown_connections 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdb4102ef0 0x7efdb419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7efd9c0a32c0 0x7efd9c0a5780 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efdb4102570 0x7efdb4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 --2- 172.21.15.1:0/3344878601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efdb4100e20 0x7efdb4198530 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 -- 172.21.15.1:0/3344878601 >> 172.21.15.1:0/3344878601 conn(0x7efdb40fc7d0 msgr2=0x7efdb406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 -- 172.21.15.1:0/3344878601 shutdown_connections 2024-09-19T09:08:04.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:04.374+0000 7efdb95e2640 1 -- 172.21.15.1:0/3344878601 wait complete. 2024-09-19T09:08:05.185 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b6c3296d', quiesce took 5.8 seconds. Will release after: 24.0 2024-09-19T09:08:05.421 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:05.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:05 smithi001 ceph-mon[30939]: pgmap v457: 97 pgs: 97 active+clean; 31 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 606 op/s 2024-09-19T09:08:05.929 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T09:08:05.929 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T09:08:05.940 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:08:05.949 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T09:08:05.958 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T09:08:06.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:05 smithi064 ceph-mon[35179]: pgmap v457: 97 pgs: 97 active+clean; 31 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 606 op/s 2024-09-19T09:08:06.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:05 smithi022 ceph-mon[35107]: pgmap v457: 97 pgs: 97 active+clean; 31 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 606 op/s 2024-09-19T09:08:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 -- 172.21.15.1:0/1666978607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358106f10 msgr2=0x7fc35810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 --2- 172.21.15.1:0/1666978607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358106f10 0x7fc35810ea90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc350009ca0 tx=0x7fc35002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 -- 172.21.15.1:0/1666978607 shutdown_connections 2024-09-19T09:08:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 --2- 172.21.15.1:0/1666978607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358106f10 0x7fc35810ea90 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 --2- 172.21.15.1:0/1666978607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc358102790 0x7fc3581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 --2- 172.21.15.1:0/1666978607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc358101de0 0x7fc3581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 -- 172.21.15.1:0/1666978607 >> 172.21.15.1:0/1666978607 conn(0x7fc3580fd8c0 msgr2=0x7fc3580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 -- 172.21.15.1:0/1666978607 shutdown_connections 2024-09-19T09:08:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.405+0000 7fc35e251640 1 -- 172.21.15.1:0/1666978607 wait complete. 2024-09-19T09:08:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc35e251640 1 Processor -- start 2024-09-19T09:08:06.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc35e251640 1 -- start start 2024-09-19T09:08:06.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc35e251640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358101de0 0x7fc358198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc35e251640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc358102790 0x7fc358198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc35e251640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc358106f10 0x7fc35819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc35e251640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc358112090 con 0x7fc358101de0 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc35e251640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc358111f10 con 0x7fc358102790 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc35e251640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc358112210 con 0x7fc358106f10 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc3577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358101de0 0x7fc358198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc3577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358101de0 0x7fc358198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43368/0 (socket says 172.21.15.1:43368) 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc3577fe640 1 -- 172.21.15.1:0/4130152293 learned_addr learned my addr 172.21.15.1:0/4130152293 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.406+0000 7fc357fff640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc358106f10 0x7fc35819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc34effd640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc358102790 0x7fc358198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3577fe640 1 -- 172.21.15.1:0/4130152293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc358106f10 msgr2=0x7fc35819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3577fe640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc358106f10 0x7fc35819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3577fe640 1 -- 172.21.15.1:0/4130152293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc358102790 msgr2=0x7fc358198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3577fe640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc358102790 0x7fc358198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3577fe640 1 -- 172.21.15.1:0/4130152293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35819d410 con 0x7fc358101de0 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc34effd640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc358102790 0x7fc358198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3577fe640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358101de0 0x7fc358198500 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc34800e9f0 tx=0x7fc34800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3557fa640 1 -- 172.21.15.1:0/4130152293 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34800cd80 con 0x7fc358101de0 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3557fa640 1 -- 172.21.15.1:0/4130152293 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc348010930 con 0x7fc358101de0 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc35e251640 1 -- 172.21.15.1:0/4130152293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35819d700 con 0x7fc358101de0 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc3557fa640 1 -- 172.21.15.1:0/4130152293 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348018b00 con 0x7fc358101de0 2024-09-19T09:08:06.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.407+0000 7fc35e251640 1 -- 172.21.15.1:0/4130152293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3581a4fe0 con 0x7fc358101de0 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc3557fa640 1 -- 172.21.15.1:0/4130152293 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fc348018ca0 con 0x7fc358101de0 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc36062a740 1 Processor -- start 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc36062a740 1 -- start start 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc36062a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5600851954a0 0x560085195880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc36062a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560085195dc0 0x5600851a0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc36062a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc36062a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5600850fb2e0 con 0x5600851954a0 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc36062a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5600850a2ce0 con 0x5600851a0680 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc36062a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5600850f72a0 con 0x560085195dc0 2024-09-19T09:08:06.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc357fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5600851954a0 0x560085195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc357fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5600851954a0 0x560085195880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43370/0 (socket says 172.21.15.1:43370) 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc357fff640 1 -- 172.21.15.1:0/316709858 learned_addr learned my addr 172.21.15.1:0/316709858 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc3577fe640 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560085195dc0 0x5600851a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc34effd640 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc357fff640 1 -- 172.21.15.1:0/316709858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560085195dc0 msgr2=0x5600851a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc357fff640 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560085195dc0 0x5600851a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc357fff640 1 -- 172.21.15.1:0/316709858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 msgr2=0x5600851a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc357fff640 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.410+0000 7fc357fff640 1 -- 172.21.15.1:0/316709858 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560085087440 con 0x5600851954a0 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.411+0000 7fc3557fa640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3440a3240 0x7fc3440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.411+0000 7fc357fff640 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5600851954a0 0x560085195880 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc3500098b0 tx=0x7fc3500098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139ee916fd367b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.411+0000 7fc3577fe640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3440a3240 0x7fc3440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.411+0000 7fc34dffb640 1 -- 172.21.15.1:0/316709858 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350031db0 con 0x5600851954a0 2024-09-19T09:08:06.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.411+0000 7fc34dffb640 1 -- 172.21.15.1:0/316709858 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc350036040 con 0x5600851954a0 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.411+0000 7fc34dffb640 1 -- 172.21.15.1:0/316709858 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350004430 con 0x5600851954a0 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.411+0000 7fc3557fa640 1 -- 172.21.15.1:0/4130152293 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc3480cfd60 con 0x7fc358101de0 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 -- 172.21.15.1:0/316709858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5600851954a0 msgr2=0x560085195880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc3577fe640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3440a3240 0x7fc3440a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc3480cdbb0 tx=0x7fc348018520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5600851954a0 0x560085195880 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc3500098b0 tx=0x7fc3500098e0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 -- 172.21.15.1:0/316709858 shutdown_connections 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560085195dc0 0x5600851a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 --2- 172.21.15.1:0/316709858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5600851954a0 0x560085195880 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 -- 172.21.15.1:0/316709858 >> 172.21.15.1:0/316709858 conn(0x560085191a30 msgr2=0x560085191e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 -- 172.21.15.1:0/316709858 shutdown_connections 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 -- 172.21.15.1:0/316709858 wait complete. 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.412+0000 7fc36062a740 1 -- start start 2024-09-19T09:08:06.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc36062a740 1 Processor -- start 2024-09-19T09:08:06.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc36062a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851a0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc36062a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x56008519d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc36062a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x56008519d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc36062a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5600851a7420 con 0x560085195dc0 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc36062a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5600850b6050 con 0x5600851a0680 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc36062a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5600851a75a0 con 0x5600851954a0 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc36062a740 10 client.0 _ll_register_callbacks cb 0x5600850f6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc34effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x56008519d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc34effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x56008519d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43378/0 (socket says 172.21.15.1:43378) 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc34effd640 1 -- 172.21.15.1:0/2397347328 learned_addr learned my addr 172.21.15.1:0/2397347328 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc357fff640 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x56008519d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc357fff640 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc34effd640 1 -- 172.21.15.1:0/2397347328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 msgr2=0x5600851a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc34effd640 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc34effd640 1 -- 172.21.15.1:0/2397347328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 msgr2=0x56008519d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:06.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc34effd640 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x56008519d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.413+0000 7fc34effd640 1 -- 172.21.15.1:0/2397347328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560084e6c3c0 con 0x560085195dc0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc34effd640 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x56008519d350 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc340010670 tx=0x7fc340010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435ee8f88aa7cd09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc336ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc336ffd640 1 -- 172.21.15.1:0/2397347328 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340004230 con 0x560085195dc0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc336ffd640 1 -- 172.21.15.1:0/2397347328 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc3400043d0 con 0x560085195dc0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc36062a740 1 -- 172.21.15.1:0/2397347328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc350036040 con 0x560085195dc0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc336ffd640 1 -- 172.21.15.1:0/2397347328 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc340010e70 con 0x560085195dc0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc36062a740 10 client.16653 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc36062a740 1 -- 172.21.15.1:0/2397347328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5600851b2ed0 con 0x560085195dc0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.414+0000 7fc336ffd640 1 -- 172.21.15.1:0/2397347328 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc350036040 con 0x560085195dc0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc336ffd640 1 -- 172.21.15.1:0/2397347328 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc34000f040 con 0x560085195dc0 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc36062a740 10 client.16653 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc36062a740 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:08:06.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc36062a740 20 client.16653 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc36062a740 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5600851b43a0 0x5600851b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc36062a740 4 client.16653 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc36062a740 1 -- 172.21.15.1:0/2397347328 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560085108850 con 0x5600851b43a0 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc357fff640 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5600851b43a0 0x5600851b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc357fff640 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5600851b43a0 0x5600851b67c0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4234793f7d37d55d server_cookie=c9fd19de6769b57f in_seq=0 out_seq=0 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.415+0000 7fc336ffd640 10 client.16653 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc336ffd640 1 -- 172.21.15.1:0/2397347328 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560085108850 con 0x5600851b43a0 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc336ffd640 10 client.16653 handle_command_reply: tid=0 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 client.16653 shutdown 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 -- 172.21.15.1:0/2397347328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 msgr2=0x56008519d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x56008519d350 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc340010670 tx=0x7fc340010b30 comp rx=0 tx=0).stop 2024-09-19T09:08:06.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 -- 172.21.15.1:0/2397347328 shutdown_connections 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5600851b43a0 0x5600851b67c0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x56008519d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x56008519d350 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 --2- 172.21.15.1:0/2397347328 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc336ffd640 0 client.16653 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 -- 172.21.15.1:0/2397347328 >> 172.21.15.1:0/2397347328 conn(0x560085191a30 msgr2=0x560085197710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 -- 172.21.15.1:0/2397347328 shutdown_connections 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.416+0000 7fc36062a740 1 -- 172.21.15.1:0/2397347328 wait complete. 2024-09-19T09:08:06.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.417+0000 7fc36062a740 20 client.16653 trim_cache size 0 max 16384 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc36062a740 1 Processor -- start 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc36062a740 1 -- start start 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc36062a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc36062a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x560085197600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc36062a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851bc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc36062a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581ade00 con 0x560085195dc0 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc36062a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581ab610 con 0x5600851a0680 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc36062a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581a9460 con 0x5600851954a0 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:34850/0 (socket says 172.21.15.1:34850) 2024-09-19T09:08:06.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 -- 172.21.15.1:0/1927591529 learned_addr learned my addr 172.21.15.1:0/1927591529 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc34effd640 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x560085197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851bc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 -- 172.21.15.1:0/1927591529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 msgr2=0x5600851bc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851bc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 -- 172.21.15.1:0/1927591529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 msgr2=0x560085197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x560085197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.435+0000 7fc357fff640 1 -- 172.21.15.1:0/1927591529 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008519c300 con 0x5600851954a0 2024-09-19T09:08:06.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.436+0000 7fc357fff640 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851b0760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc350009bf0 tx=0x7fc350004140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=addcd4fc42d5445f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:06.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.436+0000 7fc34d7fa640 1 -- 172.21.15.1:0/1927591529 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350031bb0 con 0x5600851954a0 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.436+0000 7fc34d7fa640 1 -- 172.21.15.1:0/1927591529 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc350036070 con 0x5600851954a0 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.436+0000 7fc34d7fa640 1 -- 172.21.15.1:0/1927591529 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350004530 con 0x5600851954a0 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 -- 172.21.15.1:0/1927591529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 msgr2=0x5600851b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851b0760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc350009bf0 tx=0x7fc350004140 comp rx=0 tx=0).stop 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 -- 172.21.15.1:0/1927591529 shutdown_connections 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851bc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x560085197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 --2- 172.21.15.1:0/1927591529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851b0760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 -- 172.21.15.1:0/1927591529 >> 172.21.15.1:0/1927591529 conn(0x560085191a30 msgr2=0x560085196ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 -- 172.21.15.1:0/1927591529 shutdown_connections 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 -- 172.21.15.1:0/1927591529 wait complete. 2024-09-19T09:08:06.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 -- start start 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.437+0000 7fc36062a740 1 Processor -- start 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc36062a740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc36062a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x5600851a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc36062a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc36062a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581a9ad0 con 0x560085195dc0 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc36062a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581aaf40 con 0x5600851a0680 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc36062a740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581aa1a0 con 0x5600851954a0 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc36062a740 10 client.0 _ll_register_callbacks cb 0x7fc34000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc34effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x5600851a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc357fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc357fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:55632/0 (socket says 172.21.15.1:55632) 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc357fff640 1 -- 172.21.15.1:0/3762363916 learned_addr learned my addr 172.21.15.1:0/3762363916 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:06.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc34effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x5600851a8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43390/0 (socket says 172.21.15.1:43390) 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc357fff640 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc34effd640 1 -- 172.21.15.1:0/3762363916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 msgr2=0x5600851a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc34effd640 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc34effd640 1 -- 172.21.15.1:0/3762363916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 msgr2=0x5600851a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc34effd640 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.438+0000 7fc34effd640 1 -- 172.21.15.1:0/3762363916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008521e330 con 0x560085195dc0 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc34effd640 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x5600851a8df0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc340003e70 tx=0x7fc340004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9283aa03ba43113 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc336ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc336ffd640 1 -- 172.21.15.1:0/3762363916 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34000b540 con 0x560085195dc0 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc336ffd640 1 -- 172.21.15.1:0/3762363916 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc34000bc30 con 0x560085195dc0 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc36062a740 1 -- 172.21.15.1:0/3762363916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc350036070 con 0x560085195dc0 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc336ffd640 1 -- 172.21.15.1:0/3762363916 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc34000e8d0 con 0x560085195dc0 2024-09-19T09:08:06.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc36062a740 10 client.16659 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:06.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc36062a740 1 -- 172.21.15.1:0/3762363916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56008521f5c0 con 0x560085195dc0 2024-09-19T09:08:06.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.439+0000 7fc336ffd640 1 -- 172.21.15.1:0/3762363916 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc350036070 con 0x560085195dc0 2024-09-19T09:08:06.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.440+0000 7fc336ffd640 1 -- 172.21.15.1:0/3762363916 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc340012450 con 0x560085195dc0 2024-09-19T09:08:06.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.440+0000 7fc36062a740 10 client.16659 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.440+0000 7fc36062a740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.440+0000 7fc36062a740 20 client.16659 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.440+0000 7fc36062a740 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56008521fcb0 0x5600852220d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.440+0000 7fc36062a740 4 client.16659 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.440+0000 7fc36062a740 1 -- 172.21.15.1:0/3762363916 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560085102d60 con 0x56008521fcb0 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.440+0000 7fc357fff640 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56008521fcb0 0x5600852220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc357fff640 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56008521fcb0 0x5600852220d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31016f89e67e9175 server_cookie=de26d97d18898b24 in_seq=0 out_seq=0 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc336ffd640 10 client.16659 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc336ffd640 1 -- 172.21.15.1:0/3762363916 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560085102d60 con 0x56008521fcb0 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc336ffd640 10 client.16659 handle_command_reply: tid=0 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 client.16659 shutdown 2024-09-19T09:08:06.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 -- 172.21.15.1:0/3762363916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 msgr2=0x5600851a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x5600851a8df0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc340003e70 tx=0x7fc340004290 comp rx=0 tx=0).stop 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 -- 172.21.15.1:0/3762363916 shutdown_connections 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x56008521fcb0 0x5600852220d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5600851a0680 0x5600851a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560085195dc0 0x5600851a8df0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 --2- 172.21.15.1:0/3762363916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600851954a0 0x5600851a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 -- 172.21.15.1:0/3762363916 >> 172.21.15.1:0/3762363916 conn(0x560085191a30 msgr2=0x5600851988e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc336ffd640 0 client.16659 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 -- 172.21.15.1:0/3762363916 shutdown_connections 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.441+0000 7fc36062a740 1 -- 172.21.15.1:0/3762363916 wait complete. 2024-09-19T09:08:06.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc36062a740 20 client.16659 trim_cache size 0 max 16384 2024-09-19T09:08:06.447 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:06.447 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:08:06.447 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:08:06.447 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 -- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3440a3240 msgr2=0x7fc3440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3440a3240 0x7fc3440a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc3480cdbb0 tx=0x7fc348018520 comp rx=0 tx=0).stop 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 -- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358101de0 msgr2=0x7fc358198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358101de0 0x7fc358198500 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc34800e9f0 tx=0x7fc34800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 -- 172.21.15.1:0/4130152293 shutdown_connections 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3440a3240 0x7fc3440a5700 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc358106f10 0x7fc35819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc358102790 0x7fc358198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 --2- 172.21.15.1:0/4130152293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc358101de0 0x7fc358198500 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:06.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 -- 172.21.15.1:0/4130152293 >> 172.21.15.1:0/4130152293 conn(0x7fc3580fd8c0 msgr2=0x7fc3580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:06.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 -- 172.21.15.1:0/4130152293 shutdown_connections 2024-09-19T09:08:06.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:06.442+0000 7fc35e251640 1 -- 172.21.15.1:0/4130152293 wait complete. 2024-09-19T09:08:07.230 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:08:07.230 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:08:07.505 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:07.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:07 smithi001 ceph-mon[30939]: pgmap v458: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 514 op/s 2024-09-19T09:08:07.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.986+0000 7f3257b94640 1 -- 172.21.15.1:0/658995456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250074590 msgr2=0x7f3250074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.986+0000 7f3257b94640 1 --2- 172.21.15.1:0/658995456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250074590 0x7f3250074970 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f324c009900 tx=0x7f324c02a480 comp rx=0 tx=0).stop 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.986+0000 7f3257b94640 1 -- 172.21.15.1:0/658995456 shutdown_connections 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.986+0000 7f3257b94640 1 --2- 172.21.15.1:0/658995456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3250112b90 0x7f3250114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.986+0000 7f3257b94640 1 --2- 172.21.15.1:0/658995456 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3250074eb0 0x7f3250112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.986+0000 7f3257b94640 1 --2- 172.21.15.1:0/658995456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250074590 0x7f3250074970 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.986+0000 7f3257b94640 1 -- 172.21.15.1:0/658995456 >> 172.21.15.1:0/658995456 conn(0x7f32500fd8c0 msgr2=0x7f32500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 -- 172.21.15.1:0/658995456 shutdown_connections 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 -- 172.21.15.1:0/658995456 wait complete. 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 Processor -- start 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 -- start start 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3250074590 0x7f32501a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3250074eb0 0x7f32501a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250112b90 0x7f325019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32501186b0 con 0x7f3250112b90 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3250118530 con 0x7f3250074590 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.987+0000 7f3257b94640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3250118830 con 0x7f3250074eb0 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250112b90 0x7f325019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3255930640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3250074590 0x7f32501a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250112b90 0x7f325019ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43406/0 (socket says 172.21.15.1:43406) 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 -- 172.21.15.1:0/692157417 learned_addr learned my addr 172.21.15.1:0/692157417 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f325512f640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3250074eb0 0x7f32501a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 -- 172.21.15.1:0/692157417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3250074eb0 msgr2=0x7f32501a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3250074eb0 0x7f32501a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:07.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 -- 172.21.15.1:0/692157417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3250074590 msgr2=0x7f32501a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3250074590 0x7f32501a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 -- 172.21.15.1:0/692157417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325019f160 con 0x7f3250112b90 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3255930640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3250074590 0x7f32501a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3256131640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250112b90 0x7f325019ea30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f324800dac0 tx=0x7f324800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3246ffd640 1 -- 172.21.15.1:0/692157417 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248017070 con 0x7f3250112b90 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325019f450 con 0x7f3250112b90 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3246ffd640 1 -- 172.21.15.1:0/692157417 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f324800be30 con 0x7f3250112b90 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3246ffd640 1 -- 172.21.15.1:0/692157417 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324800f940 con 0x7f3250112b90 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.988+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32501ab740 con 0x7f3250112b90 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.990+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3250074970 con 0x7f3250112b90 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.991+0000 7f3246ffd640 1 -- 172.21.15.1:0/692157417 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f324800fb00 con 0x7f3250112b90 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.991+0000 7f3246ffd640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f323c0a3240 0x7f323c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:07.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.992+0000 7f3255930640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f323c0a3240 0x7f323c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.992+0000 7f3246ffd640 1 -- 172.21.15.1:0/692157417 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f32480cf790 con 0x7f3250112b90 2024-09-19T09:08:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.992+0000 7f3255930640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f323c0a3240 0x7f323c0a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f325019fb70 tx=0x7f324c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:08.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:07.995+0000 7f3246ffd640 1 -- 172.21.15.1:0/692157417 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f324809bde0 con 0x7f3250112b90 2024-09-19T09:08:08.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:07 smithi064 ceph-mon[35179]: pgmap v458: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 514 op/s 2024-09-19T09:08:08.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:07 smithi022 ceph-mon[35107]: pgmap v458: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 514 op/s 2024-09-19T09:08:08.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.209+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f325019ff60 con 0x7f3250112b90 2024-09-19T09:08:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.209+0000 7f3246ffd640 1 -- 172.21.15.1:0/692157417 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11887 (secure 0 0 0) 0x7f325019ff60 con 0x7f3250112b90 2024-09-19T09:08:08.210 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:08:08.210 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-19T09:07:36:672566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:07:36.432120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:08:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-19T09:08:08.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f323c0a3240 msgr2=0x7f323c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f323c0a3240 0x7f323c0a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f325019fb70 tx=0x7f324c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250112b90 msgr2=0x7f325019ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:08.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250112b90 0x7f325019ea30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f324800dac0 tx=0x7f324800df80 comp rx=0 tx=0).stop 2024-09-19T09:08:08.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 shutdown_connections 2024-09-19T09:08:08.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3250112b90 0x7f325019ea30 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f323c0a3240 0x7f323c0a5700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3250074eb0 0x7f32501a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 --2- 172.21.15.1:0/692157417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3250074590 0x7f32501a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:08.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 >> 172.21.15.1:0/692157417 conn(0x7f32500fd8c0 msgr2=0x7f32500ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:08.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 shutdown_connections 2024-09-19T09:08:08.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:08.212+0000 7f3257b94640 1 -- 172.21.15.1:0/692157417 wait complete. 2024-09-19T09:08:08.918 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:08 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/692157417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:08.952 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:08:09.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:08 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/692157417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:09.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:08 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/692157417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:09.213 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.631+0000 7fb9e74d6640 1 -- 172.21.15.1:0/3328879518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102570 msgr2=0x7fb9e01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.631+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/3328879518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102570 0x7fb9e01029b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009900 tx=0x7fb9d002a480 comp rx=0 tx=0).stop 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.632+0000 7fb9e74d6640 1 -- 172.21.15.1:0/3328879518 shutdown_connections 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.632+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/3328879518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0102ef0 0x7fb9e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.632+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/3328879518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102570 0x7fb9e01029b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.632+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/3328879518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9e0100e20 0x7fb9e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.632+0000 7fb9e74d6640 1 -- 172.21.15.1:0/3328879518 >> 172.21.15.1:0/3328879518 conn(0x7fb9e00fc7d0 msgr2=0x7fb9e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.632+0000 7fb9e74d6640 1 -- 172.21.15.1:0/3328879518 shutdown_connections 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.632+0000 7fb9e74d6640 1 -- 172.21.15.1:0/3328879518 wait complete. 2024-09-19T09:08:09.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.632+0000 7fb9e74d6640 1 Processor -- start 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e74d6640 1 -- start start 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e74d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0100e20 0x7fb9e0199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e74d6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9e0102570 0x7fb9e01999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e74d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102ef0 0x7fb9e01a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e74d6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01110a0 con 0x7fb9e0102ef0 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e74d6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0110f20 con 0x7fb9e0100e20 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e74d6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0111220 con 0x7fb9e0102570 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102ef0 0x7fb9e01a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102ef0 0x7fb9e01a44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43424/0 (socket says 172.21.15.1:43424) 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 -- 172.21.15.1:0/886389082 learned_addr learned my addr 172.21.15.1:0/886389082 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5272640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0100e20 0x7fb9e0199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9e0102570 0x7fb9e01999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 -- 172.21.15.1:0/886389082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9e0102570 msgr2=0x7fb9e01999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9e0102570 0x7fb9e01999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 -- 172.21.15.1:0/886389082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0100e20 msgr2=0x7fb9e0199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0100e20 0x7fb9e0199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 -- 172.21.15.1:0/886389082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e01a4a30 con 0x7fb9e0102ef0 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.633+0000 7fb9e5a73640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102ef0 0x7fb9e01a44f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009fd0 tx=0x7fb9d800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.634+0000 7fb9d67fc640 1 -- 172.21.15.1:0/886389082 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8017070 con 0x7fb9e0102ef0 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.634+0000 7fb9e74d6640 1 -- 172.21.15.1:0/886389082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e01a4c00 con 0x7fb9e0102ef0 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.634+0000 7fb9d67fc640 1 -- 172.21.15.1:0/886389082 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9d8004020 con 0x7fb9e0102ef0 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.634+0000 7fb9d67fc640 1 -- 172.21.15.1:0/886389082 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80106c0 con 0x7fb9e0102ef0 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.634+0000 7fb9e74d6640 1 -- 172.21.15.1:0/886389082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01a50c0 con 0x7fb9e0102ef0 2024-09-19T09:08:09.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.636+0000 7fb9d67fc640 1 -- 172.21.15.1:0/886389082 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fb9d80041d0 con 0x7fb9e0102ef0 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.636+0000 7fb9e98af740 1 Processor -- start 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.636+0000 7fb9e98af740 1 -- start start 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c02090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c02a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c0f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e98af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563d39b682f0 con 0x563d39c025d0 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e98af740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d39b0fcf0 con 0x563d39c03b40 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e98af740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563d39b642b0 con 0x563d39c0d370 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5272640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c02a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5272640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c02a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43426/0 (socket says 172.21.15.1:43426) 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5272640 1 -- 172.21.15.1:0/2926342581 learned_addr learned my addr 172.21.15.1:0/2926342581 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c02090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9d67fc640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c0f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5a73640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5272640 1 -- 172.21.15.1:0/2926342581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 msgr2=0x563d39c0f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5272640 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c0f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5272640 1 -- 172.21.15.1:0/2926342581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 msgr2=0x563d39c02090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5272640 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c02090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e5272640 1 -- 172.21.15.1:0/2926342581 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d39af43a0 con 0x563d39c025d0 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c0f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.637+0000 7fb9d67fc640 1 -- 172.21.15.1:0/886389082 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb9d80cf520 con 0x7fb9e0102ef0 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.638+0000 7fb9e5272640 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c02a10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009d20 tx=0x7fb9dc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed5e135bc12d16d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.638+0000 7fb9e5a73640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8098030 tx=0x7fb9d8066ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.638+0000 7fb9cb7fe640 1 -- 172.21.15.1:0/2926342581 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc01e070 con 0x563d39c025d0 2024-09-19T09:08:09.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.638+0000 7fb9cb7fe640 1 -- 172.21.15.1:0/2926342581 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9dc019b30 con 0x563d39c025d0 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.638+0000 7fb9cb7fe640 1 -- 172.21.15.1:0/2926342581 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00ec40 con 0x563d39c025d0 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 -- 172.21.15.1:0/2926342581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 msgr2=0x563d39c02a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c02a10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009d20 tx=0x7fb9dc011810 comp rx=0 tx=0).stop 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 -- 172.21.15.1:0/2926342581 shutdown_connections 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c0f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c02a10 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2926342581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c02090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 -- 172.21.15.1:0/2926342581 >> 172.21.15.1:0/2926342581 conn(0x563d39bcb310 msgr2=0x563d39bfec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 -- 172.21.15.1:0/2926342581 shutdown_connections 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 -- 172.21.15.1:0/2926342581 wait complete. 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 -- start start 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.639+0000 7fb9e98af740 1 Processor -- start 2024-09-19T09:08:09.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39c0cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c03b40 0x563d39c0a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c0d370 0x563d39c0a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e98af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563d39c10070 con 0x563d39c0d370 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e98af740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563d39b23060 con 0x563d39c025d0 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e98af740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x563d39c101f0 con 0x563d39c03b40 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e98af740 10 client.0 _ll_register_callbacks cb 0x563d398768c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e4a71640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c0d370 0x563d39c0a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e5272640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c03b40 0x563d39c0a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e4a71640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c0d370 0x563d39c0a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43432/0 (socket says 172.21.15.1:43432) 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e4a71640 1 -- 172.21.15.1:0/3082648974 learned_addr learned my addr 172.21.15.1:0/3082648974 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39c0cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e5272640 1 -- 172.21.15.1:0/3082648974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 msgr2=0x563d39c0cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:09.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e5272640 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39c0cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e5272640 1 -- 172.21.15.1:0/3082648974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c0d370 msgr2=0x563d39c0a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e5272640 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c0d370 0x563d39c0a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e5272640 1 -- 172.21.15.1:0/3082648974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d398d93c0 con 0x563d39c03b40 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c0d370 0x563d39c0a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9e5272640 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c03b40 0x563d39c0a030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc011d10 tx=0x7fb9dc00ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e371385f2e96a3e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.640+0000 7fb9c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/3082648974 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc027020 con 0x563d39c03b40 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/3082648974 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb9dc019630 con 0x563d39c03b40 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 1 -- 172.21.15.1:0/3082648974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9dc019b30 con 0x563d39c03b40 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/3082648974 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9dc01e070 con 0x563d39c03b40 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 10 client.26083 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 1 -- 172.21.15.1:0/3082648974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563d39c1bab0 con 0x563d39c03b40 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/3082648974 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9dc019b30 con 0x563d39c03b40 2024-09-19T09:08:09.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/3082648974 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb9dc0046c0 con 0x563d39c03b40 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 10 client.26083 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 10 client.26083 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 20 client.26083 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x563d39c1cf10 0x563d39c1f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 4 client.26083 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.641+0000 7fb9e98af740 1 -- 172.21.15.1:0/3082648974 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d39b75860 con 0x563d39c1cf10 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.642+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x563d39c1cf10 0x563d39c1f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.642+0000 7fb9c8ff9640 10 client.26083 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.642+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x563d39c1cf10 0x563d39c1f300 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=325df332a29bdb0f server_cookie=ec5dbb02c9ce1acf in_seq=0 out_seq=0 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/3082648974 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d39b75860 con 0x563d39c1cf10 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9c8ff9640 10 client.26083 handle_command_reply: tid=0 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 client.26083 shutdown 2024-09-19T09:08:09.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 -- 172.21.15.1:0/3082648974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c03b40 msgr2=0x563d39c0a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c03b40 0x563d39c0a030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc011d10 tx=0x7fb9dc00ebb0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 -- 172.21.15.1:0/3082648974 shutdown_connections 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x563d39c1cf10 0x563d39c1f300 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c0d370 0x563d39c0a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c03b40 0x563d39c0a030 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9c8ff9640 0 client.26083 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 --2- 172.21.15.1:0/3082648974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39c0cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 -- 172.21.15.1:0/3082648974 >> 172.21.15.1:0/3082648974 conn(0x563d39bcb310 msgr2=0x563d39c04930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 -- 172.21.15.1:0/3082648974 shutdown_connections 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 1 -- 172.21.15.1:0/3082648974 wait complete. 2024-09-19T09:08:09.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.643+0000 7fb9e98af740 20 client.26083 trim_cache size 0 max 16384 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.661+0000 7fb9e98af740 1 Processor -- start 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.661+0000 7fb9e98af740 1 -- start start 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.661+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39bfee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.661+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c03b40 0x563d39c19310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c24ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e98af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01b0020 con 0x563d39c03b40 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e98af740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01ad830 con 0x563d39c025d0 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e98af740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01ab680 con 0x563d39c0d370 2024-09-19T09:08:09.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c03b40 0x563d39c19310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c03b40 0x563d39c19310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43446/0 (socket says 172.21.15.1:43446) 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 -- 172.21.15.1:0/362100168 learned_addr learned my addr 172.21.15.1:0/362100168 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39bfee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c24ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 -- 172.21.15.1:0/362100168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 msgr2=0x563d39c24ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c24ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 -- 172.21.15.1:0/362100168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 msgr2=0x563d39bfee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39bfee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 -- 172.21.15.1:0/362100168 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d39c0a970 con 0x563d39c03b40 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39bfee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9e5272640 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c03b40 0x563d39c19310 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc004a90 tx=0x7fb9dc009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca195e4766badc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9caffd640 1 -- 172.21.15.1:0/362100168 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc027040 con 0x563d39c03b40 2024-09-19T09:08:09.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9caffd640 1 -- 172.21.15.1:0/362100168 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9dc015020 con 0x563d39c03b40 2024-09-19T09:08:09.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.662+0000 7fb9caffd640 1 -- 172.21.15.1:0/362100168 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc003850 con 0x563d39c03b40 2024-09-19T09:08:09.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 -- 172.21.15.1:0/362100168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c03b40 msgr2=0x563d39c19310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c03b40 0x563d39c19310 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc004a90 tx=0x7fb9dc009620 comp rx=0 tx=0).stop 2024-09-19T09:08:09.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 -- 172.21.15.1:0/362100168 shutdown_connections 2024-09-19T09:08:09.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c24ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c03b40 0x563d39c19310 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 --2- 172.21.15.1:0/362100168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c025d0 0x563d39bfee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 -- 172.21.15.1:0/362100168 >> 172.21.15.1:0/362100168 conn(0x563d39bcb310 msgr2=0x563d39bfe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 -- 172.21.15.1:0/362100168 shutdown_connections 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 -- 172.21.15.1:0/362100168 wait complete. 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.663+0000 7fb9e98af740 1 -- start start 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e98af740 1 Processor -- start 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c15c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c06e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e98af740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e98af740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01abcf0 con 0x563d39c025d0 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e98af740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01ad160 con 0x563d39c03b40 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e98af740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e01ac3c0 con 0x563d39c0d370 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e98af740 10 client.0 _ll_register_callbacks cb 0x7fb9dc01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:09.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e4a71640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c15c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e4a71640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c15c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43450/0 (socket says 172.21.15.1:43450) 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e4a71640 1 -- 172.21.15.1:0/2575987965 learned_addr learned my addr 172.21.15.1:0/2575987965 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e5272640 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c06e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e4a71640 1 -- 172.21.15.1:0/2575987965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 msgr2=0x563d39c073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e4a71640 1 -- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 msgr2=0x563d39c06e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c06e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e4a71640 1 -- 172.21.15.1:0/2575987965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d39c07c00 con 0x563d39c025d0 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.664+0000 7fb9e5272640 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c06e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9e4a71640 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c15c50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009230 tx=0x7fb9d0005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4306dc01629166a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/2575987965 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0035040 con 0x563d39c025d0 2024-09-19T09:08:09.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/2575987965 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb9d004ce80 con 0x563d39c025d0 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9e98af740 1 -- 172.21.15.1:0/2575987965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9dc015020 con 0x563d39c025d0 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/2575987965 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9d0004100 con 0x563d39c025d0 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9e98af740 10 client.16683 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9e98af740 1 -- 172.21.15.1:0/2575987965 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563d39c87bd0 con 0x563d39c025d0 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/2575987965 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9dc015020 con 0x563d39c025d0 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/2575987965 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb9d004c360 con 0x563d39c025d0 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9e98af740 10 client.16683 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9e98af740 10 client.16683 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9e98af740 20 client.16683 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.665+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x563d39c88360 0x563d39c8a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 4 client.16683 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 1 -- 172.21.15.1:0/2575987965 --> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d39b6fd70 con 0x563d39c88360 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e5272640 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x563d39c88360 0x563d39c8a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:09.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e5272640 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x563d39c88360 0x563d39c8a780 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b111a5d836fa3b41 server_cookie=b2c14c2795dafe77 in_seq=0 out_seq=0 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9c8ff9640 10 client.16683 ms_handle_connect on v2:172.21.15.22:6836/866445696 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9c8ff9640 1 -- 172.21.15.1:0/2575987965 <== mds.2 v2:172.21.15.22:6836/866445696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d39b6fd70 con 0x563d39c88360 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9c8ff9640 10 client.16683 handle_command_reply: tid=0 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 1 client.16683 shutdown 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 1 -- 172.21.15.1:0/2575987965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 msgr2=0x563d39c15c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c15c50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009230 tx=0x7fb9d0005760 comp rx=0 tx=0).stop 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 1 -- 172.21.15.1:0/2575987965 shutdown_connections 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:6836/866445696,v1:172.21.15.22:6837/866445696] conn(0x563d39c88360 0x563d39c8a780 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x563d39c0d370 0x563d39c073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9c8ff9640 0 client.16683 ms_handle_reset on v2:172.21.15.22:6836/866445696 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.666+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563d39c03b40 0x563d39c06e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e98af740 1 --2- 172.21.15.1:0/2575987965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563d39c025d0 0x563d39c15c50 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e98af740 1 -- 172.21.15.1:0/2575987965 >> 172.21.15.1:0/2575987965 conn(0x563d39bcb310 msgr2=0x563d39bfd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:09.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e98af740 1 -- 172.21.15.1:0/2575987965 shutdown_connections 2024-09-19T09:08:09.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e98af740 1 -- 172.21.15.1:0/2575987965 wait complete. 2024-09-19T09:08:09.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e98af740 20 client.16683 trim_cache size 0 max 16384 2024-09-19T09:08:09.673 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 -- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9cc0a3240 msgr2=0x7fb9cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8098030 tx=0x7fb9d8066ab0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 -- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102ef0 msgr2=0x7fb9e01a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102ef0 0x7fb9e01a44f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009fd0 tx=0x7fb9d800b260 comp rx=0 tx=0).stop 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 -- 172.21.15.1:0/886389082 shutdown_connections 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9e0102ef0 0x7fb9e01a44f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fb9cc0a3240 0x7fb9cc0a5700 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9e0102570 0x7fb9e01999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 --2- 172.21.15.1:0/886389082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0100e20 0x7fb9e0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:09.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 -- 172.21.15.1:0/886389082 >> 172.21.15.1:0/886389082 conn(0x7fb9e00fc7d0 msgr2=0x7fb9e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:09.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 -- 172.21.15.1:0/886389082 shutdown_connections 2024-09-19T09:08:09.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:09.667+0000 7fb9e74d6640 1 -- 172.21.15.1:0/886389082 wait complete. 2024-09-19T09:08:09.966 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:09 smithi001 ceph-mon[30939]: pgmap v459: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 782 KiB/s wr, 446 op/s 2024-09-19T09:08:10.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:09 smithi064 ceph-mon[35179]: pgmap v459: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 782 KiB/s wr, 446 op/s 2024-09-19T09:08:10.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:09 smithi022 ceph-mon[35107]: pgmap v459: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 782 KiB/s wr, 446 op/s 2024-09-19T09:08:10.431 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:08:10.687 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 -- 172.21.15.1:0/3294462404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a4101290 msgr2=0x7f27a410df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/3294462404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a4101290 0x7f27a410df50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2794009900 tx=0x7f279402a410 comp rx=0 tx=0).stop 2024-09-19T09:08:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 -- 172.21.15.1:0/3294462404 shutdown_connections 2024-09-19T09:08:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/3294462404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27a410e490 0x7f27a4110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/3294462404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a4101290 0x7f27a410df50 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/3294462404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a41008e0 0x7f27a4100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 -- 172.21.15.1:0/3294462404 >> 172.21.15.1:0/3294462404 conn(0x7f27a40fc7d0 msgr2=0x7f27a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 -- 172.21.15.1:0/3294462404 shutdown_connections 2024-09-19T09:08:11.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.138+0000 7f27ab2c9640 1 -- 172.21.15.1:0/3294462404 wait complete. 2024-09-19T09:08:11.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27ab2c9640 1 Processor -- start 2024-09-19T09:08:11.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27ab2c9640 1 -- start start 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27ab2c9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a41008e0 0x7f27a41a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27ab2c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27a4101290 0x7f27a41a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27ab2c9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a410e490 0x7f27a419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27ab2c9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41142f0 con 0x7f27a410e490 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27ab2c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f27a4114170 con 0x7f27a4101290 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27ab2c9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27a4114470 con 0x7f27a41008e0 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a9866640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a410e490 0x7f27a419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a8864640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27a4101290 0x7f27a41a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a9065640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a41008e0 0x7f27a41a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a8864640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27a4101290 0x7f27a41a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:55728/0 (socket says 172.21.15.1:55728) 2024-09-19T09:08:11.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a8864640 1 -- 172.21.15.1:0/1932228246 learned_addr learned my addr 172.21.15.1:0/1932228246 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a9866640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a410e490 0x7f27a419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43460/0 (socket says 172.21.15.1:43460) 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a9065640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a41008e0 0x7f27a41a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:34940/0 (socket says 172.21.15.1:34940) 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a9866640 1 -- 172.21.15.1:0/1932228246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a41008e0 msgr2=0x7f27a41a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a9866640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a41008e0 0x7f27a41a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a9866640 1 -- 172.21.15.1:0/1932228246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27a4101290 msgr2=0x7f27a41a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.139+0000 7f27a9866640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27a4101290 0x7f27a41a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.140+0000 7f27a9866640 1 -- 172.21.15.1:0/1932228246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a419ad10 con 0x7f27a410e490 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.140+0000 7f27a8864640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27a4101290 0x7f27a41a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.140+0000 7f27a9866640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a410e490 0x7f27a419a5e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f27a4102ac0 tx=0x7f279c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.140+0000 7f279a7fc640 1 -- 172.21.15.1:0/1932228246 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c00ada0 con 0x7f27a410e490 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.140+0000 7f27ab2c9640 1 -- 172.21.15.1:0/1932228246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a419b000 con 0x7f27a410e490 2024-09-19T09:08:11.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.140+0000 7f279a7fc640 1 -- 172.21.15.1:0/1932228246 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f279c00f950 con 0x7f27a410e490 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.140+0000 7f279a7fc640 1 -- 172.21.15.1:0/1932228246 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c018b50 con 0x7f27a410e490 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.140+0000 7f27ab2c9640 1 -- 172.21.15.1:0/1932228246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a41a72f0 con 0x7f27a410e490 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.142+0000 7f279a7fc640 1 -- 172.21.15.1:0/1932228246 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f279c00fb00 con 0x7f27a410e490 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27ad6a2740 1 Processor -- start 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27ad6a2740 1 -- start start 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 0x55a4715db090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715db5d0 0x55a4715dba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 0x55a4715e8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4715412f0 con 0x55a4715db5d0 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4714e8cf0 con 0x55a4715dcb40 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a47153d2b0 con 0x55a4715e6370 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f279a7fc640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27900a3240 0x7f27900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27a9065640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715db5d0 0x55a4715dba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27a9065640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715db5d0 0x55a4715dba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43464/0 (socket says 172.21.15.1:43464) 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27a9065640 1 -- 172.21.15.1:0/2112234960 learned_addr learned my addr 172.21.15.1:0/2112234960 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27a8864640 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 0x55a4715e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27a9866640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27900a3240 0x7f27900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27a8864640 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 0x55a4715db090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f279a7fc640 1 -- 172.21.15.1:0/1932228246 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f279c0cfb10 con 0x7f27a410e490 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.143+0000 7f27a9065640 1 -- 172.21.15.1:0/2112234960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 msgr2=0x55a4715e8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f27a9065640 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 0x55a4715e8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f27a9065640 1 -- 172.21.15.1:0/2112234960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 msgr2=0x55a4715db090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f27a9065640 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 0x55a4715db090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f27a9065640 1 -- 172.21.15.1:0/2112234960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4714cd3a0 con 0x55a4715db5d0 2024-09-19T09:08:11.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f27a9065640 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715db5d0 0x55a4715dba10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f27a000b760 tx=0x7f27a000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea30f92c41ad4d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f27a9866640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27900a3240 0x7f27900a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f279c09c0a0 tx=0x7f279c06ef90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f278f7fe640 1 -- 172.21.15.1:0/2112234960 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0003dd0 con 0x55a4715db5d0 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f278f7fe640 1 -- 172.21.15.1:0/2112234960 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27a0015070 con 0x55a4715db5d0 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.144+0000 7f278f7fe640 1 -- 172.21.15.1:0/2112234960 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0004e50 con 0x55a4715db5d0 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2112234960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715db5d0 msgr2=0x55a4715dba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715db5d0 0x55a4715dba10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f27a000b760 tx=0x7f27a000bc20 comp rx=0 tx=0).stop 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2112234960 shutdown_connections 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 0x55a4715e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715db5d0 0x55a4715dba10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2112234960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 0x55a4715db090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2112234960 >> 172.21.15.1:0/2112234960 conn(0x55a4715a4310 msgr2=0x55a4715d7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2112234960 shutdown_connections 2024-09-19T09:08:11.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2112234960 wait complete. 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 -- start start 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.145+0000 7f27ad6a2740 1 Processor -- start 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715dcb40 0x55a4715e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4715e9070 con 0x55a4715e6370 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a4714fc060 con 0x55a4715db5d0 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a4715e91f0 con 0x55a4715dcb40 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27ad6a2740 10 client.0 _ll_register_callbacks cb 0x55a47124f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43476/0 (socket says 172.21.15.1:43476) 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 -- 172.21.15.1:0/2875629401 learned_addr learned my addr 172.21.15.1:0/2875629401 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:11.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a9065640 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715dcb40 0x55a4715e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 -- 172.21.15.1:0/2875629401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715dcb40 msgr2=0x55a4715e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715dcb40 0x55a4715e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 -- 172.21.15.1:0/2875629401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 msgr2=0x55a4715e5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 -- 172.21.15.1:0/2875629401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4712b23c0 con 0x55a4715e6370 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f27a8864640 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e35d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2794005ec0 tx=0x7f2794031550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8350bbd245acb8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f278cff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.146+0000 7f278cff9640 1 -- 172.21.15.1:0/2875629401 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794035040 con 0x55a4715e6370 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f278cff9640 1 -- 172.21.15.1:0/2875629401 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2794004970 con 0x55a4715e6370 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2875629401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a0015070 con 0x55a4715e6370 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f278cff9640 1 -- 172.21.15.1:0/2875629401 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2794054050 con 0x55a4715e6370 2024-09-19T09:08:11.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 10 client.16695 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2875629401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a4715f4ad0 con 0x55a4715e6370 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f278cff9640 1 -- 172.21.15.1:0/2875629401 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27a0015070 con 0x55a4715e6370 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f278cff9640 1 -- 172.21.15.1:0/2875629401 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f279404b070 con 0x55a4715e6370 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 10 client.16695 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 10 client.16695 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 20 client.16695 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4715f5ee0 0x55a4715f8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 4 client.16695 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:11.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.147+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2875629401 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a47154e860 con 0x55a4715f5ee0 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.148+0000 7f27a9065640 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4715f5ee0 0x55a4715f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.148+0000 7f278cff9640 10 client.16695 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.148+0000 7f27a9065640 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4715f5ee0 0x55a4715f8310 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ee716c32f73005d server_cookie=b08b11ad32416549 in_seq=0 out_seq=0 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f278cff9640 1 -- 172.21.15.1:0/2875629401 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a47154e860 con 0x55a4715f5ee0 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f278cff9640 10 client.16695 handle_command_reply: tid=0 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 client.16695 shutdown 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2875629401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 msgr2=0x55a4715e35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e35d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2794005ec0 tx=0x7f2794031550 comp rx=0 tx=0).stop 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2875629401 shutdown_connections 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a4715f5ee0 0x55a4715f8310 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e35d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715dcb40 0x55a4715e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/2875629401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f278cff9640 0 client.16695 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2875629401 >> 172.21.15.1:0/2875629401 conn(0x55a4715a4310 msgr2=0x55a4715dd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2875629401 shutdown_connections 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 1 -- 172.21.15.1:0/2875629401 wait complete. 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.149+0000 7f27ad6a2740 20 client.16695 trim_cache size 0 max 16384 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27ad6a2740 1 Processor -- start 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27ad6a2740 1 -- start start 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715dcb40 0x55a4715de120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 0x55a4715de660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41b21d0 con 0x55a4715dcb40 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41af9e0 con 0x55a4715db5d0 2024-09-19T09:08:11.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41ad830 con 0x55a4715e6370 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27a9065640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715dcb40 0x55a4715de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27a9065640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715dcb40 0x55a4715de120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43482/0 (socket says 172.21.15.1:43482) 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.162+0000 7f27a9065640 1 -- 172.21.15.1:0/3698043236 learned_addr learned my addr 172.21.15.1:0/3698043236 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a8864640 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 0x55a4715de660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a8864640 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a9065640 1 -- 172.21.15.1:0/3698043236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 msgr2=0x55a4715de660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a9065640 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 0x55a4715de660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a9065640 1 -- 172.21.15.1:0/3698043236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 msgr2=0x55a4715e4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a9065640 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a9065640 1 -- 172.21.15.1:0/3698043236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4715e1fb0 con 0x55a4715dcb40 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a8864640 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:08:11.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f27a9065640 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715dcb40 0x55a4715de120 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55a4715d8ac0 tx=0x7f27a0004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364f593bcd9a3a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f278effd640 1 -- 172.21.15.1:0/3698043236 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0003dd0 con 0x55a4715dcb40 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f278effd640 1 -- 172.21.15.1:0/3698043236 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27a0015040 con 0x55a4715dcb40 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.163+0000 7f278effd640 1 -- 172.21.15.1:0/3698043236 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0019680 con 0x55a4715dcb40 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3698043236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715dcb40 msgr2=0x55a4715de120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715dcb40 0x55a4715de120 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55a4715d8ac0 tx=0x7f27a0004a30 comp rx=0 tx=0).stop 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3698043236 shutdown_connections 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715e6370 0x55a4715de660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715dcb40 0x55a4715de120 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3698043236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715db5d0 0x55a4715e4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3698043236 >> 172.21.15.1:0/3698043236 conn(0x55a4715a4310 msgr2=0x55a4715e4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3698043236 shutdown_connections 2024-09-19T09:08:11.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3698043236 wait complete. 2024-09-19T09:08:11.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- start start 2024-09-19T09:08:11.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 Processor -- start 2024-09-19T09:08:11.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715db5d0 0x55a4715dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 0x55a4715e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41adea0 con 0x55a4715e6370 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41af310 con 0x55a4715dcb40 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.164+0000 7f27ad6a2740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f27a41ae570 con 0x55a4715db5d0 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27ad6a2740 10 client.0 _ll_register_callbacks cb 0x7f27940053c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43494/0 (socket says 172.21.15.1:43494) 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 -- 172.21.15.1:0/3306493564 learned_addr learned my addr 172.21.15.1:0/3306493564 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a9065640 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 0x55a4715e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715db5d0 0x55a4715dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 -- 172.21.15.1:0/3306493564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715db5d0 msgr2=0x55a4715dfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715db5d0 0x55a4715dfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 -- 172.21.15.1:0/3306493564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 msgr2=0x55a4715e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 0x55a4715e0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 -- 172.21.15.1:0/3306493564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a47165fbb0 con 0x55a4715e6370 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27a8864640 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e0a70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f27940096c0 tx=0x7f27940050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6688b1d5168517fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f278cff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f278cff9640 1 -- 172.21.15.1:0/3306493564 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794035040 con 0x55a4715e6370 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f278cff9640 1 -- 172.21.15.1:0/3306493564 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2794004b80 con 0x55a4715e6370 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3306493564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a0015040 con 0x55a4715e6370 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f278cff9640 1 -- 172.21.15.1:0/3306493564 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2794032d30 con 0x55a4715e6370 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.165+0000 7f27ad6a2740 10 client.16701 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3306493564 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a471660da0 con 0x55a4715e6370 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f278cff9640 1 -- 172.21.15.1:0/3306493564 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f27a0015040 con 0x55a4715e6370 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f278cff9640 1 -- 172.21.15.1:0/3306493564 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f279404b040 con 0x55a4715e6370 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f27ad6a2740 10 client.16701 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f27ad6a2740 10 client.16701 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:08:11.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f27ad6a2740 20 client.16701 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a471661550 0x55a471663970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f27ad6a2740 4 client.16701 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3306493564 --> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a471548d70 con 0x55a471661550 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.166+0000 7f27a9065640 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a471661550 0x55a471663970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27a9065640 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a471661550 0x55a471663970 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf4dedb2cd2cb3e0 server_cookie=a0b18d834ebfa2e3 in_seq=0 out_seq=0 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f278cff9640 10 client.16701 ms_handle_connect on v2:172.21.15.64:6838/2311666322 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f278cff9640 1 -- 172.21.15.1:0/3306493564 <== mds.1 v2:172.21.15.64:6838/2311666322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a471548d70 con 0x55a471661550 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f278cff9640 10 client.16701 handle_command_reply: tid=0 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 client.16701 shutdown 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3306493564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 msgr2=0x55a4715e0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e0a70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f27940096c0 tx=0x7f27940050f0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3306493564 shutdown_connections 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.64:6838/2311666322,v1:172.21.15.64:6839/2311666322] conn(0x55a471661550 0x55a471663970 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a4715e6370 0x55a4715e0a70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a4715dcb40 0x55a4715e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 --2- 172.21.15.1:0/3306493564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a4715db5d0 0x55a4715dfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3306493564 >> 172.21.15.1:0/3306493564 conn(0x55a4715a4310 msgr2=0x55a4715f1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f278cff9640 0 client.16701 ms_handle_reset on v2:172.21.15.64:6838/2311666322 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3306493564 shutdown_connections 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 1 -- 172.21.15.1:0/3306493564 wait complete. 2024-09-19T09:08:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.167+0000 7f27ad6a2740 20 client.16701 trim_cache size 0 max 16384 2024-09-19T09:08:11.188 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:08:11.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 -- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27900a3240 msgr2=0x7f27900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27900a3240 0x7f27900a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f279c09c0a0 tx=0x7f279c06ef90 comp rx=0 tx=0).stop 2024-09-19T09:08:11.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 -- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a410e490 msgr2=0x7f27a419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:11.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a410e490 0x7f27a419a5e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f27a4102ac0 tx=0x7f279c00cf10 comp rx=0 tx=0).stop 2024-09-19T09:08:11.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 -- 172.21.15.1:0/1932228246 shutdown_connections 2024-09-19T09:08:11.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27a410e490 0x7f27a419a5e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27a4101290 0x7f27a41a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f27900a3240 0x7f27900a5700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 --2- 172.21.15.1:0/1932228246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27a41008e0 0x7f27a41a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:11.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 -- 172.21.15.1:0/1932228246 >> 172.21.15.1:0/1932228246 conn(0x7f27a40fc7d0 msgr2=0x7f27a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:11.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 -- 172.21.15.1:0/1932228246 shutdown_connections 2024-09-19T09:08:11.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:11.168+0000 7f27ab2c9640 1 -- 172.21.15.1:0/1932228246 wait complete. 2024-09-19T09:08:11.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:08:12.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:11 smithi001 ceph-mon[30939]: pgmap v460: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 784 KiB/s wr, 451 op/s 2024-09-19T09:08:12.103 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:12.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:11 smithi064 ceph-mon[35179]: pgmap v460: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 784 KiB/s wr, 451 op/s 2024-09-19T09:08:12.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:11 smithi022 ceph-mon[35107]: pgmap v460: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 784 KiB/s wr, 451 op/s 2024-09-19T09:08:12.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 -- 172.21.15.1:0/100589818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44101420 msgr2=0x7f3c4410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 --2- 172.21.15.1:0/100589818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44101420 0x7f3c4410d950 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009cd0 tx=0x7f3c3c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 -- 172.21.15.1:0/100589818 shutdown_connections 2024-09-19T09:08:12.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 --2- 172.21.15.1:0/100589818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44101420 0x7f3c4410d950 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 --2- 172.21.15.1:0/100589818 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c44100a80 0x7f3c44100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 --2- 172.21.15.1:0/100589818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c44106a80 0x7f3c44106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 -- 172.21.15.1:0/100589818 >> 172.21.15.1:0/100589818 conn(0x7f3c440fc7a0 msgr2=0x7f3c440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 -- 172.21.15.1:0/100589818 shutdown_connections 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.555+0000 7f3c49d17640 1 -- 172.21.15.1:0/100589818 wait complete. 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c49d17640 1 Processor -- start 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c49d17640 1 -- start start 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c49d17640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c44100a80 0x7f3c440fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c49d17640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c44101420 0x7f3c440fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c49d17640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44106a80 0x7f3c440fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c49d17640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44110fa0 con 0x7f3c44106a80 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c49d17640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44110e20 con 0x7f3c44100a80 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c49d17640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44111120 con 0x7f3c44101420 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44106a80 0x7f3c440fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44106a80 0x7f3c440fd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50082/0 (socket says 172.21.15.1:50082) 2024-09-19T09:08:12.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c43fff640 1 -- 172.21.15.1:0/2183047194 learned_addr learned my addr 172.21.15.1:0/2183047194 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c437fe640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c44100a80 0x7f3c440fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.556+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c44101420 0x7f3c440fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c43fff640 1 -- 172.21.15.1:0/2183047194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c44101420 msgr2=0x7f3c440fd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c43fff640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c44101420 0x7f3c440fd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c43fff640 1 -- 172.21.15.1:0/2183047194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c44100a80 msgr2=0x7f3c440fcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c43fff640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c44100a80 0x7f3c440fcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c43fff640 1 -- 172.21.15.1:0/2183047194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c441a69b0 con 0x7f3c44106a80 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c43fff640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44106a80 0x7f3c440fd7f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c006010 tx=0x7f3c3c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c40ff9640 1 -- 172.21.15.1:0/2183047194 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c004040 con 0x7f3c44106a80 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c49d17640 1 -- 172.21.15.1:0/2183047194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c441a6c40 con 0x7f3c44106a80 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c40ff9640 1 -- 172.21.15.1:0/2183047194 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c3c0046e0 con 0x7f3c44106a80 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c40ff9640 1 -- 172.21.15.1:0/2183047194 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c046480 con 0x7f3c44106a80 2024-09-19T09:08:12.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.557+0000 7f3c49d17640 1 -- 172.21.15.1:0/2183047194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c441a7180 con 0x7f3c44106a80 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.559+0000 7f3c40ff9640 1 -- 172.21.15.1:0/2183047194 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f3c3c030630 con 0x7f3c44106a80 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.559+0000 7f3c4c0f0740 1 Processor -- start 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.559+0000 7f3c4c0f0740 1 -- start start 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 0x5640fb075090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 0x5640fb075a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb082760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5640fafdb2f0 con 0x5640fb080370 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5640faf82cf0 con 0x5640fb0755d0 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5640fafd72b0 con 0x5640fb076b40 2024-09-19T09:08:12.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb082760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb082760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50094/0 (socket says 172.21.15.1:50094) 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 -- 172.21.15.1:0/142116297 learned_addr learned my addr 172.21.15.1:0/142116297 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 0x5640fb075090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c437fe640 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 0x5640fb075a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 -- 172.21.15.1:0/142116297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 msgr2=0x5640fb075090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 0x5640fb075090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 -- 172.21.15.1:0/142116297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 msgr2=0x5640fb075a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 0x5640fb075a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c42ffd640 1 -- 172.21.15.1:0/142116297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640faf673a0 con 0x5640fb080370 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.560+0000 7f3c40ff9640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c300a3240 0x7f3c300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.561+0000 7f3c40ff9640 1 -- 172.21.15.1:0/2183047194 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3c3c02e030 con 0x7f3c44106a80 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.561+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c300a3240 0x7f3c300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.561+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb082760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b6c0 tx=0x7f3c2c00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a791194bb15d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.561+0000 7f3c39ffb640 1 -- 172.21.15.1:0/142116297 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c026070 con 0x5640fb080370 2024-09-19T09:08:12.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.561+0000 7f3c39ffb640 1 -- 172.21.15.1:0/142116297 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c2c010cf0 con 0x5640fb080370 2024-09-19T09:08:12.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.561+0000 7f3c39ffb640 1 -- 172.21.15.1:0/142116297 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c01f620 con 0x5640fb080370 2024-09-19T09:08:12.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/142116297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 msgr2=0x5640fb082760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c300a3240 0x7f3c300a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c023000 tx=0x7f3c2c01fd50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb082760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b6c0 tx=0x7f3c2c00b650 comp rx=0 tx=0).stop 2024-09-19T09:08:12.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/142116297 shutdown_connections 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb082760 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 0x5640fb075a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/142116297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 0x5640fb075090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/142116297 >> 172.21.15.1:0/142116297 conn(0x5640fb03e310 msgr2=0x5640fb071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/142116297 shutdown_connections 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/142116297 wait complete. 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 -- start start 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.562+0000 7f3c4c0f0740 1 Processor -- start 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 0x5640fb07fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 0x5640fb07cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb07d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5640fb083070 con 0x5640fb080370 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5640faf96060 con 0x5640fb0755d0 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5640fb0831f0 con 0x5640fb076b40 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c4c0f0740 10 client.0 _ll_register_callbacks cb 0x5640face98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb07d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50100/0 (socket says 172.21.15.1:50100) 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 -- 172.21.15.1:0/1252846549 learned_addr learned my addr 172.21.15.1:0/1252846549 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 0x5640fb07cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c437fe640 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 0x5640fb07fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 -- 172.21.15.1:0/1252846549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 msgr2=0x5640fb07cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 0x5640fb07cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 -- 172.21.15.1:0/1252846549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 msgr2=0x5640fb07fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 0x5640fb07fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 -- 172.21.15.1:0/1252846549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640fad4c3c0 con 0x5640fb080370 2024-09-19T09:08:12.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c43fff640 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb07d570 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0c5e10 tx=0x7f3c3c0b9a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5596818cc1cdf826 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c22ffd640 1 -- 172.21.15.1:0/1252846549 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0d5070 con 0x5640fb080370 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c22ffd640 1 -- 172.21.15.1:0/1252846549 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3c3c0bcd20 con 0x5640fb080370 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.563+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1252846549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c2c010cf0 con 0x5640fb080370 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c22ffd640 1 -- 172.21.15.1:0/1252846549 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c3c0dc070 con 0x5640fb080370 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c4c0f0740 10 client.16713 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1252846549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640fb08eaf0 con 0x5640fb080370 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c22ffd640 1 -- 172.21.15.1:0/1252846549 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c2c010cf0 con 0x5640fb080370 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c22ffd640 1 -- 172.21.15.1:0/1252846549 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3c3c04e070 con 0x5640fb080370 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c4c0f0740 10 client.16713 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c4c0f0740 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c4c0f0740 20 client.16713 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5640fb08ff50 0x5640fb092380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c4c0f0740 4 client.16713 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1252846549 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640fafe8860 con 0x5640fb08ff50 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.564+0000 7f3c437fe640 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5640fb08ff50 0x5640fb092380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.565+0000 7f3c437fe640 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5640fb08ff50 0x5640fb092380 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=554df0e70acf35df server_cookie=3d37784794965ee8 in_seq=0 out_seq=0 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.565+0000 7f3c22ffd640 10 client.16713 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.565+0000 7f3c22ffd640 1 -- 172.21.15.1:0/1252846549 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640fafe8860 con 0x5640fb08ff50 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.565+0000 7f3c22ffd640 10 client.16713 handle_command_reply: tid=0 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.565+0000 7f3c4c0f0740 1 client.16713 shutdown 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1252846549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 msgr2=0x5640fb07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb07d570 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0c5e10 tx=0x7f3c3c0b9a70 comp rx=0 tx=0).stop 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1252846549 shutdown_connections 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5640fb08ff50 0x5640fb092380 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb07d570 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb076b40 0x5640fb07cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1252846549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb0755d0 0x5640fb07fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1252846549 >> 172.21.15.1:0/1252846549 conn(0x5640fb03e310 msgr2=0x5640fb077960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c22ffd640 0 client.16713 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:12.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1252846549 shutdown_connections 2024-09-19T09:08:12.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1252846549 wait complete. 2024-09-19T09:08:12.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.566+0000 7f3c4c0f0740 20 client.16713 trim_cache size 0 max 16384 2024-09-19T09:08:12.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c4c0f0740 1 Processor -- start 2024-09-19T09:08:12.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c4c0f0740 1 -- start start 2024-09-19T09:08:12.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb0755d0 0x5640fb071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 0x5640fb08c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb078120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441b2170 con 0x5640fb080370 2024-09-19T09:08:12.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441af980 con 0x5640fb076b40 2024-09-19T09:08:12.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441ad7d0 con 0x5640fb0755d0 2024-09-19T09:08:12.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb078120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb078120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50114/0 (socket says 172.21.15.1:50114) 2024-09-19T09:08:12.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c43fff640 1 -- 172.21.15.1:0/1684590436 learned_addr learned my addr 172.21.15.1:0/1684590436 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:12.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c42ffd640 1 --2- 172.21.15.1:0/1684590436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 0x5640fb08c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c43fff640 1 -- 172.21.15.1:0/1684590436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb0755d0 msgr2=0x5640fb071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c43fff640 1 --2- 172.21.15.1:0/1684590436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb0755d0 0x5640fb071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c43fff640 1 -- 172.21.15.1:0/1684590436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 msgr2=0x5640fb08c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c43fff640 1 --2- 172.21.15.1:0/1684590436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 0x5640fb08c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.579+0000 7f3c43fff640 1 -- 172.21.15.1:0/1684590436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640fb07b520 con 0x5640fb080370 2024-09-19T09:08:12.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c43fff640 1 --2- 172.21.15.1:0/1684590436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb078120 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009430 tx=0x7f3c3c0bbbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee7d7dd927c681f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c397fa640 1 -- 172.21.15.1:0/1684590436 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0d5050 con 0x5640fb080370 2024-09-19T09:08:12.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c397fa640 1 -- 172.21.15.1:0/1684590436 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c3c036040 con 0x5640fb080370 2024-09-19T09:08:12.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c397fa640 1 -- 172.21.15.1:0/1684590436 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0bcd80 con 0x5640fb080370 2024-09-19T09:08:12.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1684590436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 msgr2=0x5640fb078120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1684590436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb078120 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009430 tx=0x7f3c3c0bbbe0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1684590436 shutdown_connections 2024-09-19T09:08:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1684590436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb080370 0x5640fb078120 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1684590436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 0x5640fb08c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/1684590436 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb0755d0 0x5640fb071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1684590436 >> 172.21.15.1:0/1684590436 conn(0x5640fb03e310 msgr2=0x5640fb071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.580+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1684590436 shutdown_connections 2024-09-19T09:08:12.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/1684590436 wait complete. 2024-09-19T09:08:12.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 -- start start 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 Processor -- start 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb0755d0 0x5640fb088570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 0x5640fb088ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb080370 0x5640fb083a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441ade40 con 0x5640fb0755d0 2024-09-19T09:08:12.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441af2b0 con 0x5640fb076b40 2024-09-19T09:08:12.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441ae510 con 0x5640fb080370 2024-09-19T09:08:12.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.581+0000 7f3c4c0f0740 10 client.0 _ll_register_callbacks cb 0x7f3c3c004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:08:12.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb080370 0x5640fb083a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb0755d0 0x5640fb088570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 0x5640fb088ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb080370 0x5640fb083a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:40152/0 (socket says 172.21.15.1:40152) 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 -- 172.21.15.1:0/3541717786 learned_addr learned my addr 172.21.15.1:0/3541717786 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 -- 172.21.15.1:0/3541717786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 msgr2=0x5640fb088ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 0x5640fb088ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 -- 172.21.15.1:0/3541717786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb0755d0 msgr2=0x5640fb088570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb0755d0 0x5640fb088570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 -- 172.21.15.1:0/3541717786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640fb084210 con 0x5640fb080370 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c43fff640 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb080370 0x5640fb083a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009ca0 tx=0x7f3c3c0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6fd3346f671f702 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c22ffd640 1 -- 172.21.15.1:0/3541717786 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0d5070 con 0x5640fb080370 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c22ffd640 1 -- 172.21.15.1:0/3541717786 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3c3c0bc590 con 0x5640fb080370 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/3541717786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c3c036040 con 0x5640fb080370 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c22ffd640 1 -- 172.21.15.1:0/3541717786 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c3c0bd210 con 0x5640fb080370 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c4c0f0740 10 client.26119 fetch_fsmap learned FSMap version 28 2024-09-19T09:08:12.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.582+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/3541717786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640fb084210 con 0x5640fb080370 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c22ffd640 1 -- 172.21.15.1:0/3541717786 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c3c036040 con 0x5640fb080370 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c22ffd640 1 -- 172.21.15.1:0/3541717786 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3c3c04e040 con 0x5640fb080370 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c4c0f0740 10 client.26119 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c4c0f0740 10 client.26119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c4c0f0740 20 client.26119 populate_metadata read hostname 'smithi001' 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5640fb0fa990 0x5640fb0fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c4c0f0740 4 client.26119 mds_command: new command op to 24500 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/3541717786 --> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640fafe2d70 con 0x5640fb0fa990 2024-09-19T09:08:12.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.583+0000 7f3c437fe640 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5640fb0fa990 0x5640fb0fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c22ffd640 10 client.26119 ms_handle_connect on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c437fe640 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5640fb0fa990 0x5640fb0fcd80 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1233a1f9aef9e15 server_cookie=7346740cdfc1f13f in_seq=0 out_seq=0 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c22ffd640 1 -- 172.21.15.1:0/3541717786 <== mds.0 v2:172.21.15.22:6838/1767594317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640fafe2d70 con 0x5640fb0fa990 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c22ffd640 10 client.26119 handle_command_reply: tid=0 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 client.26119 shutdown 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/3541717786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb080370 msgr2=0x5640fb083a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb080370 0x5640fb083a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009ca0 tx=0x7f3c3c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/3541717786 shutdown_connections 2024-09-19T09:08:12.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.22:6838/1767594317,v1:172.21.15.22:6839/1767594317] conn(0x5640fb0fa990 0x5640fb0fcd80 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5640fb080370 0x5640fb083a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5640fb076b40 0x5640fb088ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 --2- 172.21.15.1:0/3541717786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640fb0755d0 0x5640fb088570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c22ffd640 0 client.26119 ms_handle_reset on v2:172.21.15.22:6838/1767594317 2024-09-19T09:08:12.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/3541717786 >> 172.21.15.1:0/3541717786 conn(0x5640fb03e310 msgr2=0x5640fb07f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/3541717786 shutdown_connections 2024-09-19T09:08:12.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 1 -- 172.21.15.1:0/3541717786 wait complete. 2024-09-19T09:08:12.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.584+0000 7f3c4c0f0740 20 client.26119 trim_cache size 0 max 16384 2024-09-19T09:08:12.614 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 -- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c300a3240 msgr2=0x7f3c300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c300a3240 0x7f3c300a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c023000 tx=0x7f3c2c01fd50 comp rx=0 tx=0).stop 2024-09-19T09:08:12.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 -- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44106a80 msgr2=0x7f3c440fd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44106a80 0x7f3c440fd7f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c006010 tx=0x7f3c3c003f10 comp rx=0 tx=0).stop 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 -- 172.21.15.1:0/2183047194 shutdown_connections 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c44106a80 0x7f3c440fd7f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f3c300a3240 0x7f3c300a5700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c44101420 0x7f3c440fd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 --2- 172.21.15.1:0/2183047194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c44100a80 0x7f3c440fcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:12.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 -- 172.21.15.1:0/2183047194 >> 172.21.15.1:0/2183047194 conn(0x7f3c440fc7a0 msgr2=0x7f3c4406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 -- 172.21.15.1:0/2183047194 shutdown_connections 2024-09-19T09:08:12.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:12.585+0000 7f3c49d17640 1 -- 172.21.15.1:0/2183047194 wait complete. 2024-09-19T09:08:13.353 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T09:08:13.354 INFO:tasks.fwd_scrub:done joining 2024-09-19T09:08:13.354 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T09:08:13.365 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:08:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.469+0000 7f13c422e640 1 -- 172.21.15.1:0/1399912018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc101c40 msgr2=0x7f13bc1020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.469+0000 7f13c422e640 1 --2- 172.21.15.1:0/1399912018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc101c40 0x7f13bc1020c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009900 tx=0x7f13ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:08:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 -- 172.21.15.1:0/1399912018 shutdown_connections 2024-09-19T09:08:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 --2- 172.21.15.1:0/1399912018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13bc102600 0x7f13bc108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 --2- 172.21.15.1:0/1399912018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc101c40 0x7f13bc1020c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 --2- 172.21.15.1:0/1399912018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13bc100a50 0x7f13bc100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 -- 172.21.15.1:0/1399912018 >> 172.21.15.1:0/1399912018 conn(0x7f13bc0fc190 msgr2=0x7f13bc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 -- 172.21.15.1:0/1399912018 shutdown_connections 2024-09-19T09:08:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 -- 172.21.15.1:0/1399912018 wait complete. 2024-09-19T09:08:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 Processor -- start 2024-09-19T09:08:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 -- start start 2024-09-19T09:08:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13bc100a50 0x7f13bc06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13bc101c40 0x7f13bc19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc102600 0x7f13bc1a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10c880 con 0x7f13bc102600 2024-09-19T09:08:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10c700 con 0x7f13bc100a50 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.470+0000 7f13c422e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc10ca00 con 0x7f13bc101c40 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc102600 0x7f13bc1a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc102600 0x7f13bc1a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50140/0 (socket says 172.21.15.1:50140) 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c1fca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13bc100a50 0x7f13bc06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 -- 172.21.15.1:0/4019997533 learned_addr learned my addr 172.21.15.1:0/4019997533 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c17c9640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13bc101c40 0x7f13bc19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 -- 172.21.15.1:0/4019997533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13bc101c40 msgr2=0x7f13bc19f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13bc101c40 0x7f13bc19f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 -- 172.21.15.1:0/4019997533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13bc100a50 msgr2=0x7f13bc06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13bc100a50 0x7f13bc06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 -- 172.21.15.1:0/4019997533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc1a1db0 con 0x7f13bc102600 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c27cb640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc102600 0x7f13bc1a15c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f13b400eb10 tx=0x7f13b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13b2ffd640 1 -- 172.21.15.1:0/4019997533 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4004b20 con 0x7f13bc102600 2024-09-19T09:08:13.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13b2ffd640 1 -- 172.21.15.1:0/4019997533 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13b4004cc0 con 0x7f13bc102600 2024-09-19T09:08:13.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13b2ffd640 1 -- 172.21.15.1:0/4019997533 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b40107f0 con 0x7f13bc102600 2024-09-19T09:08:13.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc1a1fe0 con 0x7f13bc102600 2024-09-19T09:08:13.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.471+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc1a2550 con 0x7f13bc102600 2024-09-19T09:08:13.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.472+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc107d70 con 0x7f13bc102600 2024-09-19T09:08:13.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.474+0000 7f13b2ffd640 1 -- 172.21.15.1:0/4019997533 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f13b4010990 con 0x7f13bc102600 2024-09-19T09:08:13.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.475+0000 7f13b2ffd640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13a80a3300 0x7f13a80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:13.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.476+0000 7f13b2ffd640 1 -- 172.21.15.1:0/4019997533 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f13b40cffe0 con 0x7f13bc102600 2024-09-19T09:08:13.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.476+0000 7f13c1fca640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13a80a3300 0x7f13a80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:13.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.476+0000 7f13c1fca640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13a80a3300 0x7f13a80a57c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f13b8005fd0 tx=0x7f13b800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:13.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.478+0000 7f13b2ffd640 1 -- 172.21.15.1:0/4019997533 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13b4054210 con 0x7f13bc102600 2024-09-19T09:08:13.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.665+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13bc02d9e0 con 0x7f13bc102600 2024-09-19T09:08:13.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.666+0000 7f13b2ffd640 1 -- 172.21.15.1:0/4019997533 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7f13b409cce0 con 0x7f13bc102600 2024-09-19T09:08:13.667 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:08:13.667 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:08:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.668+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13a80a3300 msgr2=0x7f13a80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.668+0000 7f13c422e640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13a80a3300 0x7f13a80a57c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f13b8005fd0 tx=0x7f13b800b410 comp rx=0 tx=0).stop 2024-09-19T09:08:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.668+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc102600 msgr2=0x7f13bc1a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.668+0000 7f13c422e640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc102600 0x7f13bc1a15c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f13b400eb10 tx=0x7f13b400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.669+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 shutdown_connections 2024-09-19T09:08:13.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.669+0000 7f13c422e640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13bc102600 0x7f13bc1a15c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.669+0000 7f13c422e640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f13a80a3300 0x7f13a80a57c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.669+0000 7f13c422e640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13bc101c40 0x7f13bc19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.669+0000 7f13c422e640 1 --2- 172.21.15.1:0/4019997533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13bc100a50 0x7f13bc06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.669+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 >> 172.21.15.1:0/4019997533 conn(0x7f13bc0fc190 msgr2=0x7f13bc104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.669+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 shutdown_connections 2024-09-19T09:08:13.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.669+0000 7f13c422e640 1 -- 172.21.15.1:0/4019997533 wait complete. 2024-09-19T09:08:13.681 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:57:30.365239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:01:58.505972+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:02:00.589422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:08:13.681 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.788+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/2636814299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 msgr2=0x7f1cb8108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.788+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/2636814299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 0x7f1cb8108e70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009900 tx=0x7f1cb002a410 comp rx=0 tx=0).stop 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.788+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/2636814299 shutdown_connections 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.788+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/2636814299 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 0x7f1cb8108e70 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.788+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/2636814299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cb8101c20 0x7f1cb81020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.788+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/2636814299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8100a30 0x7f1cb8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.788+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/2636814299 >> 172.21.15.1:0/2636814299 conn(0x7f1cb80fc190 msgr2=0x7f1cb80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/2636814299 shutdown_connections 2024-09-19T09:08:13.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/2636814299 wait complete. 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 Processor -- start 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 -- start start 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cb8100a30 0x7f1cb8197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8101c20 0x7f1cb8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 0x7f1cb819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb810da50 con 0x7f1cb81025e0 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb810d8d0 con 0x7f1cb8101c20 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbf3e8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb810dbd0 con 0x7f1cb8100a30 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbd985640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 0x7f1cb819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbd985640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 0x7f1cb819f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50144/0 (socket says 172.21.15.1:50144) 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.789+0000 7f1cbd985640 1 -- 172.21.15.1:0/3645460261 learned_addr learned my addr 172.21.15.1:0/3645460261 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbc983640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8101c20 0x7f1cb8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:13.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbd184640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cb8100a30 0x7f1cb8197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbd985640 1 -- 172.21.15.1:0/3645460261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cb8100a30 msgr2=0x7f1cb8197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbd985640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cb8100a30 0x7f1cb8197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbd985640 1 -- 172.21.15.1:0/3645460261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8101c20 msgr2=0x7f1cb8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbd985640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8101c20 0x7f1cb8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbd985640 1 -- 172.21.15.1:0/3645460261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb819faf0 con 0x7f1cb81025e0 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbc983640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8101c20 0x7f1cb8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbd985640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 0x7f1cb819f480 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0005ab0 tx=0x7f1cb0032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cb67fc640 1 -- 172.21.15.1:0/3645460261 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb003f030 con 0x7f1cb81025e0 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb819fd80 con 0x7f1cb81025e0 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cb67fc640 1 -- 172.21.15.1:0/3645460261 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1cb0003d00 con 0x7f1cb81025e0 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cb67fc640 1 -- 172.21.15.1:0/3645460261 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0035070 con 0x7f1cb81025e0 2024-09-19T09:08:13.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.790+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb81a0210 con 0x7f1cb81025e0 2024-09-19T09:08:13.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.791+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb8107d50 con 0x7f1cb81025e0 2024-09-19T09:08:13.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.793+0000 7f1cb67fc640 1 -- 172.21.15.1:0/3645460261 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1cb0042030 con 0x7f1cb81025e0 2024-09-19T09:08:13.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.793+0000 7f1cb67fc640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1ca00a3250 0x7f1ca00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:13.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.793+0000 7f1cb67fc640 1 -- 172.21.15.1:0/3645460261 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f1cb00f0220 con 0x7f1cb81025e0 2024-09-19T09:08:13.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.793+0000 7f1cbd184640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1ca00a3250 0x7f1ca00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:13.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.794+0000 7f1cbd184640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1ca00a3250 0x7f1ca00a5710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8101a80 tx=0x7f1ca8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:13.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.797+0000 7f1cb67fc640 1 -- 172.21.15.1:0/3645460261 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cb00bcf20 con 0x7f1cb81025e0 2024-09-19T09:08:13.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.976+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1cb8062e90 con 0x7f1cb81025e0 2024-09-19T09:08:13.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.976+0000 7f1cb67fc640 1 -- 172.21.15.1:0/3645460261 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f1cb00bc820 con 0x7f1cb81025e0 2024-09-19T09:08:13.977 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-19T09:08:13.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1ca00a3250 msgr2=0x7f1ca00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1ca00a3250 0x7f1ca00a5710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8101a80 tx=0x7f1ca8009500 comp rx=0 tx=0).stop 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 msgr2=0x7f1cb819f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 0x7f1cb819f480 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0005ab0 tx=0x7f1cb0032cf0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 shutdown_connections 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1cb81025e0 0x7f1cb819f480 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8101c20 0x7f1cb8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1ca00a3250 0x7f1ca00a5710 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 --2- 172.21.15.1:0/3645460261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1cb8100a30 0x7f1cb8197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 >> 172.21.15.1:0/3645460261 conn(0x7f1cb80fc190 msgr2=0x7f1cb8104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 shutdown_connections 2024-09-19T09:08:13.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:13.979+0000 7f1cbf3e8640 1 -- 172.21.15.1:0/3645460261 wait complete. 2024-09-19T09:08:13.989 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:13 smithi001 ceph-mon[30939]: pgmap v461: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 148 KiB/s wr, 63 op/s 2024-09-19T09:08:13.989 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:13.989 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:13.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:13.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:13 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:08:13.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:13 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4019997533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:08:13.991 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/4282596988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68102d10 msgr2=0x7fbd68103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/4282596988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68102d10 0x7fbd68103190 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009900 tx=0x7fbd5c02a410 comp rx=0 tx=0).stop 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/4282596988 shutdown_connections 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/4282596988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd681036d0 0x7fbd68109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/4282596988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68102d10 0x7fbd68103190 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/4282596988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd68101b20 0x7fbd68101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/4282596988 >> 172.21.15.1:0/4282596988 conn(0x7fbd680fd2a0 msgr2=0x7fbd680ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/4282596988 shutdown_connections 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/4282596988 wait complete. 2024-09-19T09:08:14.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.097+0000 7fbd6e6d0640 1 Processor -- start 2024-09-19T09:08:14.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd6e6d0640 1 -- start start 2024-09-19T09:08:14.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd6e6d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68101b20 0x7fbd68197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd6e6d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd68102d10 0x7fbd68198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd6e6d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd681036d0 0x7fbd6819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd6e6d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6810d900 con 0x7fbd68101b20 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd6e6d0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6810d780 con 0x7fbd681036d0 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd6e6d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6810da80 con 0x7fbd68102d10 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68101b20 0x7fbd68197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68101b20 0x7fbd68197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50164/0 (socket says 172.21.15.1:50164) 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 -- 172.21.15.1:0/3698312636 learned_addr learned my addr 172.21.15.1:0/3698312636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd6cc6d640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd681036d0 0x7fbd6819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 -- 172.21.15.1:0/3698312636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd68102d10 msgr2=0x7fbd68198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd68102d10 0x7fbd68198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 -- 172.21.15.1:0/3698312636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd681036d0 msgr2=0x7fbd6819f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd681036d0 0x7fbd6819f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 -- 172.21.15.1:0/3698312636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6819fb60 con 0x7fbd68101b20 2024-09-19T09:08:14.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.098+0000 7fbd67fff640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68101b20 0x7fbd68197f40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800e9c0 tx=0x7fbd5800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:14.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.099+0000 7fbd657fa640 1 -- 172.21.15.1:0/3698312636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800cd80 con 0x7fbd68101b20 2024-09-19T09:08:14.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.099+0000 7fbd657fa640 1 -- 172.21.15.1:0/3698312636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbd580035f0 con 0x7fbd68101b20 2024-09-19T09:08:14.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.099+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6819fe50 con 0x7fbd68101b20 2024-09-19T09:08:14.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.099+0000 7fbd657fa640 1 -- 172.21.15.1:0/3698312636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58010670 con 0x7fbd68101b20 2024-09-19T09:08:14.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.099+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a02c0 con 0x7fbd68101b20 2024-09-19T09:08:14.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.100+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd68108ec0 con 0x7fbd68101b20 2024-09-19T09:08:14.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.102+0000 7fbd657fa640 1 -- 172.21.15.1:0/3698312636 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fbd580037a0 con 0x7fbd68101b20 2024-09-19T09:08:14.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.102+0000 7fbd657fa640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbd500a3250 0x7fbd500a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.103+0000 7fbd657fa640 1 -- 172.21.15.1:0/3698312636 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fbd580cfe70 con 0x7fbd68101b20 2024-09-19T09:08:14.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.103+0000 7fbd677fe640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbd500a3250 0x7fbd500a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.103+0000 7fbd677fe640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbd500a3250 0x7fbd500a5710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005c20 tx=0x7fbd5c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:13 smithi064 ceph-mon[35179]: pgmap v461: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 148 KiB/s wr, 63 op/s 2024-09-19T09:08:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:13 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:08:14.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:13 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4019997533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:08:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.105+0000 7fbd657fa640 1 -- 172.21.15.1:0/3698312636 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd5809cb70 con 0x7fbd68101b20 2024-09-19T09:08:14.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:13 smithi022 ceph-mon[35107]: pgmap v461: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 148 KiB/s wr, 63 op/s 2024-09-19T09:08:14.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:08:14.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:14.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:08:14.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:13 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' 2024-09-19T09:08:14.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:13 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4019997533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:08:14.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.282+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbd6802da30 con 0x7fbd68101b20 2024-09-19T09:08:14.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.282+0000 7fbd657fa640 1 -- 172.21.15.1:0/3698312636 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7fbd5809c470 con 0x7fbd68101b20 2024-09-19T09:08:14.283 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-19T09:08:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.284+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbd500a3250 msgr2=0x7fbd500a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.284+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbd500a3250 0x7fbd500a5710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005c20 tx=0x7fbd5c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.284+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68101b20 msgr2=0x7fbd68197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.284+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68101b20 0x7fbd68197f40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800e9c0 tx=0x7fbd5800ee80 comp rx=0 tx=0).stop 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.285+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 shutdown_connections 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.285+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd681036d0 0x7fbd6819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.285+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbd500a3250 0x7fbd500a5710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.285+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd68102d10 0x7fbd68198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.285+0000 7fbd6e6d0640 1 --2- 172.21.15.1:0/3698312636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd68101b20 0x7fbd68197f40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.285+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 >> 172.21.15.1:0/3698312636 conn(0x7fbd680fd2a0 msgr2=0x7fbd68106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.285+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 shutdown_connections 2024-09-19T09:08:14.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.285+0000 7fbd6e6d0640 1 -- 172.21.15.1:0/3698312636 wait complete. 2024-09-19T09:08:14.296 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 -- 172.21.15.1:0/251844348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 msgr2=0x7fcd601007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 --2- 172.21.15.1:0/251844348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 0x7fcd601007a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009900 tx=0x7fcd5c02a410 comp rx=0 tx=0).stop 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 -- 172.21.15.1:0/251844348 shutdown_connections 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 --2- 172.21.15.1:0/251844348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd60101680 0x7fcd60101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 --2- 172.21.15.1:0/251844348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd60100ce0 0x7fcd60101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 --2- 172.21.15.1:0/251844348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 0x7fcd601007a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 -- 172.21.15.1:0/251844348 >> 172.21.15.1:0/251844348 conn(0x7fcd600fc190 msgr2=0x7fcd600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 -- 172.21.15.1:0/251844348 shutdown_connections 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 -- 172.21.15.1:0/251844348 wait complete. 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 Processor -- start 2024-09-19T09:08:14.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.402+0000 7fcd67c27640 1 -- start start 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd67c27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 0x7fcd6019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd67c27640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd60100ce0 0x7fcd6019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd67c27640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd60101680 0x7fcd601a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd67c27640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6010fb00 con 0x7fcd601003a0 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd67c27640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6010f980 con 0x7fcd60100ce0 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd67c27640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6010fc80 con 0x7fcd60101680 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 0x7fcd6019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 0x7fcd6019a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50172/0 (socket says 172.21.15.1:50172) 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 -- 172.21.15.1:0/1912696868 learned_addr learned my addr 172.21.15.1:0/1912696868 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd651c2640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd60100ce0 0x7fcd6019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd661c4640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd60101680 0x7fcd601a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 -- 172.21.15.1:0/1912696868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd60101680 msgr2=0x7fcd601a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd60101680 0x7fcd601a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 -- 172.21.15.1:0/1912696868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd60100ce0 msgr2=0x7fcd6019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd60100ce0 0x7fcd6019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 -- 172.21.15.1:0/1912696868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd601a1d00 con 0x7fcd601003a0 2024-09-19T09:08:14.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd659c3640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 0x7fcd6019a0e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009a20 tx=0x7fcd5c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:14.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd56ffd640 1 -- 172.21.15.1:0/1912696868 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c03f030 con 0x7fcd601003a0 2024-09-19T09:08:14.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd56ffd640 1 -- 172.21.15.1:0/1912696868 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcd5c003d00 con 0x7fcd601003a0 2024-09-19T09:08:14.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd601a1f90 con 0x7fcd601003a0 2024-09-19T09:08:14.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.403+0000 7fcd56ffd640 1 -- 172.21.15.1:0/1912696868 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c035070 con 0x7fcd601003a0 2024-09-19T09:08:14.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.404+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd601a23a0 con 0x7fcd601003a0 2024-09-19T09:08:14.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.404+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6010b0f0 con 0x7fcd601003a0 2024-09-19T09:08:14.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.406+0000 7fcd56ffd640 1 -- 172.21.15.1:0/1912696868 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fcd5c042030 con 0x7fcd601003a0 2024-09-19T09:08:14.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.406+0000 7fcd56ffd640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd4c0a3250 0x7fcd4c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.406+0000 7fcd651c2640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd4c0a3250 0x7fcd4c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.406+0000 7fcd56ffd640 1 -- 172.21.15.1:0/1912696868 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fcd5c0eff80 con 0x7fcd601003a0 2024-09-19T09:08:14.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.407+0000 7fcd651c2640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd4c0a3250 0x7fcd4c0a5710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd6019b5f0 tx=0x7fcd5000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:14.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.414+0000 7fcd56ffd640 1 -- 172.21.15.1:0/1912696868 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd5c0bc630 con 0x7fcd601003a0 2024-09-19T09:08:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.591+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcd60062f30 con 0x7fcd601003a0 2024-09-19T09:08:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.591+0000 7fcd56ffd640 1 -- 172.21.15.1:0/1912696868 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7fcd5c0c0930 con 0x7fcd601003a0 2024-09-19T09:08:14.592 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-19T09:08:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd4c0a3250 msgr2=0x7fcd4c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd4c0a3250 0x7fcd4c0a5710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd6019b5f0 tx=0x7fcd5000b410 comp rx=0 tx=0).stop 2024-09-19T09:08:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 msgr2=0x7fcd6019a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 0x7fcd6019a0e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009a20 tx=0x7fcd5c004430 comp rx=0 tx=0).stop 2024-09-19T09:08:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 shutdown_connections 2024-09-19T09:08:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd4c0a3250 0x7fcd4c0a5710 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd60101680 0x7fcd601a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd60100ce0 0x7fcd6019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 --2- 172.21.15.1:0/1912696868 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd601003a0 0x7fcd6019a0e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 >> 172.21.15.1:0/1912696868 conn(0x7fcd600fc190 msgr2=0x7fcd600fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 shutdown_connections 2024-09-19T09:08:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.593+0000 7fcd67c27640 1 -- 172.21.15.1:0/1912696868 wait complete. 2024-09-19T09:08:14.605 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T09:08:14.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.706+0000 7f1e68823640 1 -- 172.21.15.1:0/1030370225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64101c40 msgr2=0x7f1e641020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.706+0000 7f1e68823640 1 --2- 172.21.15.1:0/1030370225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64101c40 0x7f1e641020c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009900 tx=0x7f1e4c02a410 comp rx=0 tx=0).stop 2024-09-19T09:08:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.706+0000 7f1e68823640 1 -- 172.21.15.1:0/1030370225 shutdown_connections 2024-09-19T09:08:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.706+0000 7f1e68823640 1 --2- 172.21.15.1:0/1030370225 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e64102600 0x7f1e64108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.706+0000 7f1e68823640 1 --2- 172.21.15.1:0/1030370225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64101c40 0x7f1e641020c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.706+0000 7f1e68823640 1 --2- 172.21.15.1:0/1030370225 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e64100a50 0x7f1e64100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.707+0000 7f1e68823640 1 -- 172.21.15.1:0/1030370225 >> 172.21.15.1:0/1030370225 conn(0x7f1e640fc1b0 msgr2=0x7f1e640fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.707+0000 7f1e68823640 1 -- 172.21.15.1:0/1030370225 shutdown_connections 2024-09-19T09:08:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.707+0000 7f1e68823640 1 -- 172.21.15.1:0/1030370225 wait complete. 2024-09-19T09:08:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.707+0000 7f1e68823640 1 Processor -- start 2024-09-19T09:08:14.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.707+0000 7f1e68823640 1 -- start start 2024-09-19T09:08:14.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e68823640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e64100a50 0x7f1e64197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e68823640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e64101c40 0x7f1e64198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e68823640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64102600 0x7f1e6419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e68823640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410c830 con 0x7f1e64102600 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e68823640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410c6b0 con 0x7f1e64101c40 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e68823640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410c9b0 con 0x7f1e64100a50 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64102600 0x7f1e6419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64102600 0x7f1e6419f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50192/0 (socket says 172.21.15.1:50192) 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 -- 172.21.15.1:0/660699005 learned_addr learned my addr 172.21.15.1:0/660699005 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e59d9b640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e64101c40 0x7f1e64198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e6259c640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e64100a50 0x7f1e64197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 -- 172.21.15.1:0/660699005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e64100a50 msgr2=0x7f1e64197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e64100a50 0x7f1e64197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 -- 172.21.15.1:0/660699005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e64101c40 msgr2=0x7f1e64198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e64101c40 0x7f1e64198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 -- 172.21.15.1:0/660699005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6419fb60 con 0x7f1e64102600 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e59d9b640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e64101c40 0x7f1e64198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e62d9d640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64102600 0x7f1e6419f4f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00eaa0 tx=0x7f1e5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e5bfff640 1 -- 172.21.15.1:0/660699005 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00cdb0 con 0x7f1e64102600 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e5bfff640 1 -- 172.21.15.1:0/660699005 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1e5c004b20 con 0x7f1e64102600 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6419fe50 con 0x7f1e64102600 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.708+0000 7f1e5bfff640 1 -- 172.21.15.1:0/660699005 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c011760 con 0x7f1e64102600 2024-09-19T09:08:14.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.709+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e641a02c0 con 0x7f1e64102600 2024-09-19T09:08:14.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.709+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e641a0550 con 0x7f1e64102600 2024-09-19T09:08:14.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.711+0000 7f1e5bfff640 1 -- 172.21.15.1:0/660699005 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1e5c004cd0 con 0x7f1e64102600 2024-09-19T09:08:14.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.712+0000 7f1e5bfff640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e500a3250 0x7f1e500a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:14.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.712+0000 7f1e6259c640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e500a3250 0x7f1e500a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:14.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.712+0000 7f1e5bfff640 1 -- 172.21.15.1:0/660699005 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f1e5c0cfb30 con 0x7f1e64102600 2024-09-19T09:08:14.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.712+0000 7f1e6259c640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e500a3250 0x7f1e500a5710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1e64101aa0 tx=0x7f1e54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:14.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.716+0000 7f1e5bfff640 1 -- 172.21.15.1:0/660699005 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e5c016030 con 0x7f1e64102600 2024-09-19T09:08:14.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.942+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f1e641a07c0 con 0x7f1e64102600 2024-09-19T09:08:14.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.950+0000 7f1e5bfff640 1 -- 172.21.15.1:0/660699005 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+742329 (secure 0 0 0) 0x7f1e5c09c1e0 con 0x7f1e64102600 2024-09-19T09:08:14.963 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:08:14.963 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:14.963 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 20, 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "active_gid": 14150, 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "active_name": "x", 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addrs": { 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6800", 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 554641341 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:14.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6801", 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 554641341 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addr": "172.21.15.1:6801/554641341", 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "active_change": "2024-09-19T08:55:09.857153+0000", 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "available": true, 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "standbys": [ 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24109, 2024-09-19T09:08:14.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "z", 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:14.968 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.969 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:14.971 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.974 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.975 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T09:08:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.979 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.980 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.981 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T09:08:14.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T09:08:14.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.984 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:08:14.985 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:08:14.986 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:08:14.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.989 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:14.991 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:14.992 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:14.993 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:14.994 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.995 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.996 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:14.997 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:14.998 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:14.999 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.000 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.001 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.002 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.003 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.004 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.005 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.006 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.007 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T09:08:15.008 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.009 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.010 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.011 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.012 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.013 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.014 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T09:08:15.016 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.017 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.018 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.019 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.020 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.021 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.022 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.023 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.024 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.025 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.026 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.027 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.028 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.029 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.030 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.031 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.032 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.033 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.034 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.035 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.036 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.037 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.038 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.039 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.040 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.041 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T09:08:15.042 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T09:08:15.043 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.043 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.043 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.043 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.043 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.043 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.043 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.043 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.044 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.045 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.046 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:08:15.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:08:15.048 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T09:08:15.049 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T09:08:15.050 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T09:08:15.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.052 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:08:15.053 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.054 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.055 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.056 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T09:08:15.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.058 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T09:08:15.059 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:08:15.060 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T09:08:15.061 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T09:08:15.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T09:08:15.063 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T09:08:15.064 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.065 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.066 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.067 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.068 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.069 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.070 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.071 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.072 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.073 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.074 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.075 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:08:15.076 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:08:15.077 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.079 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.080 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.081 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:08:15.082 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:08:15.083 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:08:15.084 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:08:15.085 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:08:15.088 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:08:15.089 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:08:15.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:08:15.091 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.092 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.093 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.094 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.095 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.096 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.097 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.098 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.099 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.100 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.101 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.104 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.105 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.108 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.109 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.110 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.113 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.114 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.116 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.117 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.120 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.121 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.122 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.123 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.124 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.125 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.126 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.128 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.129 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.131 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.132 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T09:08:15.133 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T09:08:15.135 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.136 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:08:15.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.138 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T09:08:15.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.141 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.143 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.146 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.148 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:08:15.149 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:08:15.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:08:15.152 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.154 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.157 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.160 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.161 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T09:08:15.162 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T09:08:15.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T09:08:15.165 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.169 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.170 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T09:08:15.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T09:08:15.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.176 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.177 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.178 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.179 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.181 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.186 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:08:15.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.191 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.193 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.197 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.200 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.202 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.206 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.207 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.209 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.211 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.212 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.213 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.214 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.217 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.218 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.219 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.220 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.222 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.223 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:08:15.224 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.225 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.226 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.228 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.230 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T09:08:15.231 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.232 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.233 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.234 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.237 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.238 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.240 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.241 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.244 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.245 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.247 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.250 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.252 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.255 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.256 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.257 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.258 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.258 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.258 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.258 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.258 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.258 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.258 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.260 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T09:08:15.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T09:08:15.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.260 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.263 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.265 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.266 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.268 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.269 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.272 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.275 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T09:08:15.276 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:08:15.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.278 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.281 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:08:15.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:08:15.284 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T09:08:15.285 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.286 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.288 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.289 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.291 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.292 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.293 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.294 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.296 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.297 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.300 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.303 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.304 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.306 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.311 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.312 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.317 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.319 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.322 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.323 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.324 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.325 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.326 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.327 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.328 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.329 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.332 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.333 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.334 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.336 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.338 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.341 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.345 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T09:08:15.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.347 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.348 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.349 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.351 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.352 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.353 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.355 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.356 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.357 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.360 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:08:15.361 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.362 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T09:08:15.363 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.364 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.365 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.366 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.367 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.369 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.370 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.371 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.372 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.373 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.374 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T09:08:15.375 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.376 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.377 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.379 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.380 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.381 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.382 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.383 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.384 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.385 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.386 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.387 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:08:15.388 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:08:15.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.393 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.395 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.396 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.397 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:08:15.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.402 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24116, 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "y", 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.403 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.404 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.407 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.408 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.410 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.411 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:08:15.416 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.418 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T09:08:15.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:08:15.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T09:08:15.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T09:08:15.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T09:08:15.424 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T09:08:15.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.426 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.429 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.430 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:08:15.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T09:08:15.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.435 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:08:15.436 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:08:15.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T09:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T09:08:15.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T09:08:15.440 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T09:08:15.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.442 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.443 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T09:08:15.445 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:08:15.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:08:15.456 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:08:15.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.459 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.468 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.471 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T09:08:15.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T09:08:15.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.477 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.480 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.481 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:08:15.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:08:15.491 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:08:15.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:08:15.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:08:15.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.500 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.504 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.507 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.510 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.515 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.518 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.518 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:08:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:08:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.522 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.524 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.525 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.526 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.527 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.528 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.530 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.536 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.544 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.547 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.548 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.549 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.552 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.555 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.564 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.565 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.572 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.573 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:08:15.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.577 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.578 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.583 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.585 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.593 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.594 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:08:15.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.596 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T09:08:15.598 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.599 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:08:15.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:08:15.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:08:15.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.603 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:08:15.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T09:08:15.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:08:15.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:08:15.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:08:15.612 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.617 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.619 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.620 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.630 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.632 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.634 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.637 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.641 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.644 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.645 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.651 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.657 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.659 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.661 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.663 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T09:08:15.668 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.669 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.670 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.672 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.674 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.676 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.677 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.678 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.680 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.681 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.690 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.691 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.693 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.694 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.697 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.698 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.700 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.701 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.707 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.709 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T09:08:15.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T09:08:15.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:08:15.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.717 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T09:08:15.722 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.725 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.727 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.728 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.729 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.731 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.732 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.735 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.736 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.738 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.739 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.740 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.741 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.743 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.744 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.745 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.746 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.747 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.748 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.751 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.752 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.753 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.754 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.755 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.756 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T09:08:15.757 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.759 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.760 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T09:08:15.762 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.763 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.765 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.766 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.767 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.768 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.769 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.770 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.771 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.772 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.773 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.774 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.776 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.777 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.778 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.779 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.780 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.782 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.783 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.784 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.785 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.786 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.788 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.789 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.790 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.792 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.793 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.795 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.796 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.797 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.798 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.799 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.800 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.801 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.802 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.803 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.804 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.805 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.860 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T09:08:15.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T09:08:15.862 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.863 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.864 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.865 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.868 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.869 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.870 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.872 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.872 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.872 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.872 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.873 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.874 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.875 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.876 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.878 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.879 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.880 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.882 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.883 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.884 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.885 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.886 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.887 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.888 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.889 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.890 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.891 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.893 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: "modules": [ 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard", 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: "iostat", 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: "nfs", 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: "restful" 2024-09-19T09:08:15.894 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.895 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.896 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.897 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.898 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.899 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.900 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.902 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.903 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.904 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.905 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.906 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.907 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T09:08:15.908 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.909 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.910 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.911 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:08:15.912 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:08:15.913 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.913 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:08:15.913 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:08:15.913 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.913 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.913 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.913 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T09:08:15.913 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:08:15.914 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:08:15.915 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.916 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.917 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.918 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.919 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.920 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.921 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.922 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.923 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.924 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.925 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.926 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.927 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.928 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.929 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.930 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.931 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.932 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.933 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.934 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:08:15.935 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.936 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.937 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.938 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T09:08:15.939 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.940 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T09:08:15.941 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.942 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.943 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.944 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.945 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.946 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.947 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.948 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.950 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.951 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.952 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.953 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T09:08:15.954 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:08:15.955 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.956 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.957 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.958 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.959 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.960 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.961 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T09:08:15.962 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.963 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.964 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T09:08:15.965 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T09:08:15.966 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.967 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.968 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.969 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.970 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.971 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.972 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:15.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.977 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.978 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.979 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.980 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.981 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T09:08:15.982 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.983 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.986 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.987 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.988 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T09:08:15.990 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T09:08:15.991 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.992 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.993 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.994 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.996 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:15.997 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:15.998 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:15.999 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.000 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.002 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.003 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.004 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.005 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.006 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:08:16.007 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.008 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.009 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.010 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.011 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.012 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.014 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.015 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.016 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.017 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.018 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.019 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.020 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:08:16.021 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:08:16.022 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:08:16.023 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:08:16.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.027 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.028 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.029 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.030 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.031 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.032 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.033 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.034 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.035 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.036 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.037 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.038 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.039 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.040 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:08:16.041 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:08:16.042 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:08:16.043 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.044 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.046 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.047 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.048 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.049 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.050 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.051 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.053 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:08:16.054 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.055 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.056 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.057 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.058 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.059 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.060 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.061 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.062 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:08:16.063 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:16.064 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.065 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.066 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.067 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.068 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.069 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.070 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.071 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T09:08:16.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T09:08:16.073 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.073 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.073 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.073 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.073 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.073 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.073 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.073 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T09:08:16.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.077 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.079 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.080 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.081 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.082 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.083 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.084 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:16.087 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.088 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.089 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.090 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.092 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.093 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.094 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.095 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.097 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:08:16.099 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.100 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.101 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.102 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.103 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.104 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.105 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.106 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.108 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.109 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T09:08:16.110 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:16.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.113 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T09:08:16.114 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.115 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.117 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.118 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.121 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.123 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.124 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.125 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T09:08:16.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.128 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.131 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.132 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.133 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.134 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.135 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.136 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:08:16.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.141 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.142 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.143 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T09:08:16.144 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.145 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.146 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.147 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.149 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.150 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.150 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.150 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.151 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.153 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.155 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.156 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.157 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.161 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.162 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.163 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.165 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.166 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.168 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.169 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T09:08:16.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.172 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.173 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.174 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.177 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.179 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.180 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.181 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.182 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.183 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.185 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.187 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.188 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:16.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T09:08:16.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.192 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.193 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.197 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.198 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T09:08:16.201 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:08:16.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.204 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.205 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.208 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:08:16.212 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T09:08:16.213 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.214 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:08:16.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.217 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.220 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.221 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T09:08:16.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.227 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.228 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.229 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.230 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.232 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.233 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.234 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.236 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.238 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.240 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.243 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.244 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.247 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.248 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T09:08:16.250 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.251 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.253 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.255 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.256 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.257 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.258 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.259 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.260 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.262 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.264 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.266 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T09:08:16.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.268 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.269 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.271 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.272 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.273 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.274 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.275 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.276 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.280 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.281 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T09:08:16.282 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.283 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.284 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.286 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.288 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.289 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.290 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.291 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.292 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.293 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.295 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T09:08:16.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T09:08:16.297 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T09:08:16.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T09:08:16.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.300 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.301 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.302 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.303 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.304 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.305 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.308 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.310 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.312 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.313 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.314 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.316 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.317 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.318 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.319 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.320 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.321 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.322 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.325 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.328 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:08:16.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T09:08:16.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.332 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.333 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T09:08:16.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T09:08:16.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.336 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.337 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.338 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.339 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.341 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.342 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.343 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.344 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:08:16.345 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: "services": { 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard": "https://172.21.15.1:8443/" 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: "always_on_modules": { 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: "octopus": [ 2024-09-19T09:08:16.346 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "pacific": [ 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:08:16.347 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "quincy": [ 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:08:16.348 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "reef": [ 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:08:16.349 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "squid": [ 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:08:16.350 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "last_failure_osd_epoch": 3, 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "active_clients": [ 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T09:08:16.351 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1715378460 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "libcephsqlite", 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:08:16.352 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1895823207 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 834753591 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.353 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2627107171 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:08:16.354 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e500a3250 msgr2=0x7f1e500a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e500a3250 0x7f1e500a5710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1e64101aa0 tx=0x7f1e54005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64102600 msgr2=0x7f1e6419f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64102600 0x7f1e6419f4f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00eaa0 tx=0x7f1e5c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:08:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 shutdown_connections 2024-09-19T09:08:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e64102600 0x7f1e6419f4f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e64101c40 0x7f1e64198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:16.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e500a3250 0x7f1e500a5710 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:16.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 --2- 172.21.15.1:0/660699005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e64100a50 0x7f1e64197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:16.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 >> 172.21.15.1:0/660699005 conn(0x7f1e640fc1b0 msgr2=0x7f1e6406a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:16.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 shutdown_connections 2024-09-19T09:08:16.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:14.956+0000 7f1e68823640 1 -- 172.21.15.1:0/660699005 wait complete. 2024-09-19T09:08:16.357 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:14 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3645460261' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.357 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:14 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3698312636' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.357 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:14 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/1912696868' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:14 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3645460261' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:14 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3698312636' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:14 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/1912696868' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:15 smithi022 ceph-mon[35107]: pgmap v462: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 148 KiB/s wr, 64 op/s 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:15 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/660699005' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:14 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3645460261' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:14 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3698312636' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:14 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/1912696868' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:15 smithi064 ceph-mon[35179]: pgmap v462: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 148 KiB/s wr, 64 op/s 2024-09-19T09:08:16.358 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:15 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/660699005' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:08:16.419 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T09:08:16.419 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T09:08:16.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:15 smithi001 ceph-mon[30939]: pgmap v462: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 148 KiB/s wr, 64 op/s 2024-09-19T09:08:16.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:15 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/660699005' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:08:16.689 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:17.448 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 112, 2024-09-19T09:08:17.448 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 107, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 725776, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 64688, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.019392725, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.007241080, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.016016612, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 106, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.005520743, 2024-09-19T09:08:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000052082 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 725776, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 64688 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 5, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 83, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 3184, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 93232, 2024-09-19T09:08:17.450 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.009642995, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.005355632, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.003454543, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 82, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.010729527, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000130847 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:17.451 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 93232 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.000314494, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:08:17.452 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000235481, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:08:17.453 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:17.454 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:17.455 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:17.456 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148863, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 28, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:17.457 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 113, 2024-09-19T09:08:17.458 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 709982, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 113, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 113, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 709982, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:17.459 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:18.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:17 smithi001 ceph-mon[30939]: pgmap v463: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 19 op/s 2024-09-19T09:08:18.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:17 smithi064 ceph-mon[35179]: pgmap v463: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 19 op/s 2024-09-19T09:08:18.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:17 smithi022 ceph-mon[35107]: pgmap v463: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 19 op/s 2024-09-19T09:08:18.948 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T09:08:18.948 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T09:08:18.949 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T09:08:18.949 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T09:08:19.213 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.001328403, 2024-09-19T09:08:19.841 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000298225, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.842 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 122, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 115, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 730432, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 68976, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.021303447, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.007046542, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.020492305, 2024-09-19T09:08:19.843 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 115, 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.010326414, 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000089794 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 730432, 2024-09-19T09:08:19.844 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 68976 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 85, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 93488, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.006963132, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.004837587, 2024-09-19T09:08:19.845 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001205325, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 83, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004063035, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000048952 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 93488 2024-09-19T09:08:19.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:19.847 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:19.848 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:19.849 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148863, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 28, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-19T09:08:19.850 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 119, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 710762, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 119, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 119, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 710762, 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-19T09:08:19.852 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:19.853 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:19.853 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:19.853 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:19.853 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:19.853 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:20.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:19 smithi001 ceph-mon[30939]: pgmap v464: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T09:08:20.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:19 smithi064 ceph-mon[35179]: pgmap v464: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T09:08:20.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:19 smithi022 ceph-mon[35107]: pgmap v464: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T09:08:20.636 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T09:08:20.636 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T09:08:20.636 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T09:08:20.637 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T09:08:20.899 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 114, 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 109, 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 726320, 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 65968, 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.020066079, 2024-09-19T09:08:21.386 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.007866197, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.016357570, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 108, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.006138974, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000056842 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.387 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 726320, 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 65968 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 82, 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 92960, 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-19T09:08:21.388 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.006838924, 2024-09-19T09:08:21.389 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.004718940, 2024-09-19T09:08:21.389 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001158718, 2024-09-19T09:08:21.389 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:21.389 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:21.389 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 80, 2024-09-19T09:08:21.389 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.003788476, 2024-09-19T09:08:21.389 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000047355 2024-09-19T09:08:21.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 92960 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.393 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 4, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 4, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 3024, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 448, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.002301933, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000033399, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.002234256, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004169704, 2024-09-19T09:08:21.394 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001389901 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-19T09:08:21.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:21.396 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:21.397 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:21.398 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148823, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 27, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-19T09:08:21.399 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-19T09:08:21.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 115, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 710242, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 115, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 115, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 710242, 2024-09-19T09:08:21.401 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-19T09:08:21.402 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:21.402 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:21.402 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:21.402 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:21.402 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:21.402 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:22.032 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:21 smithi001 ceph-mon[30939]: pgmap v465: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-19T09:08:22.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:21 smithi064 ceph-mon[35179]: pgmap v465: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-19T09:08:22.158 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T09:08:22.158 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T09:08:22.158 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T09:08:22.158 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T09:08:22.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:21 smithi022 ceph-mon[35107]: pgmap v465: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-19T09:08:22.415 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:23.037 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:08:23.037 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.001327296, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000243103, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:23.038 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:23.039 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-19T09:08:23.040 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 86, 2024-09-19T09:08:23.040 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:08:23.040 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 93664, 2024-09-19T09:08:23.040 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-19T09:08:23.040 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-19T09:08:23.040 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.007577984, 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.005409224, 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001242035, 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 84, 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004162693, 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000049555 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.041 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:23.042 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:23.042 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:23.042 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:23.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.042 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:08:23.042 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 93664 2024-09-19T09:08:23.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.042 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 123, 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 116, 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 730704, 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 69616, 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.022400093, 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.007431472, 2024-09-19T09:08:23.043 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.020502693, 2024-09-19T09:08:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 116, 2024-09-19T09:08:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.009922397, 2024-09-19T09:08:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000085537 2024-09-19T09:08:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:23.044 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 730704, 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 69616 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-19T09:08:23.045 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-19T09:08:23.046 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.046 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-19T09:08:23.046 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:23.046 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:23.046 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:23.046 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:23.046 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:23.046 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:23.047 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:23.048 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:23.048 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:23.048 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:23.048 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:23.048 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:23.048 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:23.048 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:23.048 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:23.049 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:23.050 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-19T09:08:23.050 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:23.050 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:23.050 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:23.050 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:23.050 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148863, 2024-09-19T09:08:23.050 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 28, 2024-09-19T09:08:23.050 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-19T09:08:23.051 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-19T09:08:23.052 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:23.052 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:23.052 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:23.052 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-19T09:08:23.052 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-19T09:08:23.052 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-19T09:08:23.052 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:23.052 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-19T09:08:23.053 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:23.053 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-19T09:08:23.053 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:08:23.053 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:23.053 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-19T09:08:23.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-19T09:08:23.053 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-19T09:08:23.053 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 120, 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 710892, 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 120, 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 120, 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 710892, 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-19T09:08:23.054 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:08:23.055 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:08:23.055 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:08:23.055 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:23.055 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:08:23.055 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:08:23.921 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T09:08:23.921 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T09:08:23.921 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T09:08:23.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T09:08:24.010 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:23 smithi022 ceph-mon[35107]: pgmap v466: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:08:24.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:23 smithi001 ceph-mon[30939]: pgmap v466: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:08:24.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:23 smithi064 ceph-mon[35179]: pgmap v466: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:08:24.193 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:08:24.712 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:08:24.712 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:24.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 14993, 2024-09-19T09:08:24.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 14506, 2024-09-19T09:08:24.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 4758543, 2024-09-19T09:08:24.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 61271000, 2024-09-19T09:08:24.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 93, 2024-09-19T09:08:24.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 4, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 1.133927053, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.501658124, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.320308033, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.277027695, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 14504, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 6.555769074, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000451997 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 6766, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000986673, 2024-09-19T09:08:24.713 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000145 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 41104, 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 1856 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 50437, 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 96504, 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 18448667, 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 68708156, 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 42, 2024-09-19T09:08:24.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 5, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 3.037532579, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 1.272031026, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 3.108037595, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.336091471, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 96503, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 10.252696252, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000106242 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 108720, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.018302467, 2024-09-19T09:08:24.715 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000168 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 58560, 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 258464 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 13556, 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 13603, 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 5143815, 2024-09-19T09:08:24.716 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 35189476, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 13, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 6, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 1.042144660, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.408159424, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.320628689, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.314809699, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 13602, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 8.380677096, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000616135 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 7855, 2024-09-19T09:08:24.717 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.001343096, 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000170 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 786928, 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 80992 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:08:24.718 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 5061, 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 26.003452928, 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.005138006 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 13063, 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 2.957597971, 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000226410 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-19T09:08:24.719 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 21831, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 21747, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 21747, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 75.111489292, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.003453878 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 84, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 2, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 1, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 1449, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 12, 2024-09-19T09:08:24.720 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 3, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 522, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 78, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 433, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 11, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 410, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 2750, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 2, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 2, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 4, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 22627, 2024-09-19T09:08:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 22445, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 35, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 0, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 126, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 2618, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 47, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 173, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-19T09:08:24.722 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 3775, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 4, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 234, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 3775, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 360, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 8, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 352, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 3415, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 68, 2024-09-19T09:08:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 9389, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 22500, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 18270, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 9916, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 72, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 10598 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-19T09:08:24.724 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 126, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 9, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 8807, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 8798, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:08:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 5, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 3737, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 8, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 126, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 15, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 51369, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 49346, 2024-09-19T09:08:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 49346, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 2023, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 6907, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 81, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 78, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 78, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 3, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 1, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 9, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 102669428, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 106318169, 2024-09-19T09:08:24.727 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 0, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 4725, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 1172.949535960, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.248243288 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 0 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 43, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 11469, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 11426, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 56, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 746, 2024-09-19T09:08:24.728 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 690, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 522, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 17112, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 16590, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 2, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 11446, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 11444, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 99128, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 231712 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 24581, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 1360, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 21831, 2024-09-19T09:08:24.729 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 136, 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 2841, 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 10812, 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 16.414770599, 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001518199 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 49, 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.032448002, 2024-09-19T09:08:24.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000662204 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.731 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 587, 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.942303841, 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001605287 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1, 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000276064, 2024-09-19T09:08:24.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000276064 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.733 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.734 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-19T09:08:24.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.734 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 623, 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 19.856893131, 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.031873022 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-19T09:08:24.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000649378, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000324689 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 829, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 1.102836833, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001330321 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.736 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2, 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.002051837, 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001025918 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 465, 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 6.320533123, 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.013592544 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.738 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 27, 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 3.750272570, 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.138898984 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-19T09:08:24.739 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 8, 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.020296421, 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002537052 2024-09-19T09:08:24.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 8342, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 26.668157493, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.003196854 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-19T09:08:24.741 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 1, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 3, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 2, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 1, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 13899, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 13899, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 279, 2024-09-19T09:08:24.742 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:24.743 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-19T09:08:24.745 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 302920, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 109, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 88, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 1, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:24.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 7688, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 158, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 568314, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 7878, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-19T09:08:24.747 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 30585, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 120237958, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 32, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 30585, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 30585, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 1948.784758051, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.063717010 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-19T09:08:24.748 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 30585, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 54233 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 30585, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 3920, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 26665, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 767, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 10651, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 134, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 4851, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 133, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-19T09:08:24.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 12, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 9450, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 3786, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 21302, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:08:24.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-19T09:08:24.751 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 80, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-19T09:08:24.752 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 2, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 12, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 12, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 0, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 3051, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 6, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 90 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 1, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-19T09:08:24.753 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: "osd-slow-ops": { 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 3691 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 20, 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 10, 2024-09-19T09:08:24.754 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 8875, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 8798, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 78982, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 21220493, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 78982, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:24.755 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 78982, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 21220493, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:08:24.756 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 30585, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 121126584, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 30585, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 121126584, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-19T09:08:24.757 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 30585, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 30585, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 30585, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 30585, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.758 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 8798, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 888662, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 8798, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 126, 2024-09-19T09:08:24.759 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 888662, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x557371a7a500": { 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 51369, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 102123865, 2024-09-19T09:08:24.760 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 51369, 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 4725, 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 102123865, 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:24.761 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:08:25.730 INFO:tasks.check_counter:Daemon mds.b mds.exported=126 2024-09-19T09:08:25.730 INFO:tasks.check_counter:Daemon mds.b mds.imported=47 2024-09-19T09:08:25.730 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T09:08:25.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T09:08:25.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:25 smithi022 ceph-mon[35107]: pgmap v467: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:08:25.984 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:08:26.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:25 smithi001 ceph-mon[30939]: pgmap v467: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:08:26.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:25 smithi064 ceph-mon[35179]: pgmap v467: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:08:26.411 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:08:26.411 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:26.411 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 408, 2024-09-19T09:08:26.411 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 409, 2024-09-19T09:08:26.411 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 4300383, 2024-09-19T09:08:26.411 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 129489, 2024-09-19T09:08:26.411 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 7, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.039343467, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.013954474, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.011794455, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.009373809, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 407, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.018370635, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000045136 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.412 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 133, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 122, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 768638, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 70818, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-19T09:08:26.413 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.022215500, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.007735527, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.022066463, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000041621, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 121, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.008707426, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000071962 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.414 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 767536, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 70176 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 491, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 574, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 2667484, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 379140, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-19T09:08:26.415 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 4, 2024-09-19T09:08:26.416 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.059733433, 2024-09-19T09:08:26.416 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.018648052, 2024-09-19T09:08:26.416 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.018232053, 2024-09-19T09:08:26.416 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.017060676, 2024-09-19T09:08:26.416 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:26.416 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 573, 2024-09-19T09:08:26.416 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.032557526, 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000056819 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 224592 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-19T09:08:26.417 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1670, 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.046389102, 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000027777 2024-09-19T09:08:26.418 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-19T09:08:26.419 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 0, 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 0, 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 0, 2024-09-19T09:08:26.420 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 1036, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 1036, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 1036, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 0, 2024-09-19T09:08:26.421 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 1, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 0, 2024-09-19T09:08:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-19T09:08:26.423 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:08:26.424 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 0 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 0, 2024-09-19T09:08:26.425 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-19T09:08:26.426 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:08:26.427 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:08:26.427 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:08:26.427 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 0, 2024-09-19T09:08:26.427 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-19T09:08:26.427 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:08:26.427 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-19T09:08:26.427 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0 2024-09-19T09:08:26.427 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 3834, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 0, 2024-09-19T09:08:26.428 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 6, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 2, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 0, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 4194304, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 10899068, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 10897930, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 3834 2024-09-19T09:08:26.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 8, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 1111, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 1103, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 6, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 117, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 111, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 1036, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 1886, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 850, 2024-09-19T09:08:26.430 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 0, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 0, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 0, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 51496, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 215328 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 0, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 0, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 0, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 0, 2024-09-19T09:08:26.431 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 0, 2024-09-19T09:08:26.432 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-19T09:08:26.432 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.433 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.434 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.435 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.436 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.437 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-19T09:08:26.437 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.438 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.439 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-19T09:08:26.440 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.441 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.442 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.443 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.444 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 1, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 1, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 0, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 1, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 0, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 0, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 1584, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-19T09:08:26.445 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:26.446 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:26.448 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 206183, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 58, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 7688, 2024-09-19T09:08:26.449 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 158, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 755416, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 4217, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-19T09:08:26.450 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 895, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 21, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 3, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 895, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 895, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.856989296, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000957529 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 895, 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 896 2024-09-19T09:08:26.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 895, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 895, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 471, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 422, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-19T09:08:26.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 1, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:08:26.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-19T09:08:26.454 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 80, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 1, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 7, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 7, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 0, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 2, 2024-09-19T09:08:26.455 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 0 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 0, 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "osd-slow-ops": { 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 0 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 0, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 0, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 0, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 1028, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 7634249, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:26.457 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 1028, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 1028, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 7634249, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:08:26.458 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 895, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 6704769, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 895, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 6704769, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.459 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:26.460 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 895, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 895, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 895, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 895, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:08:26.461 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:26.462 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x55566e7306e0": { 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:26.463 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:26.464 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:26.464 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:26.464 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.464 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:26.464 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:08:27.176 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T09:08:27.176 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T09:08:27.176 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T09:08:27.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T09:08:27.426 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:08:27.890 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:27 smithi022 ceph-mon[35107]: pgmap v468: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T09:08:28.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:27 smithi001 ceph-mon[30939]: pgmap v468: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T09:08:28.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:27 smithi064 ceph-mon[35179]: pgmap v468: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T09:08:28.709 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:08:28.709 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:28.709 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 3862, 2024-09-19T09:08:28.709 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 4268, 2024-09-19T09:08:28.709 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1938140, 2024-09-19T09:08:28.709 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 5440820, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 15, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.283004064, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.125720412, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.148321610, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.024038537, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 4269, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.137185200, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000032135 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 6549, 2024-09-19T09:08:28.710 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.001085260, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000165 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 849, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 907, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 236072, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 2764828, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 8, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 6, 2024-09-19T09:08:28.711 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.066318830, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.024392556, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.025197465, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.015406297, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 905, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.050582168, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000055891 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 477, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000080328, 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000168 2024-09-19T09:08:28.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 225680 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 4171, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 7652, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 2216182, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 4056825, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 24, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 7, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.293030513, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.126420598, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.201645628, 2024-09-19T09:08:28.713 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.017531780, 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 7649, 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.281122626, 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000036752 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 8565, 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.001619396, 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000189 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 777376, 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 76384 2024-09-19T09:08:28.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 766, 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 1.583313440, 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002066988 2024-09-19T09:08:28.715 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1672, 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.262361994, 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000156915 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-19T09:08:28.716 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 1962, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 1959, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1959, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 2.441747764, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001246425 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 3, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 11, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 0, 2024-09-19T09:08:28.717 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 12, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 0, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 1, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 11, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 11, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 123, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 0, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 0, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 2, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 3627, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 2594, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 1, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 35, 2024-09-19T09:08:28.718 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 24, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 79, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 26, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 774, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 266, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 4, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 234, 2024-09-19T09:08:28.719 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 266, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 9, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 9, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 257, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 4, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 697, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 1404, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:08:28.720 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 1251, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 603, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 24, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 1788 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 21, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 3, 2024-09-19T09:08:28.721 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 1031, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 1031, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 5, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 291, 2024-09-19T09:08:28.722 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 24, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 3834, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 0, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 0, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 3834, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-19T09:08:28.723 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 0, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 6, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 0, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 0, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 6, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 2, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 0, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 4194304, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 10899068, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 0, 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-19T09:08:28.724 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 395, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 2.243561471, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.005679902 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 0 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 18, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 1098, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 1080, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 22, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 107, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 85, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 74, 2024-09-19T09:08:28.725 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 1899, 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 1825, 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 0, 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 1052, 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 1052, 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 61684, 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 223520 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 3128, 2024-09-19T09:08:28.726 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 48, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 1962, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 2, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 1046, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 257, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.254099140, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000988712 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000710109, 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000710109 2024-09-19T09:08:28.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 604, 2024-09-19T09:08:28.728 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.194156192, 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000321450 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-19T09:08:28.729 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.730 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.731 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 65, 2024-09-19T09:08:28.732 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.057594410, 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000886067 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.733 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 18, 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.392720395, 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.021817799 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1, 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.038968866, 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.038968866 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.735 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1013, 2024-09-19T09:08:28.737 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 1.503498652, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001484204 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 1, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 1, 2024-09-19T09:08:28.738 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 0, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 1, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 1452, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 1452, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 1586, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:28.739 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:28.740 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:28.741 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 278892, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 92, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:28.742 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 7688, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 158, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 131303, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2474, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.743 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 1917, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 6962156, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 29, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 1917, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1917, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 4.762940674, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002484580 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.744 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1917, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 1991 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 1917, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 319, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 1598, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 0, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 10, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 53, 2024-09-19T09:08:28.745 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 448, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 37, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 1052, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 266, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 20, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-19T09:08:28.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-19T09:08:28.747 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 80, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 2, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 12, 2024-09-19T09:08:28.748 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 12, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 0, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 77, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 0, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 28 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 1, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osd-slow-ops": { 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 294 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 18, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 10, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 1039, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 1031, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:28.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 8878, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 3580260, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 8878, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 8878, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 3580260, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.751 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 1917, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 7066295, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 1917, 2024-09-19T09:08:28.752 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 7066295, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:28.753 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 1917, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 1917, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 1917, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1917, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:08:28.754 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 1031, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 104139, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 1031, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 53, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 104139, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x559cda2ac500": { 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 3834, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 6704764, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 3834, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 395, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 6704764, 2024-09-19T09:08:28.756 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:28.757 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:28.757 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:28.757 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:28.757 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.757 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:28.757 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:08:29.493 INFO:tasks.check_counter:Daemon mds.h mds.exported=24 2024-09-19T09:08:29.493 INFO:tasks.check_counter:Daemon mds.h mds.imported=26 2024-09-19T09:08:29.493 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T09:08:29.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T09:08:29.746 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:08:30.022 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:29 smithi022 ceph-mon[35107]: pgmap v469: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:30.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:29 smithi001 ceph-mon[30939]: pgmap v469: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:30.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:29 smithi064 ceph-mon[35179]: pgmap v469: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:30.273 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 4, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 4, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 3024, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 448, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.003051193, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000045849, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002264745, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.004058296, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001352765 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 122, 2024-09-19T09:08:30.275 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 117, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 728496, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 71088, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.021898870, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.008225815, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.020845327, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 116, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.006883468, 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000059340 2024-09-19T09:08:30.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 728496, 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 71088 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:30.277 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 89, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 94192, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.006362980, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.004120379, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001092597, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:30.278 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 87, 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.005186768, 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000059618 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 94192 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:30.280 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:30.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148863, 2024-09-19T09:08:30.282 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 28, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:30.283 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 123, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 711282, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:30.284 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 123, 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 123, 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 711282, 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:08:30.285 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:08:30.990 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T09:08:30.990 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T09:08:30.991 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T09:08:30.991 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T09:08:31.255 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:08:31.823 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 880, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 881, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 54785144, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 279532, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 8, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.112382310, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.027649646, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.050210867, 2024-09-19T09:08:31.824 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.025792522, 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 879, 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.036986913, 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000042078 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:08:31.825 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 257, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 244, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 23237927, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 109328, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 5, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.045783969, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.011053232, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.039137789, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.002875097, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 244, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.019041328, 2024-09-19T09:08:31.826 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000078038 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 770720, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 70784 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 351, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 436, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 25255358, 2024-09-19T09:08:31.827 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 337061, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 6, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 5, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.050362851, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.015755675, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.019877349, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.010737805, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 434, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.019632794, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000045236 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:31.828 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 225760 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-19T09:08:31.829 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2141, 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.197008492, 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000092017 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-09-19T09:08:31.830 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-09-19T09:08:31.831 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 9275, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 5541, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 3734, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 1358, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 2, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:08:31.832 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 4, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 234, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 0, 2024-09-19T09:08:31.833 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:08:31.834 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 0 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:08:31.835 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-09-19T09:08:31.836 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 51369, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 0, 2024-09-19T09:08:31.837 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 3, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 22, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 102669428, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 106318169, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 106316518, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.840 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 51369 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 32, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 11456, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 11424, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 45, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 742, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 697, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 9275, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 17056, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 7781, 2024-09-19T09:08:31.841 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 66412, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 215328 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.842 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-09-19T09:08:31.843 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.844 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.845 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.846 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.847 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-09-19T09:08:31.848 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.849 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.850 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.851 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 1, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 3, 2024-09-19T09:08:31.853 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 2, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 2, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 2866, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:31.855 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:31.856 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 230796, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 80, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 7688, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 158, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:31.857 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 6665537, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 41367, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 1350, 2024-09-19T09:08:31.858 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 26, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 4, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 1350, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1350, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.292973956, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000957758 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1350, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1351 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 1350, 2024-09-19T09:08:31.859 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 1350, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 839, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 508, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 0, 2024-09-19T09:08:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 2, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-09-19T09:08:31.861 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-09-19T09:08:31.862 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 80, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 1, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 10, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 10, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 0, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 2, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 0 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.863 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 0, 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "osd-slow-ops": { 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-09-19T09:08:31.864 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 0, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 0, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 0, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 1484, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 103135087, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 1484, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:31.865 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 1484, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 103135087, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:31.866 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 1350, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 102131303, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 1350, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 102131303, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-09-19T09:08:31.867 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 1350, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 1350, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 1350, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 1350, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.868 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-09-19T09:08:31.869 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x561ff84266e0": { 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:31.870 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:31.871 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-19T09:08:31.993 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:31 smithi064 ceph-mon[35179]: pgmap v470: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:08:32.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:31 smithi001 ceph-mon[30939]: pgmap v470: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:08:32.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:31 smithi022 ceph-mon[35107]: pgmap v470: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T09:08:32.673 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-19T09:08:32.673 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-19T09:08:32.673 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T09:08:32.673 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T09:08:32.930 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:08:33.502 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-19T09:08:33.502 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 517, 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 504, 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 898848, 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 192422, 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 5, 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 1, 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.070650684, 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.021867924, 2024-09-19T09:08:33.503 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.036209281, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.015108169, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 504, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.034329338, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000068113 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 770832, 2024-09-19T09:08:33.504 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 71264 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 25, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 111, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 4200720, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 235246, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 5, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.009884261, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.004173596, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.004021737, 2024-09-19T09:08:33.505 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.000538454, 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 109, 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.007343079, 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000067367 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 227552 2024-09-19T09:08:33.506 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 723, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 725, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 14155348, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 229921, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 5, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 4, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.061174782, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.018113780, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.020905366, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.017807988, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 723, 2024-09-19T09:08:33.507 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.029969539, 2024-09-19T09:08:33.508 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000041451 2024-09-19T09:08:33.508 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.508 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:33.508 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.508 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.508 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.508 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.508 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1930, 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.052924098, 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000027421 2024-09-19T09:08:33.509 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-09-19T09:08:33.510 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-09-19T09:08:33.511 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 1930, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 0, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 1930, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 0, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 1930, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 0, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 0, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 0, 2024-09-19T09:08:33.512 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 1, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 0, 2024-09-19T09:08:33.513 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:08:33.514 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:08:33.515 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:08:33.515 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 0, 2024-09-19T09:08:33.515 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:08:33.515 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:08:33.515 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:08:33.515 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 0, 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 0, 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 0 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-09-19T09:08:33.516 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:08:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 0, 2024-09-19T09:08:33.518 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 9044, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 12, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 2, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 4194304, 2024-09-19T09:08:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 22358430, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 22357292, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 9044 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 10, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 2006, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 1996, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 8, 2024-09-19T09:08:33.520 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 231, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 223, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 1930, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 3858, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 1928, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 0, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 0, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 0, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 55576, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 215328 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 0, 2024-09-19T09:08:33.521 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 0, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 0, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 0, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 0, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.522 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-09-19T09:08:33.523 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.524 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.526 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.526 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.526 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-09-19T09:08:33.526 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.526 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.526 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.526 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.526 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.527 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.528 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.529 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.530 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.531 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-09-19T09:08:33.532 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.533 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 1, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 3, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 2, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 2, 2024-09-19T09:08:33.534 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 2869, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:33.535 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:33.536 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:33.537 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 197319, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 52, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:33.538 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 7688, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 158, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 1391800, 2024-09-19T09:08:33.539 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 7815, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 1128, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 21, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 3, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 1128, 2024-09-19T09:08:33.540 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1128, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.642987034, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000570023 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1128, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1129 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 1128, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 1128, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 0, 2024-09-19T09:08:33.541 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 691, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 435, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-09-19T09:08:33.542 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 1, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-09-19T09:08:33.543 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-09-19T09:08:33.544 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 80, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 1, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 6, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 6, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-09-19T09:08:33.545 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 0, 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 2, 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 0 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 0, 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "osd-slow-ops": { 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 0 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-09-19T09:08:33.546 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 0, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 0, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 0, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 1261, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 19131638, 2024-09-19T09:08:33.547 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 1261, 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 1261, 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 19131638, 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.548 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 1128, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 18164754, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 1128, 2024-09-19T09:08:33.549 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 18164754, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:33.550 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 1128, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 1128, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 1128, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 1128, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:33.551 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.552 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x565410b666e0": { 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 0, 2024-09-19T09:08:33.553 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 0, 2024-09-19T09:08:33.554 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:33.554 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:33.554 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:33.554 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:33.554 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.554 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:33.554 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-19T09:08:34.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:33 smithi001 ceph-mon[30939]: pgmap v471: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:34.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:33 smithi064 ceph-mon[35179]: pgmap v471: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:34.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:33 smithi022 ceph-mon[35107]: pgmap v471: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:34.297 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T09:08:34.298 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T09:08:34.298 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T09:08:34.298 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T09:08:34.550 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:08:35.159 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-19T09:08:35.159 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:35.159 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 5170, 2024-09-19T09:08:35.159 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 5094, 2024-09-19T09:08:35.159 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 4206949, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 15650416, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 18, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 5, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.366583025, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.154423483, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.213941545, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.033693467, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 5095, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.181465282, 2024-09-19T09:08:35.160 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000035616 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 7797, 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.001290503, 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000165 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 781776, 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 78336 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 1105, 2024-09-19T09:08:35.161 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 1216, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 295551, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 694370, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 19, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 7, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.108106612, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.047637161, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.034581585, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.019331465, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1213, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.088066552, 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000072602 2024-09-19T09:08:35.162 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 523, 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000094964, 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000181 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 8144, 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 235504 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 7100, 2024-09-19T09:08:35.163 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 12025, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 2531643, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 10085490, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 12, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 6, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.385589868, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.165541711, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 7.757411990, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.026481374, 2024-09-19T09:08:35.164 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 12023, 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.339565837, 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000028243 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 14743, 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.002890959, 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000196 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:08:35.166 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:08:35.166 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.166 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-09-19T09:08:35.166 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 1, 2024-09-19T09:08:35.166 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-09-19T09:08:35.166 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-MDSRank": { 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 925, 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 2.819492097, 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.003048099 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.167 INFO:teuthology.orchestra.run.smithi064.stdout: "finisher-PurgeQueue": { 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "queue_len": 0, 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "complete_latency": { 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2993, 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.394991010, 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000131971 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": { 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "request": 2495, 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "reply": 2486, 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "reply_latency": { 2024-09-19T09:08:35.168 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2486, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 4.489556930, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001805936 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_reply": 0, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "forward": 9, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_complete": 0, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_fetch_keys": 0, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_commit": 11, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_split": 0, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_merge": 0, 2024-09-19T09:08:35.169 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes": 15, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_top": 2, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_bottom": 2, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pin_tail": 11, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_pinned": 11, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_expired": 177, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "inodes_with_caps": 1, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": 1, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "subtrees": 3, 2024-09-19T09:08:35.170 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse": 3488, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_hit": 2834, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_forward": 1, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_discover": 101, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_remote_ino": 0, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "traverse_lock": 0, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "load_cent": 0, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "q": 0, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "exported": 27, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "exported_inodes": 95, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "imported": 104, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "imported_inodes": 1845, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_dir_fetch": 0, 2024-09-19T09:08:35.171 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_backtrace_fetch": 85, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "openino_peer_discover": 0, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rfiles": 4, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rbytes": 234, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "root_rsnaps": 0, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_fetch": 85, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_set_tag": 0, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_inodes": 6, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_dirfrag_rstats": 6, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "scrub_file_inodes": 79, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_inode_file_caps": 12, 2024-09-19T09:08:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_revoke": 502, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_grant": 2504, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps": 3581, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_caps_dirty": 1685, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_cap_release": 27, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "process_request_cap_release": 2461 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_cache": { 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update": 0, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_update_receipt": 0, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_try_discover": 0, 2024-09-19T09:08:35.173 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_send_discover": 109, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "dir_handle_discover": 1, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_delayed": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_created": 1923, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_enqueued": 1923, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_reintegrated": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "strays_migrated": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_processing": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_started": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "recovery_completed": 0, 2024-09-19T09:08:35.174 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_path": 5, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_quiesce_inode": 126, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_exportdir": 27, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_flush": 0, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_fragstats": 0, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "ireq_inodestats": 0 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_log": { 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "evlrg": 0, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "evadd": 9044, 2024-09-19T09:08:35.175 INFO:teuthology.orchestra.run.smithi064.stdout: "evex": 0, 2024-09-19T09:08:35.176 INFO:teuthology.orchestra.run.smithi064.stdout: "evtrm": 0, 2024-09-19T09:08:35.176 INFO:teuthology.orchestra.run.smithi064.stdout: "ev": 9044, 2024-09-19T09:08:35.176 INFO:teuthology.orchestra.run.smithi064.stdout: "evexg": 0, 2024-09-19T09:08:35.176 INFO:teuthology.orchestra.run.smithi064.stdout: "evexd": 0, 2024-09-19T09:08:35.176 INFO:teuthology.orchestra.run.smithi064.stdout: "segadd": 12, 2024-09-19T09:08:35.177 INFO:teuthology.orchestra.run.smithi064.stdout: "segex": 0, 2024-09-19T09:08:35.177 INFO:teuthology.orchestra.run.smithi064.stdout: "segtrm": 0, 2024-09-19T09:08:35.177 INFO:teuthology.orchestra.run.smithi064.stdout: "seg": 12, 2024-09-19T09:08:35.177 INFO:teuthology.orchestra.run.smithi064.stdout: "segmjr": 2, 2024-09-19T09:08:35.177 INFO:teuthology.orchestra.run.smithi064.stdout: "segexg": 0, 2024-09-19T09:08:35.177 INFO:teuthology.orchestra.run.smithi064.stdout: "segexd": 0, 2024-09-19T09:08:35.177 INFO:teuthology.orchestra.run.smithi064.stdout: "expos": 4194304, 2024-09-19T09:08:35.177 INFO:teuthology.orchestra.run.smithi064.stdout: "wrpos": 22358430, 2024-09-19T09:08:35.178 INFO:teuthology.orchestra.run.smithi064.stdout: "rdpos": 0, 2024-09-19T09:08:35.178 INFO:teuthology.orchestra.run.smithi064.stdout: "jlat": { 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 462, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 2.081462474, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.004505330 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "replayed": 0 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_mem": { 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "ino": 20, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "ino+": 1990, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "ino-": 1970, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "dir": 18, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "dir+": 217, 2024-09-19T09:08:35.179 INFO:teuthology.orchestra.run.smithi064.stdout: "dir-": 199, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "dn": 15, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "dn+": 3864, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "dn-": 3849, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "cap": 1, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "cap+": 1949, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "cap-": 1948, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "rss": 71492, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "heap": 223520 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_server": { 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_client_request": 3682, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "dispatch_server_request": 92, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_request": 2495, 2024-09-19T09:08:35.180 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_client_session": 12, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "handle_peer_request": 654, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "req_create_latency": { 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 79, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.083427085, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001056039 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getattr_latency": { 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 5, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.003609142, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000721828 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getfilelock_latency": { 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.181 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "req_link_latency": { 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookup_latency": { 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 307, 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.084237586, 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000274389 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.182 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookuphash_latency": { 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupino_latency": { 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000111791, 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000111791 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupname_latency": { 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.183 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupparent_latency": { 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lookupsnap_latency": { 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "req_lssnap_latency": { 2024-09-19T09:08:35.184 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.185 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.185 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.185 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.185 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mkdir_latency": { 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mknod_latency": { 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "req_mksnap_latency": { 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.186 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "req_open_latency": { 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "req_readdir_latency": { 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 170, 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.082070599, 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000482768 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rename_latency": { 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.187 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "req_renamesnap_latency": { 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "req_snapdiff_latency": { 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmdir_latency": { 2024-09-19T09:08:35.188 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 134, 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 1.900426231, 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.014182285 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmsnap_latency": { 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "req_rmxattr_latency": { 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.189 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setattr_latency": { 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1, 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.010161918, 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.010161918 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setdirlayout_latency": { 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setfilelock_latency": { 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.190 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setlayout_latency": { 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "req_setxattr_latency": { 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "req_symlink_latency": { 2024-09-19T09:08:35.191 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "req_unlink_latency": { 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 1789, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 2.325512578, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.001299895 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "req_getvxattr_latency": { 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.192 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_sessions": { 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "session_count": 1, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "session_add": 3, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "session_remove": 2, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_open": 1, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "sessions_stale": 0, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "total_load": 2169, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "average_load": 2169, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "avg_session_uptime": 267, 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: "mdthresh_evicted": 0 2024-09-19T09:08:35.193 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:35.194 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:35.195 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 271207, 2024-09-19T09:08:35.196 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 93, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 7688, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 158, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:35.197 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 80568, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 373, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "objecter": { 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "op_active": 0, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "op_laggy": 0, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send": 2745, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "op_send_bytes": 18559175, 2024-09-19T09:08:35.198 INFO:teuthology.orchestra.run.smithi064.stdout: "op_resend": 30, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "op_reply": 2745, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "op_latency": { 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2745, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 6.673864834, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.002431280 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "op_inflight": 0, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "oplen_avg": { 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 2745, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 2830 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "op": 2745, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "op_r": 156, 2024-09-19T09:08:35.199 INFO:teuthology.orchestra.run.smithi064.stdout: "op_w": 2589, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "op_rmw": 0, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "op_pg": 0, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_stat": 0, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_create": 10, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_read": 71, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_write": 533, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writefull": 49, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_writesame": 0, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_append": 0, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_zero": 0, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_truncate": 0, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_delete": 1939, 2024-09-19T09:08:35.200 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_mapext": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_sparse_read": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_clonerange": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_getxattr": 85, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_setxattr": 20, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_rmxattr": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_call": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_watch": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_notify": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:08:35.201 INFO:teuthology.orchestra.run.smithi064.stdout: "osdop_other": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_active": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_send": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_resend": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "linger_ping": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_active": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_send": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "poolop_resend": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_active": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_send": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "poolstat_resend": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_active": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_send": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "statfs_resend": 0, 2024-09-19T09:08:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: "command_active": 0, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "command_send": 0, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "command_resend": 0, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "map_epoch": 80, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "map_full": 0, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "map_inc": 2, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_sessions": 12, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_open": 12, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_session_close": 0, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_laggy": 0, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_wr": 94, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_rd": 0, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_del": 29 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: "oft": { 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_objs": 1, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_updates": 0, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "omap_total_removes": 0 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "osd-slow-ops": { 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "slow_ops_count": 127 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "purge_queue": { 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops": 0, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing": 0, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executing_high_water": 10, 2024-09-19T09:08:35.204 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed_ops": 1923, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_executed": 1923, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "pq_item_in_journal": 0 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 13371, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 5818687, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 13371, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:35.205 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 13371, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 5818687, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_bytes": { 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:35.206 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 2745, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 18753398, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2745, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 18753398, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.207 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-objecter_ops": { 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 1024, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 0, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 0, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 0, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 2745, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 2745, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 2745, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 2745, 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:35.208 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 1923, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 194223, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 1923, 2024-09-19T09:08:35.209 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 71, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 194223, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-write_buf_throttle-0x56390f402500": { 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 3758096384, 2024-09-19T09:08:35.210 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 9044, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 18164126, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 9044, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 462, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 18164126, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:35.211 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.212 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:35.212 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-19T09:08:35.956 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:35 smithi064 ceph-mon[35179]: pgmap v472: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:08:35.957 INFO:tasks.check_counter:Daemon mds.i mds.exported=27 2024-09-19T09:08:35.957 INFO:tasks.check_counter:Daemon mds.i mds.imported=104 2024-09-19T09:08:35.957 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T09:08:35.957 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T09:08:36.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:35 smithi001 ceph-mon[30939]: pgmap v472: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:08:36.208 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:08:36.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:35 smithi022 ceph-mon[35107]: pgmap v472: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:08:36.694 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-09-19T09:08:36.694 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:08:36.694 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 0, 2024-09-19T09:08:36.694 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 2, 2024-09-19T09:08:36.694 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 0, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 4, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 0, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.001093337, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.000212773, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.695 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 124, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 119, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 729040, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 72368, 2024-09-19T09:08:36.696 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 2, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 1, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.022996917, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.008226633, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.021217868, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 118, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.006190218, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000052459 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:36.697 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 729040, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 72368 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_messages": 5, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages": 92, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_bytes": 3184, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_bytes": 94816, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_created_connections": 3, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_active_connections": 2, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_total_time": 0.007903733, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_send_time": 0.004274612, 2024-09-19T09:08:36.698 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_recv_time": 0.002575564, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 91, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.009414838, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000103459 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: "msgr_send_encrypted_bytes": 94816 2024-09-19T09:08:36.699 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "cct": { 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "total_workers": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "unhealthy_workers": 0 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "mempool": { 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bloom_filter_items": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:08:36.700 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_extent_items": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_blob_items": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:08:36.701 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_txc_items": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluestore_writing_items": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_bytes": 0, 2024-09-19T09:08:36.702 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_items": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_bytes": 148863, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_anon_items": 28, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "buffer_meta_items": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_bytes": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_items": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_mapbl_items": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:08:36.703 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_pglog_items": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_bytes": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_items": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_bytes": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "pgmap_items": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_bytes": 928, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_co_items": 2, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_bytes": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_1_items": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_bytes": 0, 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: "unittest_2_items": 0 2024-09-19T09:08:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "val": 0, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "max": 104857600, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get_started": 0, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get": 125, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get_sum": 711542, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_fail": 0, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "get_or_fail_success": 125, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "take": 0, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "take_sum": 0, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "put": 125, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "put_sum": 711542, 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "wait": { 2024-09-19T09:08:36.705 INFO:teuthology.orchestra.run.smithi064.stdout: "avgcount": 0, 2024-09-19T09:08:36.706 INFO:teuthology.orchestra.run.smithi064.stdout: "sum": 0.000000000, 2024-09-19T09:08:36.706 INFO:teuthology.orchestra.run.smithi064.stdout: "avgtime": 0.000000000 2024-09-19T09:08:36.706 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:36.706 INFO:teuthology.orchestra.run.smithi064.stdout: } 2024-09-19T09:08:36.706 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-09-19T09:08:37.372 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-19T09:08:37.372 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-19T09:08:37.372 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:08:37.382 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:08:37.382 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:08:37.382 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:08:37.405 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:08:37.405 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:08:37.465 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:08:37.779 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:37.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:37 smithi001 ceph-mon[30939]: pgmap v473: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:08:38.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:37 smithi064 ceph-mon[35179]: pgmap v473: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:08:38.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:37 smithi022 ceph-mon[35107]: pgmap v473: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:08:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.251+0000 7f4e49171640 1 -- 172.21.15.1:0/4205021724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 msgr2=0x7f4e441029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.251+0000 7f4e49171640 1 --2- 172.21.15.1:0/4205021724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 0x7f4e441029b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009900 tx=0x7f4e3802a480 comp rx=0 tx=0).stop 2024-09-19T09:08:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.252+0000 7f4e49171640 1 -- 172.21.15.1:0/4205021724 shutdown_connections 2024-09-19T09:08:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.252+0000 7f4e49171640 1 --2- 172.21.15.1:0/4205021724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e44102ef0 0x7f4e4410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.252+0000 7f4e49171640 1 --2- 172.21.15.1:0/4205021724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 0x7f4e441029b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.252+0000 7f4e49171640 1 --2- 172.21.15.1:0/4205021724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e44100e20 0x7f4e44101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.252+0000 7f4e49171640 1 -- 172.21.15.1:0/4205021724 >> 172.21.15.1:0/4205021724 conn(0x7f4e440fc7d0 msgr2=0x7f4e440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:38.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.252+0000 7f4e49171640 1 -- 172.21.15.1:0/4205021724 shutdown_connections 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.252+0000 7f4e49171640 1 -- 172.21.15.1:0/4205021724 wait complete. 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.252+0000 7f4e49171640 1 Processor -- start 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e49171640 1 -- start start 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e49171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e44100e20 0x7f4e44198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e49171640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 0x7f4e44198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e49171640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e44102ef0 0x7f4e4419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e49171640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4e441110a0 con 0x7f4e44102570 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e49171640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4e44110f20 con 0x7f4e44100e20 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e49171640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4e44111220 con 0x7f4e44102ef0 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e4259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 0x7f4e44198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e4259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 0x7f4e44198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36504/0 (socket says 172.21.15.1:36504) 2024-09-19T09:08:38.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e4259c640 1 -- 172.21.15.1:0/2290295934 learned_addr learned my addr 172.21.15.1:0/2290295934 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e42d9d640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e44100e20 0x7f4e44198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e4359e640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e44102ef0 0x7f4e4419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e4259c640 1 -- 172.21.15.1:0/2290295934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e44102ef0 msgr2=0x7f4e4419cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e4259c640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e44102ef0 0x7f4e4419cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e4259c640 1 -- 172.21.15.1:0/2290295934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e44100e20 msgr2=0x7f4e44198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.253+0000 7f4e4259c640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e44100e20 0x7f4e44198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.254+0000 7f4e4259c640 1 -- 172.21.15.1:0/2290295934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4419d630 con 0x7f4e44102570 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.254+0000 7f4e4259c640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 0x7f4e44198bc0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4e38006010 tx=0x7f4e38004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.254+0000 7f4e2bfff640 1 -- 172.21.15.1:0/2290295934 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3803f030 con 0x7f4e44102570 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.254+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4419d8c0 con 0x7f4e44102570 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.254+0000 7f4e2bfff640 1 -- 172.21.15.1:0/2290295934 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4e38005500 con 0x7f4e44102570 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.254+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e441a5200 con 0x7f4e44102570 2024-09-19T09:08:38.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.254+0000 7f4e2bfff640 1 -- 172.21.15.1:0/2290295934 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38035070 con 0x7f4e44102570 2024-09-19T09:08:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.255+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e44101200 con 0x7f4e44102570 2024-09-19T09:08:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.256+0000 7f4e2bfff640 1 -- 172.21.15.1:0/2290295934 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f4e38042030 con 0x7f4e44102570 2024-09-19T09:08:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.257+0000 7f4e2bfff640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e2c0a32c0 0x7f4e2c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.257+0000 7f4e2bfff640 1 -- 172.21.15.1:0/2290295934 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4e380f0320 con 0x7f4e44102570 2024-09-19T09:08:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.257+0000 7f4e42d9d640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e2c0a32c0 0x7f4e2c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.258+0000 7f4e42d9d640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e2c0a32c0 0x7f4e2c0a5780 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400bbe0 tx=0x7f4e3400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:38.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.265+0000 7f4e2bfff640 1 -- 172.21.15.1:0/2290295934 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4e380bc9d0 con 0x7f4e44102570 2024-09-19T09:08:38.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.455+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4e4410a0a0 con 0x7f4e44102570 2024-09-19T09:08:38.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.455+0000 7f4e2bfff640 1 -- 172.21.15.1:0/2290295934 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+581 (secure 0 0 0) 0x7f4e380c0cd0 con 0x7f4e44102570 2024-09-19T09:08:38.456 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2387018469 2024-09-20T08:55:09.857036+0000 2024-09-19T09:08:38.456 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/2001580204 2024-09-20T08:55:09.857036+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/2001580204 2024-09-20T08:55:09.857036+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/859712265 2024-09-20T08:55:09.857036+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/4135803667 2024-09-20T08:55:09.857036+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3240635112 2024-09-20T08:54:45.648707+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/3303995107 2024-09-20T08:54:45.648707+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/3303995107 2024-09-20T08:54:45.648707+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3792489660 2024-09-20T08:54:45.648707+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1402054231 2024-09-20T08:54:45.648707+0000 2024-09-19T09:08:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-09-19T09:08:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e2c0a32c0 msgr2=0x7f4e2c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e2c0a32c0 0x7f4e2c0a5780 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400bbe0 tx=0x7f4e3400b390 comp rx=0 tx=0).stop 2024-09-19T09:08:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 msgr2=0x7f4e44198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:38.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 0x7f4e44198bc0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4e38006010 tx=0x7f4e38004c00 comp rx=0 tx=0).stop 2024-09-19T09:08:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 shutdown_connections 2024-09-19T09:08:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f4e2c0a32c0 0x7f4e2c0a5780 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e44102ef0 0x7f4e4419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4e44102570 0x7f4e44198bc0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 --2- 172.21.15.1:0/2290295934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e44100e20 0x7f4e44198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 >> 172.21.15.1:0/2290295934 conn(0x7f4e440fc7d0 msgr2=0x7f4e4406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 shutdown_connections 2024-09-19T09:08:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:38.458+0000 7f4e49171640 1 -- 172.21.15.1:0/2290295934 wait complete. 2024-09-19T09:08:39.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:38 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2290295934' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:08:39.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:38 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2290295934' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:08:39.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:38 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2290295934' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:08:39.215 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:08:39.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:08:39.216 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:08:39.279 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:08:39.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:08:39.279 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:08:39.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:08:39.321 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T09:08:39.390 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:08:39.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:08:39.391 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:08:39.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:08:39.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-19T09:08:39.563 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:08:39.573 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:08:39.573 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:08:39.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:08:39.835 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:40.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:39 smithi001 ceph-mon[30939]: pgmap v474: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:40.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:39 smithi064 ceph-mon[35179]: pgmap v474: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:40.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:39 smithi022 ceph-mon[35107]: pgmap v474: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:08:40.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 -- 172.21.15.1:0/170944157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c100e20 msgr2=0x7fcd6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:40.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 --2- 172.21.15.1:0/170944157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c100e20 0x7fcd6c101200 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009ca0 tx=0x7fcd5c02a950 comp rx=0 tx=0).stop 2024-09-19T09:08:40.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 -- 172.21.15.1:0/170944157 shutdown_connections 2024-09-19T09:08:40.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 --2- 172.21.15.1:0/170944157 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd6c102ef0 0x7fcd6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 --2- 172.21.15.1:0/170944157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c102570 0x7fcd6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 --2- 172.21.15.1:0/170944157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c100e20 0x7fcd6c101200 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 -- 172.21.15.1:0/170944157 >> 172.21.15.1:0/170944157 conn(0x7fcd6c0fc7d0 msgr2=0x7fcd6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 -- 172.21.15.1:0/170944157 shutdown_connections 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 -- 172.21.15.1:0/170944157 wait complete. 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.333+0000 7fcd7134b640 1 Processor -- start 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd7134b640 1 -- start start 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd7134b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd6c100e20 0x7fcd6c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd7134b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c102570 0x7fcd6c199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd7134b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c102ef0 0x7fcd6c1a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd7134b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c1110a0 con 0x7fcd6c102ef0 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd7134b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c110f20 con 0x7fcd6c102570 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd7134b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c111220 con 0x7fcd6c100e20 2024-09-19T09:08:40.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd6b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c102ef0 0x7fcd6c1a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd6b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c102ef0 0x7fcd6c1a4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36520/0 (socket says 172.21.15.1:36520) 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd6a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c102570 0x7fcd6c199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd6b7fe640 1 -- 172.21.15.1:0/2253390532 learned_addr learned my addr 172.21.15.1:0/2253390532 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.334+0000 7fcd6affd640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd6c100e20 0x7fcd6c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd6b7fe640 1 -- 172.21.15.1:0/2253390532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd6c100e20 msgr2=0x7fcd6c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd6b7fe640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd6c100e20 0x7fcd6c1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd6b7fe640 1 -- 172.21.15.1:0/2253390532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c102570 msgr2=0x7fcd6c199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd6b7fe640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c102570 0x7fcd6c199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd6b7fe640 1 -- 172.21.15.1:0/2253390532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c1a49a0 con 0x7fcd6c102ef0 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd6b7fe640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c102ef0 0x7fcd6c1a4460 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400c970 tx=0x7fcd6400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd63fff640 1 -- 172.21.15.1:0/2253390532 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd64007bb0 con 0x7fcd6c102ef0 2024-09-19T09:08:40.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c1a4b70 con 0x7fcd6c102ef0 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd63fff640 1 -- 172.21.15.1:0/2253390532 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcd64007d50 con 0x7fcd6c102ef0 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd63fff640 1 -- 172.21.15.1:0/2253390532 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400f450 con 0x7fcd6c102ef0 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.335+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c1a50b0 con 0x7fcd6c102ef0 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.336+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6c101200 con 0x7fcd6c102ef0 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.337+0000 7fcd63fff640 1 -- 172.21.15.1:0/2253390532 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fcd64005020 con 0x7fcd6c102ef0 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.338+0000 7fcd63fff640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd580a3240 0x7fcd580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.338+0000 7fcd63fff640 1 -- 172.21.15.1:0/2253390532 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fcd640cf4d0 con 0x7fcd6c102ef0 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.338+0000 7fcd6affd640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd580a3240 0x7fcd580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:40.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.338+0000 7fcd6affd640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd580a3240 0x7fcd580a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c030040 tx=0x7fcd5c009980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:40.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.342+0000 7fcd63fff640 1 -- 172.21.15.1:0/2253390532 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd64014030 con 0x7fcd6c102ef0 2024-09-19T09:08:40.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.554+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd6c1a5340 con 0x7fcd6c102ef0 2024-09-19T09:08:40.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.554+0000 7fcd63fff640 1 -- 172.21.15.1:0/2253390532 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11887 (secure 0 0 0) 0x7fcd6409bb80 con 0x7fcd6c102ef0 2024-09-19T09:08:40.555 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:08:40.556 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-19T09:07:36:672566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:07:36.432120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:08:40.556 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-19T09:08:40.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.556+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd580a3240 msgr2=0x7fcd580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:40.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.556+0000 7fcd7134b640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd580a3240 0x7fcd580a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c030040 tx=0x7fcd5c009980 comp rx=0 tx=0).stop 2024-09-19T09:08:40.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c102ef0 msgr2=0x7fcd6c1a4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:40.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c102ef0 0x7fcd6c1a4460 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400c970 tx=0x7fcd6400ce30 comp rx=0 tx=0).stop 2024-09-19T09:08:40.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 shutdown_connections 2024-09-19T09:08:40.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd6c102ef0 0x7fcd6c1a4460 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c102570 0x7fcd6c199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fcd580a3240 0x7fcd580a5700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 --2- 172.21.15.1:0/2253390532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcd6c100e20 0x7fcd6c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:40.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 >> 172.21.15.1:0/2253390532 conn(0x7fcd6c0fc7d0 msgr2=0x7fcd6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:40.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 shutdown_connections 2024-09-19T09:08:40.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:40.557+0000 7fcd7134b640 1 -- 172.21.15.1:0/2253390532 wait complete. 2024-09-19T09:08:41.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:40 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2253390532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:41.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:40 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2253390532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:41.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:40 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2253390532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:41.294 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:08:41.555 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:41.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:41 smithi001 ceph-mon[30939]: pgmap v475: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T09:08:42.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3919026526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 msgr2=0x7fbe5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:42.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3919026526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 0x7fbe5810ea90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009ca0 tx=0x7fbe5002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3919026526 shutdown_connections 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3919026526 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 0x7fbe5810ea90 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3919026526 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe58102790 0x7fbe581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3919026526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe58101de0 0x7fbe581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3919026526 >> 172.21.15.1:0/3919026526 conn(0x7fbe580fd8c0 msgr2=0x7fbe580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3919026526 shutdown_connections 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.998+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3919026526 wait complete. 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe5e19d640 1 Processor -- start 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe5e19d640 1 -- start start 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe5e19d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe58101de0 0x7fbe5819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe5e19d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe58102790 0x7fbe5819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe5e19d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 0x7fbe5819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:42.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe5e19d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58112090 con 0x7fbe58106f10 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe5e19d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58111f10 con 0x7fbe58102790 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe5e19d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58112210 con 0x7fbe58101de0 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe57fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 0x7fbe5819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:41.999+0000 7fbe577fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe58101de0 0x7fbe5819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe577fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe58101de0 0x7fbe5819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.1:34830/0 (socket says 172.21.15.1:34830) 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe577fe640 1 -- 172.21.15.1:0/3392754679 learned_addr learned my addr 172.21.15.1:0/3392754679 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe57fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 0x7fbe5819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:36546/0 (socket says 172.21.15.1:36546) 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe56ffd640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe58102790 0x7fbe5819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:42.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe577fe640 1 -- 172.21.15.1:0/3392754679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe58102790 msgr2=0x7fbe5819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe577fe640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe58102790 0x7fbe5819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe577fe640 1 -- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 msgr2=0x7fbe5819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe577fe640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 0x7fbe5819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe577fe640 1 -- 172.21.15.1:0/3392754679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5819f690 con 0x7fbe58101de0 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe57fff640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 0x7fbe5819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe577fe640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe58101de0 0x7fbe5819a6e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800d950 tx=0x7fbe4800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe54ff9640 1 -- 172.21.15.1:0/3392754679 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48017070 con 0x7fbe58101de0 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5819f980 con 0x7fbe58101de0 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe54ff9640 1 -- 172.21.15.1:0/3392754679 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe48009c30 con 0x7fbe58101de0 2024-09-19T09:08:42.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.000+0000 7fbe54ff9640 1 -- 172.21.15.1:0/3392754679 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800f740 con 0x7fbe58101de0 2024-09-19T09:08:42.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.001+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe581a7260 con 0x7fbe58101de0 2024-09-19T09:08:42.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.002+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe581021c0 con 0x7fbe58101de0 2024-09-19T09:08:42.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.003+0000 7fbe54ff9640 1 -- 172.21.15.1:0/3392754679 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fbe48010a80 con 0x7fbe58101de0 2024-09-19T09:08:42.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.004+0000 7fbe54ff9640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbe400a3240 0x7fbe400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:42.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.004+0000 7fbe56ffd640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbe400a3240 0x7fbe400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:42.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.004+0000 7fbe54ff9640 1 -- 172.21.15.1:0/3392754679 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fbe480cf590 con 0x7fbe58101de0 2024-09-19T09:08:42.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.004+0000 7fbe56ffd640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbe400a3240 0x7fbe400a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbe5810ee50 tx=0x7fbe4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:42.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.007+0000 7fbe54ff9640 1 -- 172.21.15.1:0/3392754679 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe48009de0 con 0x7fbe58101de0 2024-09-19T09:08:42.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:41 smithi064 ceph-mon[35179]: pgmap v475: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T09:08:42.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:41 smithi022 ceph-mon[35107]: pgmap v475: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T09:08:42.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.218+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe5819ba40 con 0x7fbe58101de0 2024-09-19T09:08:42.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.219+0000 7fbe54ff9640 1 -- 172.21.15.1:0/3392754679 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11887 (secure 0 0 0) 0x7fbe4809c290 con 0x7fbe58101de0 2024-09-19T09:08:42.219 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:08:42.220 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":28,"btime":"2024-09-19T09:07:36:672566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/250950179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":250950179},{"type":"v1","addr":"172.21.15.1:6835","nonce":250950179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2260283181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2260283181},{"type":"v1","addr":"172.21.15.1:6837","nonce":2260283181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/1644028612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":1644028612},{"type":"v1","addr":"172.21.15.1:6839","nonce":1644028612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/2023571074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":2023571074},{"type":"v1","addr":"172.21.15.1:6841","nonce":2023571074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/670081711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":670081711},{"type":"v1","addr":"172.21.15.22:6833","nonce":670081711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/1311787098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1311787098},{"type":"v1","addr":"172.21.15.64:6833","nonce":1311787098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:02:02.334504+0000","modified":"2024-09-19T09:07:36.432120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24500,"mds_1":24493,"mds_2":24482},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6835/728335709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":728335709},{"type":"v1","addr":"172.21.15.22:6835","nonce":728335709}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6835/1194065600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":1194065600},{"type":"v1","addr":"172.21.15.64:6835","nonce":1194065600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.64:6837/1600726820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":1600726820},{"type":"v1","addr":"172.21.15.64:6837","nonce":1600726820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.22:6837/866445696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":866445696},{"type":"v1","addr":"172.21.15.22:6837","nonce":866445696}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.64:6839/2311666322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6838","nonce":2311666322},{"type":"v1","addr":"172.21.15.64:6839","nonce":2311666322}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24500":{"gid":24500,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/1767594317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":1767594317},{"type":"v1","addr":"172.21.15.22:6839","nonce":1767594317}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24500,"qdb_cluster":[24500,24493,24482]},"id":1}]} 2024-09-19T09:08:42.220 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 28 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbe400a3240 msgr2=0x7fbe400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbe400a3240 0x7fbe400a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbe5810ee50 tx=0x7fbe4c005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe58101de0 msgr2=0x7fbe5819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe58101de0 0x7fbe5819a6e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800d950 tx=0x7fbe4800de10 comp rx=0 tx=0).stop 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 shutdown_connections 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe58106f10 0x7fbe5819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe58102790 0x7fbe5819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fbe400a3240 0x7fbe400a5700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 --2- 172.21.15.1:0/3392754679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe58101de0 0x7fbe5819a6e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 >> 172.21.15.1:0/3392754679 conn(0x7fbe580fd8c0 msgr2=0x7fbe580ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 shutdown_connections 2024-09-19T09:08:42.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:42.221+0000 7fbe5e19d640 1 -- 172.21.15.1:0/3392754679 wait complete. 2024-09-19T09:08:42.908 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:08:42.931 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:42 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3392754679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:43.054 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:42 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3392754679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:43.165 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:43.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:42 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3392754679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:08:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 -- 172.21.15.1:0/2765523825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354100a80 msgr2=0x7fc354100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 --2- 172.21.15.1:0/2765523825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354100a80 0x7fc354100ee0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009930 tx=0x7fc33c02a420 comp rx=0 tx=0).stop 2024-09-19T09:08:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 -- 172.21.15.1:0/2765523825 shutdown_connections 2024-09-19T09:08:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 --2- 172.21.15.1:0/2765523825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc354101420 0x7fc35410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 --2- 172.21.15.1:0/2765523825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354100a80 0x7fc354100ee0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 --2- 172.21.15.1:0/2765523825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc354106a80 0x7fc354106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 -- 172.21.15.1:0/2765523825 >> 172.21.15.1:0/2765523825 conn(0x7fc3540fc7a0 msgr2=0x7fc3540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 -- 172.21.15.1:0/2765523825 shutdown_connections 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.640+0000 7fc358a2b640 1 -- 172.21.15.1:0/2765523825 wait complete. 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc358a2b640 1 Processor -- start 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc358a2b640 1 -- start start 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc358a2b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc354100a80 0x7fc35410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc358a2b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354101420 0x7fc35410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc358a2b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc354106a80 0x7fc35410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc358a2b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3541120c0 con 0x7fc354101420 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc358a2b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc354111f40 con 0x7fc354106a80 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc358a2b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc354112240 con 0x7fc354100a80 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc349d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354101420 0x7fc35410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:43.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc349d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354101420 0x7fc35410e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59734/0 (socket says 172.21.15.1:59734) 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc349d9b640 1 -- 172.21.15.1:0/4112673747 learned_addr learned my addr 172.21.15.1:0/4112673747 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc35259c640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc354100a80 0x7fc35410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.641+0000 7fc352d9d640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc354106a80 0x7fc35410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc349d9b640 1 -- 172.21.15.1:0/4112673747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc354100a80 msgr2=0x7fc35410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc349d9b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc354100a80 0x7fc35410e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc349d9b640 1 -- 172.21.15.1:0/4112673747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc354106a80 msgr2=0x7fc35410ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc349d9b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc354106a80 0x7fc35410ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc349d9b640 1 -- 172.21.15.1:0/4112673747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3541a69e0 con 0x7fc354101420 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc352d9d640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc354106a80 0x7fc35410ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc349d9b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354101420 0x7fc35410e920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009230 tx=0x7fc33c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc34bfff640 1 -- 172.21.15.1:0/4112673747 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c03f030 con 0x7fc354101420 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3541a6c70 con 0x7fc354101420 2024-09-19T09:08:43.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc34bfff640 1 -- 172.21.15.1:0/4112673747 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc33c004440 con 0x7fc354101420 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc34bfff640 1 -- 172.21.15.1:0/4112673747 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c035070 con 0x7fc354101420 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.642+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3541a7150 con 0x7fc354101420 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.643+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc354100ee0 con 0x7fc354101420 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.644+0000 7fc34bfff640 1 -- 172.21.15.1:0/4112673747 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fc33c042030 con 0x7fc354101420 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.645+0000 7fc34bfff640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3400a3240 0x7fc3400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.645+0000 7fc34bfff640 1 -- 172.21.15.1:0/4112673747 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc33c0efc00 con 0x7fc354101420 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.645+0000 7fc35259c640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3400a3240 0x7fc3400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.646+0000 7fc35259c640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3400a3240 0x7fc3400a5700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc344009b50 tx=0x7fc344005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:43.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.649+0000 7fc34bfff640 1 -- 172.21.15.1:0/4112673747 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc33c0f6080 con 0x7fc354101420 2024-09-19T09:08:43.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.828+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3541a73e0 con 0x7fc354101420 2024-09-19T09:08:43.829 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:43 smithi001 ceph-mon[30939]: pgmap v476: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T09:08:43.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.829+0000 7fc34bfff640 1 -- 172.21.15.1:0/4112673747 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22666 (secure 0 0 0) 0x7fc33c0b6e20 con 0x7fc354101420 2024-09-19T09:08:43.830 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:08:43.830 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":80,"fsid":"98b2a8e0-7664-11ef-bceb-c7b262605968","created":"2024-09-19T08:54:23.245178+0000","modified":"2024-09-19T09:02:11.680221+0000","last_up_change":"2024-09-19T09:01:12.453133+0000","last_in_change":"2024-09-19T09:00:49.273734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:57:30.365239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:01:58.505972+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:02:00.589422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a5c346b8-5301-4325-8c5d-24bfdb5ac836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6803","nonce":285096053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6805","nonce":285096053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6809","nonce":285096053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":285096053},{"type":"v1","addr":"172.21.15.1:6807","nonce":285096053}]},"public_addr":"172.21.15.1:6803/285096053","cluster_addr":"172.21.15.1:6805/285096053","heartbeat_back_addr":"172.21.15.1:6809/285096053","heartbeat_front_addr":"172.21.15.1:6807/285096053","state":["exists","up"]},{"osd":1,"uuid":"577de251-29ca-43bb-bfa9-62d8edcf7606","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6801","nonce":704223442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6803","nonce":704223442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6807","nonce":704223442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":704223442},{"type":"v1","addr":"172.21.15.22:6805","nonce":704223442}]},"public_addr":"172.21.15.22:6801/704223442","cluster_addr":"172.21.15.22:6803/704223442","heartbeat_back_addr":"172.21.15.22:6807/704223442","heartbeat_front_addr":"172.21.15.22:6805/704223442","state":["exists","up"]},{"osd":2,"uuid":"08408ff4-bdd7-41e5-9ebd-6bbfdc17c155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6801","nonce":3828827490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6803","nonce":3828827490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6807","nonce":3828827490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":3828827490},{"type":"v1","addr":"172.21.15.64:6805","nonce":3828827490}]},"public_addr":"172.21.15.64:6801/3828827490","cluster_addr":"172.21.15.64:6803/3828827490","heartbeat_back_addr":"172.21.15.64:6807/3828827490","heartbeat_front_addr":"172.21.15.64:6805/3828827490","state":["exists","up"]},{"osd":3,"uuid":"9d782b6f-5fcf-4198-b8a9-cf4dc57f038a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6811","nonce":4215889166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6813","nonce":4215889166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6817","nonce":4215889166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4215889166},{"type":"v1","addr":"172.21.15.1:6815","nonce":4215889166}]},"public_addr":"172.21.15.1:6811/4215889166","cluster_addr":"172.21.15.1:6813/4215889166","heartbeat_back_addr":"172.21.15.1:6817/4215889166","heartbeat_front_addr":"172.21.15.1:6815/4215889166","state":["exists","up"]},{"osd":4,"uuid":"aa65b2e2-2de3-4303-8efd-76384894b8cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6809","nonce":2803831833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6811","nonce":2803831833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6815","nonce":2803831833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2803831833},{"type":"v1","addr":"172.21.15.22:6813","nonce":2803831833}]},"public_addr":"172.21.15.22:6809/2803831833","cluster_addr":"172.21.15.22:6811/2803831833","heartbeat_back_addr":"172.21.15.22:6815/2803831833","heartbeat_front_addr":"172.21.15.22:6813/2803831833","state":["exists","up"]},{"osd":5,"uuid":"d85e3728-551a-417f-9a1f-37a6c7e144e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6809","nonce":2206197763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6811","nonce":2206197763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6815","nonce":2206197763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2206197763},{"type":"v1","addr":"172.21.15.64:6813","nonce":2206197763}]},"public_addr":"172.21.15.64:6809/2206197763","cluster_addr":"172.21.15.64:6811/2206197763","heartbeat_back_addr":"172.21.15.64:6815/2206197763","heartbeat_front_addr":"172.21.15.64:6813/2206197763","state":["exists","up"]},{"osd":6,"uuid":"dd093d03-4420-450f-bae0-f4c8690138f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6819","nonce":146026551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6821","nonce":146026551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6825","nonce":146026551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":146026551},{"type":"v1","addr":"172.21.15.1:6823","nonce":146026551}]},"public_addr":"172.21.15.1:6819/146026551","cluster_addr":"172.21.15.1:6821/146026551","heartbeat_back_addr":"172.21.15.1:6825/146026551","heartbeat_front_addr":"172.21.15.1:6823/146026551","state":["exists","up"]},{"osd":7,"uuid":"6c26c0c5-ee92-4ec9-8adc-6dde6335b42b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6817","nonce":1285451266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6819","nonce":1285451266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6823","nonce":1285451266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":1285451266},{"type":"v1","addr":"172.21.15.22:6821","nonce":1285451266}]},"public_addr":"172.21.15.22:6817/1285451266","cluster_addr":"172.21.15.22:6819/1285451266","heartbeat_back_addr":"172.21.15.22:6823/1285451266","heartbeat_front_addr":"172.21.15.22:6821/1285451266","state":["exists","up"]},{"osd":8,"uuid":"6eab8176-97e8-4a26-9293-64dacf2752e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6817","nonce":2825124096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6819","nonce":2825124096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6823","nonce":2825124096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2825124096},{"type":"v1","addr":"172.21.15.64:6821","nonce":2825124096}]},"public_addr":"172.21.15.64:6817/2825124096","cluster_addr":"172.21.15.64:6819/2825124096","heartbeat_back_addr":"172.21.15.64:6823/2825124096","heartbeat_front_addr":"172.21.15.64:6821/2825124096","state":["exists","up"]},{"osd":9,"uuid":"6c8cb115-549f-42fd-8bff-98586d00e5d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6827","nonce":1622106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6829","nonce":1622106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6833","nonce":1622106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1622106901},{"type":"v1","addr":"172.21.15.1:6831","nonce":1622106901}]},"public_addr":"172.21.15.1:6827/1622106901","cluster_addr":"172.21.15.1:6829/1622106901","heartbeat_back_addr":"172.21.15.1:6833/1622106901","heartbeat_front_addr":"172.21.15.1:6831/1622106901","state":["exists","up"]},{"osd":10,"uuid":"b6a50ba5-0cc9-4be8-bb6c-26b5043c6303","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6825","nonce":3539045596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6827","nonce":3539045596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6831","nonce":3539045596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3539045596},{"type":"v1","addr":"172.21.15.22:6829","nonce":3539045596}]},"public_addr":"172.21.15.22:6825/3539045596","cluster_addr":"172.21.15.22:6827/3539045596","heartbeat_back_addr":"172.21.15.22:6831/3539045596","heartbeat_front_addr":"172.21.15.22:6829/3539045596","state":["exists","up"]},{"osd":11,"uuid":"ea01a956-f246-4e9e-b294-9f24ae3b250d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6825","nonce":1960106906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6827","nonce":1960106906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6831","nonce":1960106906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1960106906},{"type":"v1","addr":"172.21.15.64:6829","nonce":1960106906}]},"public_addr":"172.21.15.64:6825/1960106906","cluster_addr":"172.21.15.64:6827/1960106906","heartbeat_back_addr":"172.21.15.64:6831/1960106906","heartbeat_front_addr":"172.21.15.64:6829/1960106906","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:56:35.976720+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:01.308099+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:26.876958+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:57:52.062985+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:17.235810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:58:42.135141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:06.218217+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:31.214053+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:59:55.740005+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:21.457753+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:00:46.576631+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:01:11.197431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":7}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/2387018469":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6800/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:6801/2001580204":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/859712265":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/4135803667":"2024-09-20T08:55:09.857036+0000","172.21.15.1:0/3240635112":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6801/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:6800/3303995107":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/3792489660":"2024-09-20T08:54:45.648707+0000","172.21.15.1:0/1402054231":"2024-09-20T08:54:45.648707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:08:43.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3400a3240 msgr2=0x7fc3400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:43.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3400a3240 0x7fc3400a5700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc344009b50 tx=0x7fc344005f90 comp rx=0 tx=0).stop 2024-09-19T09:08:43.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354101420 msgr2=0x7fc35410e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:43.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354101420 0x7fc35410e920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009230 tx=0x7fc33c004040 comp rx=0 tx=0).stop 2024-09-19T09:08:43.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 shutdown_connections 2024-09-19T09:08:43.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc354106a80 0x7fc35410ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc354101420 0x7fc35410e920 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc3400a3240 0x7fc3400a5700 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 --2- 172.21.15.1:0/4112673747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc354100a80 0x7fc35410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 >> 172.21.15.1:0/4112673747 conn(0x7fc3540fc7a0 msgr2=0x7fc3540fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:43.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 shutdown_connections 2024-09-19T09:08:43.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:43.832+0000 7fc358a2b640 1 -- 172.21.15.1:0/4112673747 wait complete. 2024-09-19T09:08:44.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:43 smithi064 ceph-mon[35179]: pgmap v476: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T09:08:44.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:43 smithi022 ceph-mon[35107]: pgmap v476: 97 pgs: 97 active+clean; 31 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T09:08:44.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T09:08:44.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:44 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4112673747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:08:44.886 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:45.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:44 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4112673747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:08:45.208 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:44 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4112673747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:08:45.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 -- 172.21.15.1:0/4100066764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c102790 msgr2=0x7f1e7c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:45.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4100066764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c102790 0x7f1e7c1067e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009900 tx=0x7f1e6402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 -- 172.21.15.1:0/4100066764 shutdown_connections 2024-09-19T09:08:45.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4100066764 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e7c106f10 0x7f1e7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4100066764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c102790 0x7f1e7c1067e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4100066764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e7c101de0 0x7f1e7c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 -- 172.21.15.1:0/4100066764 >> 172.21.15.1:0/4100066764 conn(0x7f1e7c0fd8c0 msgr2=0x7f1e7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 -- 172.21.15.1:0/4100066764 shutdown_connections 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 -- 172.21.15.1:0/4100066764 wait complete. 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.351+0000 7f1e8174c640 1 Processor -- start 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e8174c640 1 -- start start 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e8174c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e7c101de0 0x7f1e7c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e8174c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e7c102790 0x7f1e7c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e8174c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c106f10 0x7f1e7c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e8174c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c112050 con 0x7f1e7c106f10 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e8174c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c111ed0 con 0x7f1e7c102790 2024-09-19T09:08:45.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e8174c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c1121d0 con 0x7f1e7c101de0 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c106f10 0x7f1e7c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c106f10 0x7f1e7c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59756/0 (socket says 172.21.15.1:59756) 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 -- 172.21.15.1:0/4174987397 learned_addr learned my addr 172.21.15.1:0/4174987397 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7affd640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e7c101de0 0x7f1e7c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7a7fc640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e7c102790 0x7f1e7c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 -- 172.21.15.1:0/4174987397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e7c101de0 msgr2=0x7f1e7c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e7c101de0 0x7f1e7c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 -- 172.21.15.1:0/4174987397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e7c102790 msgr2=0x7f1e7c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e7c102790 0x7f1e7c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 -- 172.21.15.1:0/4174987397 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7c1a68f0 con 0x7f1e7c106f10 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.352+0000 7f1e7b7fe640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c106f10 0x7f1e7c074f70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400cce0 tx=0x7f1e7400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.353+0000 7f1e73fff640 1 -- 172.21.15.1:0/4174987397 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400f450 con 0x7f1e7c106f10 2024-09-19T09:08:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.353+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7c1a6be0 con 0x7f1e7c106f10 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.353+0000 7f1e73fff640 1 -- 172.21.15.1:0/4174987397 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1e7400faf0 con 0x7f1e7c106f10 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.353+0000 7f1e73fff640 1 -- 172.21.15.1:0/4174987397 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74018c50 con 0x7f1e7c106f10 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.353+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e7c1a70d0 con 0x7f1e7c106f10 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.354+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e7c1021c0 con 0x7f1e7c106f10 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.355+0000 7f1e73fff640 1 -- 172.21.15.1:0/4174987397 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1e7400fca0 con 0x7f1e7c106f10 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.355+0000 7f1e73fff640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e680a3240 0x7f1e680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.356+0000 7f1e7affd640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e680a3240 0x7f1e680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.356+0000 7f1e73fff640 1 -- 172.21.15.1:0/4174987397 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f1e740cffa0 con 0x7f1e7c106f10 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.356+0000 7f1e7affd640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e680a3240 0x7f1e680a5700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00abe0 tx=0x7f1e6c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:45.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.360+0000 7f1e73fff640 1 -- 172.21.15.1:0/4174987397 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e74014030 con 0x7f1e7c106f10 2024-09-19T09:08:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.571+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1e7c1a7360 con 0x7f1e7c106f10 2024-09-19T09:08:45.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.573+0000 7f1e73fff640 1 -- 172.21.15.1:0/4174987397 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f1e7409cc40 con 0x7f1e7c106f10 2024-09-19T09:08:45.574 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:08:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.576+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e680a3240 msgr2=0x7f1e680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.576+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e680a3240 0x7f1e680a5700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00abe0 tx=0x7f1e6c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.576+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c106f10 msgr2=0x7f1e7c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.576+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c106f10 0x7f1e7c074f70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400cce0 tx=0x7f1e7400a620 comp rx=0 tx=0).stop 2024-09-19T09:08:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.577+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 shutdown_connections 2024-09-19T09:08:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.577+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e7c106f10 0x7f1e7c074f70 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.577+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e7c102790 0x7f1e7c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.577+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f1e680a3240 0x7f1e680a5700 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.577+0000 7f1e8174c640 1 --2- 172.21.15.1:0/4174987397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e7c101de0 0x7f1e7c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.577+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 >> 172.21.15.1:0/4174987397 conn(0x7f1e7c0fd8c0 msgr2=0x7f1e7c0ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.577+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 shutdown_connections 2024-09-19T09:08:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:45.577+0000 7f1e8174c640 1 -- 172.21.15.1:0/4174987397 wait complete. 2024-09-19T09:08:45.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:45 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a[30935]: 2024-09-19T09:08:45.572+0000 7fe051b81640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:08:45.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:45 smithi001 ceph-mon[30939]: pgmap v477: 97 pgs: 97 active+clean; 31 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:08:45.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:45 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4174987397' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:08:45.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:45 smithi001 ceph-mon[30939]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:08:45.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:45 smithi001 ceph-mon[30939]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:08:45.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:45 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4174987397' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:08:45.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:45 smithi001 ceph-mon[30939]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:08:45.923 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:45 smithi001 ceph-mon[30939]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mon[35107]: pgmap v477: 97 pgs: 97 active+clean; 31 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4174987397' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mon[35107]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mon[35107]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4174987397' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mon[35107]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:08:45.961 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mon[35107]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T09:08:45.962 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: ignoring --setuser ceph since I am not root 2024-09-19T09:08:45.962 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: ignoring --setgroup ceph since I am not root 2024-09-19T09:08:45.962 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mds[65453]: -- 172.21.15.22:0/2839628605 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a655561c20 con 0x55a65553f400 2024-09-19T09:08:45.962 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: starting mds.b at 2024-09-19T09:08:45.962 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e[64839]: ignoring --setuser ceph since I am not root 2024-09-19T09:08:45.962 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e[64839]: ignoring --setgroup ceph since I am not root 2024-09-19T09:08:45.962 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mds[64843]: -- 172.21.15.22:0/700479052 <== mon.1 v2:172.21.15.64:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652b40bb860 con 0x5652b4099400 2024-09-19T09:08:45.962 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e[64839]: starting mds.e at 2024-09-19T09:08:45.963 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h[65139]: ignoring --setuser ceph since I am not root 2024-09-19T09:08:45.963 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h[65139]: ignoring --setgroup ceph since I am not root 2024-09-19T09:08:45.963 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-mds[65143]: -- 172.21.15.22:0/430438004 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b969e7c20 con 0x562b969c4800 2024-09-19T09:08:45.963 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:08:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h[65139]: starting mds.h at 2024-09-19T09:08:46.106 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c[65619]: ignoring --setuser ceph since I am not root 2024-09-19T09:08:46.106 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c[65619]: ignoring --setgroup ceph since I am not root 2024-09-19T09:08:46.106 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mds[65623]: -- 172.21.15.64:0/19294815 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cf65447860 con 0x55cf65425000 2024-09-19T09:08:46.106 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c[65619]: starting mds.c at 2024-09-19T09:08:46.107 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i[65919]: ignoring --setuser ceph since I am not root 2024-09-19T09:08:46.107 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i[65919]: ignoring --setgroup ceph since I am not root 2024-09-19T09:08:46.107 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mds[65923]: -- 172.21.15.64:0/2126597768 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ef9d2b860 con 0x556ef9d09000 2024-09-19T09:08:46.107 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i[65919]: starting mds.i at 2024-09-19T09:08:46.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mon[35179]: pgmap v477: 97 pgs: 97 active+clean; 31 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:08:46.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4174987397' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:08:46.107 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mon[35179]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:08:46.108 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mon[35179]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:08:46.109 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4174987397' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:08:46.109 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mon[35179]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:08:46.109 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mon[35179]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T09:08:46.109 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f[65317]: ignoring --setuser ceph since I am not root 2024-09-19T09:08:46.109 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f[65317]: ignoring --setgroup ceph since I am not root 2024-09-19T09:08:46.110 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-mds[65321]: -- 172.21.15.64:0/4075405734 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617cac8bc20 con 0x5617cac69000 2024-09-19T09:08:46.110 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:08:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f[65317]: starting mds.f at 2024-09-19T09:08:46.374 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:08:46.638 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:47.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.092+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/4195651248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8101de0 msgr2=0x7fc0b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.092+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/4195651248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8101de0 0x7fc0b81021c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009900 tx=0x7fc0b402a410 comp rx=0 tx=0).stop 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.092+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/4195651248 shutdown_connections 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.092+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/4195651248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0b8106f10 0x7fc0b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.092+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/4195651248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0b8102790 0x7fc0b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.092+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/4195651248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8101de0 0x7fc0b81021c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.092+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/4195651248 >> 172.21.15.1:0/4195651248 conn(0x7fc0b80fd8c0 msgr2=0x7fc0b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/4195651248 shutdown_connections 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/4195651248 wait complete. 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 Processor -- start 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 -- start start 2024-09-19T09:08:47.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0b8101de0 0x7fc0b8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0b8102790 0x7fc0b8198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8106f10 0x7fc0b819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b81120f0 con 0x7fc0b8106f10 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8111f70 con 0x7fc0b8102790 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0bfd3a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b8112270 con 0x7fc0b8101de0 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.093+0000 7fc0be2d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8106f10 0x7fc0b819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0be2d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8106f10 0x7fc0b819ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59772/0 (socket says 172.21.15.1:59772) 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0be2d7640 1 -- 172.21.15.1:0/2090249147 learned_addr learned my addr 172.21.15.1:0/2090249147 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0bd2d5640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0b8102790 0x7fc0b8198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0bdad6640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0b8101de0 0x7fc0b8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0be2d7640 1 -- 172.21.15.1:0/2090249147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0b8101de0 msgr2=0x7fc0b8198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0be2d7640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0b8101de0 0x7fc0b8198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0be2d7640 1 -- 172.21.15.1:0/2090249147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0b8102790 msgr2=0x7fc0b8198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0be2d7640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0b8102790 0x7fc0b8198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0be2d7640 1 -- 172.21.15.1:0/2090249147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b819d500 con 0x7fc0b8106f10 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0bd2d5640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0b8102790 0x7fc0b8198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0be2d7640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8106f10 0x7fc0b819ce20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b970 tx=0x7fc0b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0aeffd640 1 -- 172.21.15.1:0/2090249147 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0019070 con 0x7fc0b8106f10 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0aeffd640 1 -- 172.21.15.1:0/2090249147 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0b000cb40 con 0x7fc0b8106f10 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b819d7f0 con 0x7fc0b8106f10 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0aeffd640 1 -- 172.21.15.1:0/2090249147 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0007700 con 0x7fc0b8106f10 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.094+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b81a50d0 con 0x7fc0b8106f10 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.095+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b81021c0 con 0x7fc0b8106f10 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.096+0000 7fc0aeffd640 1 -- 172.21.15.1:0/2090249147 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fc0b001c070 con 0x7fc0b8106f10 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.097+0000 7fc0aeffd640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc0a40a3240 0x7fc0a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:47.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.097+0000 7fc0aeffd640 1 -- 172.21.15.1:0/2090249147 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8527+0+0 (secure 0 0 0) 0x7fc0b00cf070 con 0x7fc0b8106f10 2024-09-19T09:08:47.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.097+0000 7fc0bdad6640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc0a40a3240 0x7fc0a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:47.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.098+0000 7fc0bdad6640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc0a40a3240 0x7fc0a40a5700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4005ab0 tx=0x7fc0b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:47.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.101+0000 7fc0aeffd640 1 -- 172.21.15.1:0/2090249147 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0b009bc70 con 0x7fc0b8106f10 2024-09-19T09:08:47.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.314+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc0b802d7c0 con 0x7fc0b8106f10 2024-09-19T09:08:47.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.799+0000 7fc0aeffd640 1 -- 172.21.15.1:0/2090249147 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fc0b00bb020 con 0x7fc0b8106f10 2024-09-19T09:08:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc0a40a3240 msgr2=0x7fc0a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc0a40a3240 0x7fc0a40a5700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4005ab0 tx=0x7fc0b4005a20 comp rx=0 tx=0).stop 2024-09-19T09:08:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8106f10 msgr2=0x7fc0b819ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8106f10 0x7fc0b819ce20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b970 tx=0x7fc0b000be30 comp rx=0 tx=0).stop 2024-09-19T09:08:47.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 shutdown_connections 2024-09-19T09:08:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0b8106f10 0x7fc0b819ce20 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0b8102790 0x7fc0b8198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fc0a40a3240 0x7fc0a40a5700 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 --2- 172.21.15.1:0/2090249147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0b8101de0 0x7fc0b8198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.801+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 >> 172.21.15.1:0/2090249147 conn(0x7fc0b80fd8c0 msgr2=0x7fc0b80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.802+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 shutdown_connections 2024-09-19T09:08:47.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:47.802+0000 7fc0bfd3a640 1 -- 172.21.15.1:0/2090249147 wait complete. 2024-09-19T09:08:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: pgmap v479: 97 pgs: 97 active+clean; 31 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T09:08:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6834/2547337289,v1:172.21.15.22:6835/2547337289] up:boot 2024-09-19T09:08:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.64:6834/2914607709,v1:172.21.15.64:6835/2914607709] up:boot 2024-09-19T09:08:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6836/4245325065,v1:172.21.15.22:6837/4245325065] up:boot 2024-09-19T09:08:47.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.22:6838/2041001027,v1:172.21.15.22:6839/2041001027] up:boot 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.64:6836/3012699091,v1:172.21.15.64:6838/3012699091] up:boot 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: mds.? [v2:172.21.15.64:6837/3642472322,v1:172.21.15.64:6839/3642472322] up:boot 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:08:47.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:47 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2090249147' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:08:47.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: pgmap v479: 97 pgs: 97 active+clean; 31 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T09:08:47.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6834/2547337289,v1:172.21.15.22:6835/2547337289] up:boot 2024-09-19T09:08:47.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.64:6834/2914607709,v1:172.21.15.64:6835/2914607709] up:boot 2024-09-19T09:08:47.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6836/4245325065,v1:172.21.15.22:6837/4245325065] up:boot 2024-09-19T09:08:47.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.22:6838/2041001027,v1:172.21.15.22:6839/2041001027] up:boot 2024-09-19T09:08:47.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.64:6836/3012699091,v1:172.21.15.64:6838/3012699091] up:boot 2024-09-19T09:08:47.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: mds.? [v2:172.21.15.64:6837/3642472322,v1:172.21.15.64:6839/3642472322] up:boot 2024-09-19T09:08:47.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T09:08:47.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:08:47.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:08:47.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:08:47.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:08:47.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:08:47.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:08:47.960 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:47 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2090249147' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: pgmap v479: 97 pgs: 97 active+clean; 31 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6834/2547337289,v1:172.21.15.22:6835/2547337289] up:boot 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.64:6834/2914607709,v1:172.21.15.64:6835/2914607709] up:boot 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6836/4245325065,v1:172.21.15.22:6837/4245325065] up:boot 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.22:6838/2041001027,v1:172.21.15.22:6839/2041001027] up:boot 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.64:6836/3012699091,v1:172.21.15.64:6838/3012699091] up:boot 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: mds.? [v2:172.21.15.64:6837/3642472322,v1:172.21.15.64:6839/3642472322] up:boot 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:08:48.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:08:48.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:08:48.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:08:48.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:08:48.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: from='mgr.14150 172.21.15.1:0/948416664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:08:48.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:47 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2090249147' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:08:48.500 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:08:48.767 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:48.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:48 smithi001 ceph-mon[30939]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:08:48.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:48 smithi001 ceph-mon[30939]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:08:48.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:48 smithi001 ceph-mon[30939]: Cluster is now healthy 2024-09-19T09:08:48.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:48 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/2090249147' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:08:48.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:48 smithi001 ceph-mon[30939]: fsmap 12 up:standby 2024-09-19T09:08:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:48 smithi064 ceph-mon[35179]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:08:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:48 smithi064 ceph-mon[35179]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:08:48.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:48 smithi064 ceph-mon[35179]: Cluster is now healthy 2024-09-19T09:08:48.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:48 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/2090249147' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:08:48.857 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:48 smithi064 ceph-mon[35179]: fsmap 12 up:standby 2024-09-19T09:08:48.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:48 smithi022 ceph-mon[35107]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:08:48.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:48 smithi022 ceph-mon[35107]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:08:48.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:48 smithi022 ceph-mon[35107]: Cluster is now healthy 2024-09-19T09:08:48.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:48 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/2090249147' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:08:48.959 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:48 smithi022 ceph-mon[35107]: fsmap 12 up:standby 2024-09-19T09:08:49.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 -- 172.21.15.1:0/3961382382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100e30 msgr2=0x7f74f8104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 --2- 172.21.15.1:0/3961382382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100e30 0x7f74f8104e80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009900 tx=0x7f74e002a410 comp rx=0 tx=0).stop 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 -- 172.21.15.1:0/3961382382 shutdown_connections 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 --2- 172.21.15.1:0/3961382382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f81055b0 0x7f74f810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 --2- 172.21.15.1:0/3961382382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100e30 0x7f74f8104e80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 --2- 172.21.15.1:0/3961382382 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74f8100480 0x7f74f8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 -- 172.21.15.1:0/3961382382 >> 172.21.15.1:0/3961382382 conn(0x7f74f8077210 msgr2=0x7f74f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 -- 172.21.15.1:0/3961382382 shutdown_connections 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.264+0000 7f74fef97640 1 -- 172.21.15.1:0/3961382382 wait complete. 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fef97640 1 Processor -- start 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fef97640 1 -- start start 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fef97640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100480 0x7f74f81a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fef97640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8100e30 0x7f74f81a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fef97640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74f81055b0 0x7f74f819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fef97640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8110f80 con 0x7f74f8100480 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fef97640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8110e00 con 0x7f74f8100e30 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fef97640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8111100 con 0x7f74f81055b0 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fcd33640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100480 0x7f74f81a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fcd33640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100480 0x7f74f81a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59796/0 (socket says 172.21.15.1:59796) 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fcd33640 1 -- 172.21.15.1:0/4293148466 learned_addr learned my addr 172.21.15.1:0/4293148466 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74f7fff640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8100e30 0x7f74f81a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.265+0000 7f74fd534640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74f81055b0 0x7f74f819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74fcd33640 1 -- 172.21.15.1:0/4293148466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74f81055b0 msgr2=0x7f74f819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74fcd33640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74f81055b0 0x7f74f819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74fcd33640 1 -- 172.21.15.1:0/4293148466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8100e30 msgr2=0x7f74f81a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74fcd33640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8100e30 0x7f74f81a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74fcd33640 1 -- 172.21.15.1:0/4293148466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f819aec0 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74fcd33640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100480 0x7f74f81a0580 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f74e800d950 tx=0x7f74e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74f5ffb640 1 -- 172.21.15.1:0/4293148466 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8017030 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74f5ffb640 1 -- 172.21.15.1:0/4293148466 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74e8004020 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f819b1b0 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74f5ffb640 1 -- 172.21.15.1:0/4293148466 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8004a00 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.266+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f81a7500 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.267+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f8101960 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.268+0000 7f74f5ffb640 1 -- 172.21.15.1:0/4293148466 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f74e80041d0 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.269+0000 7f74f5ffb640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74e40a3240 0x7f74e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.269+0000 7f74f5ffb640 1 -- 172.21.15.1:0/4293148466 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8527+0+0 (secure 0 0 0) 0x7f74e80cf390 con 0x7f74f8100480 2024-09-19T09:08:49.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.269+0000 7f74f7fff640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74e40a3240 0x7f74e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.270+0000 7f74f7fff640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74e40a3240 0x7f74e40a5700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009230 tx=0x7f74e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.273+0000 7f74f5ffb640 1 -- 172.21.15.1:0/4293148466 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74e809bf90 con 0x7f74f8100480 2024-09-19T09:08:49.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.449+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f74f81a76d0 con 0x7f74f8100480 2024-09-19T09:08:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.801+0000 7f74f5ffb640 1 -- 172.21.15.1:0/4293148466 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) ==== 181+0+0 (secure 0 0 0) 0x7f74e809b890 con 0x7f74f8100480 2024-09-19T09:08:49.802 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:08:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.803+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74e40a3240 msgr2=0x7f74e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74e40a3240 0x7f74e40a5700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009230 tx=0x7f74e00058d0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100480 msgr2=0x7f74f81a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100480 0x7f74f81a0580 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f74e800d950 tx=0x7f74e800de10 comp rx=0 tx=0).stop 2024-09-19T09:08:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 shutdown_connections 2024-09-19T09:08:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7f74e40a3240 0x7f74e40a5700 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74f81055b0 0x7f74f819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8100e30 0x7f74f81a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 --2- 172.21.15.1:0/4293148466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74f8100480 0x7f74f81a0580 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 >> 172.21.15.1:0/4293148466 conn(0x7f74f8077210 msgr2=0x7f74f8102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 shutdown_connections 2024-09-19T09:08:49.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:49.804+0000 7f74fef97640 1 -- 172.21.15.1:0/4293148466 wait complete. 2024-09-19T09:08:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:49 smithi064 ceph-mon[35179]: pgmap v480: 97 pgs: 97 active+clean; 31 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T09:08:50.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:49 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4293148466' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:08:50.156 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:49 smithi001 ceph-mon[30939]: pgmap v480: 97 pgs: 97 active+clean; 31 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T09:08:50.156 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:49 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4293148466' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:08:50.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:49 smithi022 ceph-mon[35107]: pgmap v480: 97 pgs: 97 active+clean; 31 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T09:08:50.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:49 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4293148466' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:08:50.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:08:50.888 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:08:51.010 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:50 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/4293148466' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:08:51.010 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:50 smithi001 ceph-mon[30939]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:08:51.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:50 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/4293148466' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:08:51.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:50 smithi064 ceph-mon[35179]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:08:51.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:50 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/4293148466' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:08:51.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:50 smithi022 ceph-mon[35107]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:08:51.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.439+0000 7fde54d1d640 1 -- 172.21.15.1:0/3659116571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50101de0 msgr2=0x7fde501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.439+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3659116571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50101de0 0x7fde501021c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fde40009900 tx=0x7fde4002a410 comp rx=0 tx=0).stop 2024-09-19T09:08:51.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.439+0000 7fde54d1d640 1 -- 172.21.15.1:0/3659116571 shutdown_connections 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.439+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3659116571 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde50106f10 0x7fde5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.439+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3659116571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde50102790 0x7fde501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.439+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3659116571 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50101de0 0x7fde501021c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.439+0000 7fde54d1d640 1 -- 172.21.15.1:0/3659116571 >> 172.21.15.1:0/3659116571 conn(0x7fde500fd8c0 msgr2=0x7fde500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.439+0000 7fde54d1d640 1 -- 172.21.15.1:0/3659116571 shutdown_connections 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.440+0000 7fde54d1d640 1 -- 172.21.15.1:0/3659116571 wait complete. 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.440+0000 7fde54d1d640 1 Processor -- start 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.440+0000 7fde54d1d640 1 -- start start 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.440+0000 7fde54d1d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde50101de0 0x7fde50198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.440+0000 7fde54d1d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde50102790 0x7fde50198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.440+0000 7fde54d1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50106f10 0x7fde5019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde54d1d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fde50112090 con 0x7fde50106f10 2024-09-19T09:08:51.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde54d1d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fde50111f10 con 0x7fde50102790 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde54d1d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fde50112210 con 0x7fde50101de0 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50106f10 0x7fde5019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50106f10 0x7fde5019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59816/0 (socket says 172.21.15.1:59816) 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 -- 172.21.15.1:0/3199654048 learned_addr learned my addr 172.21.15.1:0/3199654048 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4dd9b640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde50102790 0x7fde50198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4e59c640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde50101de0 0x7fde50198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 -- 172.21.15.1:0/3199654048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde50101de0 msgr2=0x7fde50198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde50101de0 0x7fde50198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 -- 172.21.15.1:0/3199654048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde50102790 msgr2=0x7fde50198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde50102790 0x7fde50198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 -- 172.21.15.1:0/3199654048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5019d520 con 0x7fde50106f10 2024-09-19T09:08:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde4ed9d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50106f10 0x7fde5019ce40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fde4800eb10 tx=0x7fde4800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde477fe640 1 -- 172.21.15.1:0/3199654048 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48004b20 con 0x7fde50106f10 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde477fe640 1 -- 172.21.15.1:0/3199654048 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde48004cc0 con 0x7fde50106f10 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5019d810 con 0x7fde50106f10 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde477fe640 1 -- 172.21.15.1:0/3199654048 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde480107f0 con 0x7fde50106f10 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.441+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde501a50f0 con 0x7fde50106f10 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.443+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde501021c0 con 0x7fde50106f10 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.443+0000 7fde477fe640 1 -- 172.21.15.1:0/3199654048 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fde48005020 con 0x7fde50106f10 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.444+0000 7fde477fe640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fde3c0a3240 0x7fde3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.444+0000 7fde4e59c640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fde3c0a3240 0x7fde3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.444+0000 7fde477fe640 1 -- 172.21.15.1:0/3199654048 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8031+0+0 (secure 0 0 0) 0x7fde480cfcc0 con 0x7fde50106f10 2024-09-19T09:08:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.445+0000 7fde4e59c640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fde3c0a3240 0x7fde3c0a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde40009230 tx=0x7fde400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:51.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.449+0000 7fde477fe640 1 -- 172.21.15.1:0/3199654048 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde4809cb00 con 0x7fde50106f10 2024-09-19T09:08:51.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.624+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fde5010a0f0 con 0x7fde50106f10 2024-09-19T09:08:51.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.813+0000 7fde477fe640 1 -- 172.21.15.1:0/3199654048 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) ==== 169+0+0 (secure 0 0 0) 0x7fde4809c400 con 0x7fde50106f10 2024-09-19T09:08:51.814 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-19T09:08:51.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.816+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fde3c0a3240 msgr2=0x7fde3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.816+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fde3c0a3240 0x7fde3c0a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde40009230 tx=0x7fde400058d0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.816+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50106f10 msgr2=0x7fde5019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.816+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50106f10 0x7fde5019ce40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fde4800eb10 tx=0x7fde4800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.817+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 shutdown_connections 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.817+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fde50106f10 0x7fde5019ce40 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.817+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde50102790 0x7fde50198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.817+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.1:6800/554641341,v1:172.21.15.1:6801/554641341] conn(0x7fde3c0a3240 0x7fde3c0a5700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.817+0000 7fde54d1d640 1 --2- 172.21.15.1:0/3199654048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde50101de0 0x7fde50198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.817+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 >> 172.21.15.1:0/3199654048 conn(0x7fde500fd8c0 msgr2=0x7fde500feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.817+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 shutdown_connections 2024-09-19T09:08:51.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:08:51.817+0000 7fde54d1d640 1 -- 172.21.15.1:0/3199654048 wait complete. 2024-09-19T09:08:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:51 smithi001 ceph-mon[30939]: pgmap v482: 65 pgs: 65 active+clean; 577 KiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:08:52.048 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:51 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3199654048' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:08:52.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:51 smithi064 ceph-mon[35179]: pgmap v482: 65 pgs: 65 active+clean; 577 KiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:08:52.106 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:51 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3199654048' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:08:52.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:51 smithi022 ceph-mon[35107]: pgmap v482: 65 pgs: 65 active+clean; 577 KiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:08:52.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:51 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3199654048' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:08:52.515 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:08:52.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:08:52.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:08:52.610 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:08:52.610 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:08:52.627 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:08:52.645 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:08:52.665 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:08:52.665 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T09:08:52.666 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:08:52.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:52 smithi001 systemd[1]: Stopping Ceph mon.a for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:52 smithi064 ceph-mon[35179]: from='client.? 172.21.15.1:0/3199654048' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:08:52.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:52 smithi064 ceph-mon[35179]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:08:53.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:52 smithi022 ceph-mon[35107]: from='client.? 172.21.15.1:0/3199654048' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:08:53.209 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:52 smithi022 ceph-mon[35107]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:08:53.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:52 smithi001 ceph-mon[30939]: from='client.? 172.21.15.1:0/3199654048' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:08:53.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:52 smithi001 ceph-mon[30939]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:08:53.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a[30935]: 2024-09-19T09:08:52.994+0000 7fe05738c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:53.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a[30935]: 2024-09-19T09:08:52.994+0000 7fe05738c640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:08:53.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:53 smithi001 podman[98304]: 2024-09-19 09:08:53.210700125 +0000 UTC m=+0.341418259 container died ba7e58f53a965adb44b7f3813f6198eebd425a0f0ee4f12649e569354a10cb9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:08:53.798 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:53 smithi001 podman[98304]: 2024-09-19 09:08:53.711864005 +0000 UTC m=+0.842582124 container cleanup ba7e58f53a965adb44b7f3813f6198eebd425a0f0ee4f12649e569354a10cb9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:08:53.799 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:53 smithi001 bash[98304]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:08:54.152 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:08:53 smithi001 podman[98317]: 2024-09-19 09:08:53.975515405 +0000 UTC m=+0.762483573 container remove ba7e58f53a965adb44b7f3813f6198eebd425a0f0ee4f12649e569354a10cb9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:08:54.160 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T09:08:54.228 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:08:54.228 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T09:08:54.229 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T09:08:54.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.b 2024-09-19T09:08:54.660 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:54 smithi022 systemd[1]: Stopping Ceph mon.b for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:54.946 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-b[35103]: 2024-09-19T09:08:54.659+0000 7fdb159b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:54.946 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-b[35103]: 2024-09-19T09:08:54.659+0000 7fdb159b7640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:08:54.946 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:54 smithi022 podman[68411]: 2024-09-19 09:08:54.74196113 +0000 UTC m=+0.306301669 container died d3e4a5cd071fda7cbe554c15f1dfc9652a6398276ae6819d52db7d8c09e15ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T09:08:55.205 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:55 smithi022 podman[68411]: 2024-09-19 09:08:55.059999796 +0000 UTC m=+0.624340340 container cleanup d3e4a5cd071fda7cbe554c15f1dfc9652a6398276ae6819d52db7d8c09e15ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-b, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:08:55.206 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:55 smithi022 bash[68411]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-b 2024-09-19T09:08:55.459 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:08:55 smithi022 podman[68423]: 2024-09-19 09:08:55.286167359 +0000 UTC m=+0.542612583 container remove d3e4a5cd071fda7cbe554c15f1dfc9652a6398276ae6819d52db7d8c09e15ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:08:55.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T09:08:55.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:08:55.605 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T09:08:55.605 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T09:08:55.606 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.c 2024-09-19T09:08:55.949 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:55 smithi064 systemd[1]: Stopping Ceph mon.c for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:56.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-c[35175]: 2024-09-19T09:08:55.948+0000 7f858fbaf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:56.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-c[35175]: 2024-09-19T09:08:55.948+0000 7f858fbaf640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:08:56.356 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:56 smithi064 podman[69089]: 2024-09-19 09:08:56.17380889 +0000 UTC m=+0.358464186 container died 0a168ca63fbcd0d44f01cb6fd93e312540d2d7785335677fdb91cc245d3ea9b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T09:08:56.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:56 smithi064 podman[69089]: 2024-09-19 09:08:56.574251911 +0000 UTC m=+0.758907206 container cleanup 0a168ca63fbcd0d44f01cb6fd93e312540d2d7785335677fdb91cc245d3ea9b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:08:56.856 INFO:journalctl@ceph.mon.c.smithi064.stdout:Sep 19 09:08:56 smithi064 bash[69089]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mon-c 2024-09-19T09:08:57.058 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T09:08:57.103 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:08:57.104 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T09:08:57.104 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T09:08:57.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:08:57.409 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:08:57 smithi001 systemd[1]: Stopping Ceph mgr.x for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:57.751 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:08:57 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x[31165]: 2024-09-19T09:08:57.407+0000 7f9bfc679640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:57.751 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:08:57 smithi001 podman[98434]: 2024-09-19 09:08:57.439478471 +0000 UTC m=+0.133860711 container died f135ae2e02ea533ab8492f6124c71536c2a28fd8a7e4b0e6c0372940d3406636 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:08:58.048 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:08:57 smithi001 podman[98434]: 2024-09-19 09:08:57.942415202 +0000 UTC m=+0.636797444 container cleanup f135ae2e02ea533ab8492f6124c71536c2a28fd8a7e4b0e6c0372940d3406636 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T09:08:58.049 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:08:57 smithi001 bash[98434]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-x 2024-09-19T09:08:58.380 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T09:08:58.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:08:58.419 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T09:08:58.419 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T09:08:58.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.y 2024-09-19T09:08:58.709 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:08:58 smithi022 systemd[1]: Stopping Ceph mgr.y for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:08:59.132 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:08:58 smithi022 podman[68546]: 2024-09-19 09:08:58.751927836 +0000 UTC m=+0.123746345 container died 0f323c73707c0487709da5effceb5a16247bb8d296a09eade72e1d51ac49cf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:08:59.459 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:08:59 smithi022 podman[68546]: 2024-09-19 09:08:59.239584122 +0000 UTC m=+0.611402620 container cleanup 0f323c73707c0487709da5effceb5a16247bb8d296a09eade72e1d51ac49cf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:08:59.459 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:08:59 smithi022 bash[68546]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-y 2024-09-19T09:08:59.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T09:08:59.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:08:59.703 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T09:08:59.703 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T09:08:59.703 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.z 2024-09-19T09:09:00.033 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 09:08:59 smithi064 systemd[1]: Stopping Ceph mgr.z for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:00.296 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 09:09:00 smithi064 podman[69213]: 2024-09-19 09:09:00.033680169 +0000 UTC m=+0.130871318 container died f015fea63ea311e1dc1bb70d6decdcef1614a509ccd28252bcac420b5c05a874 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:09:00.606 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 09:09:00 smithi064 podman[69213]: 2024-09-19 09:09:00.362968488 +0000 UTC m=+0.460159637 container cleanup f015fea63ea311e1dc1bb70d6decdcef1614a509ccd28252bcac420b5c05a874 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T09:09:00.606 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 09:09:00 smithi064 bash[69213]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z 2024-09-19T09:09:00.940 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 09:09:00 smithi064 podman[69228]: 2024-09-19 09:09:00.689128589 +0000 UTC m=+0.648665367 container remove f015fea63ea311e1dc1bb70d6decdcef1614a509ccd28252bcac420b5c05a874 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mgr-z, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:09:00.940 INFO:journalctl@ceph.mgr.z.smithi064.stdout:Sep 19 09:09:00 smithi064 systemd[1]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-19T09:09:00.944 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T09:09:00.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:09:00.977 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T09:09:00.977 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:09:00.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:09:01.289 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:01 smithi001 systemd[1]: Stopping Ceph osd.0 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:01.549 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:01 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0[44801]: 2024-09-19T09:09:01.287+0000 7f3110d78640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:09:01.549 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:01 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0[44801]: 2024-09-19T09:09:01.287+0000 7f3110d78640 -1 osd.0 83 *** Got signal Terminated *** 2024-09-19T09:09:01.549 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:01 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0[44801]: 2024-09-19T09:09:01.287+0000 7f3110d78640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:09:07.049 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:06 smithi001 podman[98557]: 2024-09-19 09:09:06.790330092 +0000 UTC m=+5.611399688 container died 0249f937fd21e4d04a2bd7d8efb9a312c83a473ee48f1305cdc5fcf8299c3031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T09:09:07.515 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:07 smithi001 podman[98557]: 2024-09-19 09:09:07.272268283 +0000 UTC m=+6.093337878 container cleanup 0249f937fd21e4d04a2bd7d8efb9a312c83a473ee48f1305cdc5fcf8299c3031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:09:07.515 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:07 smithi001 bash[98557]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:09:07.799 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:07 smithi001 podman[98574]: 2024-09-19 09:09:07.515342593 +0000 UTC m=+0.717423495 container remove 0249f937fd21e4d04a2bd7d8efb9a312c83a473ee48f1305cdc5fcf8299c3031 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:09:08.152 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:07 smithi001 podman[98666]: 2024-09-19 09:09:07.762950318 +0000 UTC m=+0.016663375 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:09:08.152 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:07 smithi001 podman[98666]: 2024-09-19 09:09:07.908402566 +0000 UTC m=+0.162115653 container create 9570dd7bba6bb7482742e49e538e663656f165e2fe6487e782763ef8c0bc1219 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:09:08.549 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:08 smithi001 podman[98666]: 2024-09-19 09:09:08.152432425 +0000 UTC m=+0.406145480 container init 9570dd7bba6bb7482742e49e538e663656f165e2fe6487e782763ef8c0bc1219 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:09:08.549 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:08 smithi001 podman[98666]: 2024-09-19 09:09:08.156395631 +0000 UTC m=+0.410108684 container start 9570dd7bba6bb7482742e49e538e663656f165e2fe6487e782763ef8c0bc1219 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T09:09:08.549 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:08 smithi001 podman[98666]: 2024-09-19 09:09:08.277880432 +0000 UTC m=+0.531593486 container attach 9570dd7bba6bb7482742e49e538e663656f165e2fe6487e782763ef8c0bc1219 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:09:08.549 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:09:08 smithi001 podman[98666]: 2024-09-19 09:09:08.348355902 +0000 UTC m=+0.602068967 container died 9570dd7bba6bb7482742e49e538e663656f165e2fe6487e782763ef8c0bc1219 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:09:09.025 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:09:09.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:09:09.070 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:09:09.070 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:09:09.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:09:09.394 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:09 smithi022 systemd[1]: Stopping Ceph osd.1 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:09.709 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1[39569]: 2024-09-19T09:09:09.392+0000 7f6c305e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:09:09.709 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1[39569]: 2024-09-19T09:09:09.392+0000 7f6c305e0640 -1 osd.1 83 *** Got signal Terminated *** 2024-09-19T09:09:09.709 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1[39569]: 2024-09-19T09:09:09.392+0000 7f6c305e0640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:09:15.103 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:14 smithi022 podman[68671]: 2024-09-19 09:09:14.725979585 +0000 UTC m=+5.457303932 container died 3b66a4d79e4c91f93cebd74ee808ae9b68fadf9c8592b10497d03c1908c1c484 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:09:15.459 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:15 smithi022 podman[68671]: 2024-09-19 09:09:15.201342234 +0000 UTC m=+5.932666571 container cleanup 3b66a4d79e4c91f93cebd74ee808ae9b68fadf9c8592b10497d03c1908c1c484 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:09:15.459 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:15 smithi022 bash[68671]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:09:15.825 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:15 smithi022 podman[68689]: 2024-09-19 09:09:15.460955809 +0000 UTC m=+0.724627529 container remove 3b66a4d79e4c91f93cebd74ee808ae9b68fadf9c8592b10497d03c1908c1c484 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:09:16.100 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:15 smithi022 podman[68777]: 2024-09-19 09:09:15.728477849 +0000 UTC m=+0.016352679 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:09:16.100 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:15 smithi022 podman[68777]: 2024-09-19 09:09:15.8452105 +0000 UTC m=+0.133085373 container create 0281892504b0bd49cc25f49ab337e40f21a9970a1e66f7706adde2f667e55936 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:09:16.459 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:16 smithi022 podman[68777]: 2024-09-19 09:09:16.100031133 +0000 UTC m=+0.387905962 container init 0281892504b0bd49cc25f49ab337e40f21a9970a1e66f7706adde2f667e55936 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T09:09:16.460 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:16 smithi022 podman[68777]: 2024-09-19 09:09:16.103721819 +0000 UTC m=+0.391596648 container start 0281892504b0bd49cc25f49ab337e40f21a9970a1e66f7706adde2f667e55936 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:09:16.460 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:16 smithi022 podman[68777]: 2024-09-19 09:09:16.214354959 +0000 UTC m=+0.502229793 container attach 0281892504b0bd49cc25f49ab337e40f21a9970a1e66f7706adde2f667e55936 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:09:16.460 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:16 smithi022 podman[68777]: 2024-09-19 09:09:16.291017782 +0000 UTC m=+0.578892611 container died 0281892504b0bd49cc25f49ab337e40f21a9970a1e66f7706adde2f667e55936 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T09:09:16.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:09:16.988 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:16 smithi022 podman[68800]: 2024-09-19 09:09:16.94289248 +0000 UTC m=+0.646034146 container remove 0281892504b0bd49cc25f49ab337e40f21a9970a1e66f7706adde2f667e55936 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:09:16.989 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:16 smithi022 systemd[1]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-19T09:09:16.989 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:16 smithi022 systemd[1]: Stopped Ceph osd.1 for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:09:16.989 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:09:16 smithi022 systemd[1]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.1.service: Consumed 16.526s CPU time. 2024-09-19T09:09:17.006 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:09:17.007 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:09:17.007 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:09:17.007 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:09:17.317 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:17 smithi064 systemd[1]: Stopping Ceph osd.2 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:17.606 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2[40169]: 2024-09-19T09:09:17.316+0000 7fd4912c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:09:17.606 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2[40169]: 2024-09-19T09:09:17.316+0000 7fd4912c7640 -1 osd.2 83 *** Got signal Terminated *** 2024-09-19T09:09:17.606 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2[40169]: 2024-09-19T09:09:17.316+0000 7fd4912c7640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:09:23.106 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:22 smithi064 podman[69336]: 2024-09-19 09:09:22.829740395 +0000 UTC m=+5.620280984 container died fbe9f247307fd41c41874fa98bc78716f2f179c25bf6b9acb3dcc6e87366b9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:09:23.532 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:23 smithi064 podman[69336]: 2024-09-19 09:09:23.299894998 +0000 UTC m=+6.090435579 container cleanup fbe9f247307fd41c41874fa98bc78716f2f179c25bf6b9acb3dcc6e87366b9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:09:23.532 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:23 smithi064 bash[69336]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:09:23.856 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:23 smithi064 podman[69353]: 2024-09-19 09:09:23.546460669 +0000 UTC m=+0.710197264 container remove fbe9f247307fd41c41874fa98bc78716f2f179c25bf6b9acb3dcc6e87366b9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:09:24.187 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:23 smithi064 podman[69454]: 2024-09-19 09:09:23.893693194 +0000 UTC m=+0.096410661 container create 82cde7f9ae956daf8e98e1d637a13b9605d45459674d401bf3ead7de39ba5d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:09:24.188 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:23 smithi064 podman[69454]: 2024-09-19 09:09:23.813369507 +0000 UTC m=+0.016086976 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:09:24.188 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:24 smithi064 podman[69454]: 2024-09-19 09:09:24.112957582 +0000 UTC m=+0.315675051 container init 82cde7f9ae956daf8e98e1d637a13b9605d45459674d401bf3ead7de39ba5d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:09:24.188 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:24 smithi064 podman[69454]: 2024-09-19 09:09:24.116296781 +0000 UTC m=+0.319014256 container start 82cde7f9ae956daf8e98e1d637a13b9605d45459674d401bf3ead7de39ba5d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:09:24.188 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:24 smithi064 podman[69454]: 2024-09-19 09:09:24.187883679 +0000 UTC m=+0.390601160 container attach 82cde7f9ae956daf8e98e1d637a13b9605d45459674d401bf3ead7de39ba5d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:09:24.606 INFO:journalctl@ceph.osd.2.smithi064.stdout:Sep 19 09:09:24 smithi064 podman[69454]: 2024-09-19 09:09:24.309569622 +0000 UTC m=+0.512287095 container died 82cde7f9ae956daf8e98e1d637a13b9605d45459674d401bf3ead7de39ba5d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T09:09:25.028 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:09:25.073 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:09:25.074 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:09:25.074 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:09:25.074 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:09:25.402 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:25 smithi001 systemd[1]: Stopping Ceph osd.3 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:25.799 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:25 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3[51742]: 2024-09-19T09:09:25.400+0000 7fcb023ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:09:25.799 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:25 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3[51742]: 2024-09-19T09:09:25.400+0000 7fcb023ac640 -1 osd.3 83 *** Got signal Terminated *** 2024-09-19T09:09:25.799 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:25 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3[51742]: 2024-09-19T09:09:25.400+0000 7fcb023ac640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:09:27.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:27 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:27.017+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:28.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:27 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:27.770+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:28.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:28.042+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:28.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:28 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:28.606+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:29.025 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:28.683+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:29.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:28 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:28.726+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:29.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:29.025+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:29.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:29 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:29.625+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:30.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:29 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:29.767+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:30.067 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:29.652+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:30.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:30.066+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:30.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:30 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:30.593+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:31.042 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:30.673+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:31.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:30 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:30.754+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:31.049 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:30 smithi001 podman[98780]: 2024-09-19 09:09:30.7912978 +0000 UTC m=+5.514402958 container died 1797dae368b2580ee8e5d54c1dea9712416f02397bdef23295900bce5853ea97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:09:31.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:31.042+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:31.502 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:31 smithi001 podman[98780]: 2024-09-19 09:09:31.317980644 +0000 UTC m=+6.041085783 container cleanup 1797dae368b2580ee8e5d54c1dea9712416f02397bdef23295900bce5853ea97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:09:31.503 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:31 smithi001 bash[98780]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:09:31.781 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:31 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:31.729+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:31.782 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:31 smithi001 podman[98807]: 2024-09-19 09:09:31.502778442 +0000 UTC m=+0.705382424 container remove 1797dae368b2580ee8e5d54c1dea9712416f02397bdef23295900bce5853ea97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:09:31.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:31 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:31.598+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:32.014 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:31.701+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:32.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:31 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:31.781+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:32.049 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:31 smithi001 podman[98895]: 2024-09-19 09:09:31.848528109 +0000 UTC m=+0.016632584 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:09:32.049 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:31 smithi001 podman[98895]: 2024-09-19 09:09:31.970374239 +0000 UTC m=+0.138478694 container create 4dcbbc479ed6645dd2f760c8c012887ae5ce2b5fecd42b2f7af4f489b13f47e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T09:09:32.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:32.013+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:32.395 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:32 smithi001 podman[98895]: 2024-09-19 09:09:32.197552959 +0000 UTC m=+0.365657444 container init 4dcbbc479ed6645dd2f760c8c012887ae5ce2b5fecd42b2f7af4f489b13f47e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:09:32.395 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:32 smithi001 podman[98895]: 2024-09-19 09:09:32.201083166 +0000 UTC m=+0.369187632 container start 4dcbbc479ed6645dd2f760c8c012887ae5ce2b5fecd42b2f7af4f489b13f47e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T09:09:32.395 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:32 smithi001 podman[98895]: 2024-09-19 09:09:32.272557723 +0000 UTC m=+0.440662196 container attach 4dcbbc479ed6645dd2f760c8c012887ae5ce2b5fecd42b2f7af4f489b13f47e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:09:32.684 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:09:32 smithi001 podman[98895]: 2024-09-19 09:09:32.395564519 +0000 UTC m=+0.563668991 container died 4dcbbc479ed6645dd2f760c8c012887ae5ce2b5fecd42b2f7af4f489b13f47e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:09:32.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:32 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:32.583+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:33.043 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:32.742+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:33.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:32 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:32.688+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:33.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:32 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:32.771+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:33.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:09:33.123 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:09:33.124 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:09:33.124 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:09:33.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:09:33.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:33.043+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:33.429 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:33 smithi022 systemd[1]: Stopping Ceph osd.4 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:33.709 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:33 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:33.536+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:33.709 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:33 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4[46216]: 2024-09-19T09:09:33.428+0000 7fe3af6e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:09:33.709 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:33 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4[46216]: 2024-09-19T09:09:33.428+0000 7fe3af6e0640 -1 osd.4 83 *** Got signal Terminated *** 2024-09-19T09:09:33.709 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:33 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4[46216]: 2024-09-19T09:09:33.428+0000 7fe3af6e0640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:09:34.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:33 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:33.696+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:34.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:33 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:33.750+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:34.092 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:33.749+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:34.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:34 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:34.092+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:34.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:34 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:34.577+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:35.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:34.674+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:35.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:34 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:34.701+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:35.077 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:34 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:34.779+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:35.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:35 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:35.096+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:35.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:35 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:35.613+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:36.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:35 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:35.727+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:36.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:35 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:35.628+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:36.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:35 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:35.628+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:36.050 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:35 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:35.736+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:36.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:36 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:36.050+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:36.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:36 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:36.643+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:37.002 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:36 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:36.724+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:37.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:36 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:36.753+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:37.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:36 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:36.669+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:37.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:36 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:36.669+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:37.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:37 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:37.001+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:37.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:37 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:37.001+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:37.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:37 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4[46216]: 2024-09-19T09:09:37.019+0000 7fe3abce5640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.606871+0000 front 2024-09-19T09:09:11.606847+0000 (oldest deadline 2024-09-19T09:09:36.906863+0000) 2024-09-19T09:09:37.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:37 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:37.665+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:37.989 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:37 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:37.725+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:37.989 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:37 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:37.725+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:38.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:37 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:37.664+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:38.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:37 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:37.664+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:38.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:37 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:37.711+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:38.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:37 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:37.711+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:38.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:37 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:37.989+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:38.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:37 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:37.989+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:38.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:38 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4[46216]: 2024-09-19T09:09:38.005+0000 7fe3abce5640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.606871+0000 front 2024-09-19T09:09:11.606847+0000 (oldest deadline 2024-09-19T09:09:36.906863+0000) 2024-09-19T09:09:38.959 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:38 smithi022 podman[68891]: 2024-09-19 09:09:38.835558034 +0000 UTC m=+5.510040877 container died 6486936d3e1aead2b5163f8568c544a8898b0ac2621539030c8baa3f9f75d700 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:09:38.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:38 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:38.649+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:38.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:38 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:38.650+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:39.019 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:38 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:38.966+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:39.019 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:38 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:38.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:39.019 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:38 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:38.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:39.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:38 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:38.646+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:39.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:38 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:38.646+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:39.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:38 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:38.744+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:39.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:38 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:38.744+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:39.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:39 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:39.019+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:39.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:39 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:39.019+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:39.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:39 smithi022 podman[68891]: 2024-09-19 09:09:39.228394959 +0000 UTC m=+5.902877794 container cleanup 6486936d3e1aead2b5163f8568c544a8898b0ac2621539030c8baa3f9f75d700 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:09:39.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:39 smithi022 bash[68891]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:09:39.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:39 smithi022 podman[68905]: 2024-09-19 09:09:39.362849415 +0000 UTC m=+0.518793909 container remove 6486936d3e1aead2b5163f8568c544a8898b0ac2621539030c8baa3f9f75d700 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:09:39.916 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:39 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:39.655+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:39.916 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:39 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:39.655+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:39.916 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:39 smithi022 podman[68993]: 2024-09-19 09:09:39.675085605 +0000 UTC m=+0.016007214 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:09:39.916 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:39 smithi022 podman[68993]: 2024-09-19 09:09:39.788768424 +0000 UTC m=+0.129690026 container create 5e4aebabbcff0026a6542b75a95121948f87a5dea7949fe30bd38507c1e8ff89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:09:40.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:39 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:39.615+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:40.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:39 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:39.615+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:40.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:39 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:39.745+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:40.050 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:39 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:39.745+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:40.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:39 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:39.928+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:40.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:39 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:39.792+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:40.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:39 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:39.792+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:40.107 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:39 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:39.982+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:40.107 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:39 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:39.982+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:40.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:40 smithi022 podman[68993]: 2024-09-19 09:09:40.01629827 +0000 UTC m=+0.357219874 container init 5e4aebabbcff0026a6542b75a95121948f87a5dea7949fe30bd38507c1e8ff89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:09:40.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:40 smithi022 podman[68993]: 2024-09-19 09:09:40.019580167 +0000 UTC m=+0.360501769 container start 5e4aebabbcff0026a6542b75a95121948f87a5dea7949fe30bd38507c1e8ff89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T09:09:40.459 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:40 smithi022 podman[68993]: 2024-09-19 09:09:40.0994941 +0000 UTC m=+0.440415702 container attach 5e4aebabbcff0026a6542b75a95121948f87a5dea7949fe30bd38507c1e8ff89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:09:40.460 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:09:40 smithi022 podman[68993]: 2024-09-19 09:09:40.212606691 +0000 UTC m=+0.553528295 container died 5e4aebabbcff0026a6542b75a95121948f87a5dea7949fe30bd38507c1e8ff89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:09:40.794 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:40 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:40.770+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:40.794 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:40 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:40.689+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:40.795 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:40 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:40.689+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:40.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:09:40.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:09:40.862 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:09:40.862 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:09:40.862 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:09:41.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:40.625+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:41.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:40.625+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:41.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:40.763+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:41.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:40 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:40.763+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:41.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:40 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:40.917+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:41.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:40 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:40.788+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:41.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:40 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:40.788+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:41.107 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:40 smithi064 systemd[1]: Stopping Ceph osd.5 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:41.107 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:40 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:40.973+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:41.107 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:40 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:40.973+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:41.606 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:41.160+0000 7f693a24d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:09:41.606 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:41.160+0000 7f693a24d640 -1 osd.5 83 *** Got signal Terminated *** 2024-09-19T09:09:41.606 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:41.160+0000 7f693a24d640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:09:41.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:41 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:41.784+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:41.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:41 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:41.644+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:41.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:41 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:41.644+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:42.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:41.628+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:42.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:41.628+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:42.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:41.788+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:42.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:41 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:41.788+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:42.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:41.963+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:42.106 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:41.928+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:42.107 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:41.928+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:42.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:41.786+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:42.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:41 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:41.786+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:42.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:42 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:42.752+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:42.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:42 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:42.690+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:42.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:42 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:42.690+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:43.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:42 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:42.634+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:43.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:42 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:42.634+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:43.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:42 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:42.829+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:43.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:42 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:42.829+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:43.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:42 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:42.956+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:43.106 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:42 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:42.904+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:43.106 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:42 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:42.904+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:43.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:42 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:42.764+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:43.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:42 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:42.764+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:43.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:43 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:43.726+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:43.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:43 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:43.671+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:43.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:43 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:43.671+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:44.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:43 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:43.838+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:44.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:43 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:43.838+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:44.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:43 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:43.641+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:44.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:43 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:43.641+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:44.106 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:43.909+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:44.106 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:43.909+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:44.107 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:43.967+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:44.107 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:43.967+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:44.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:43.733+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:44.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:43 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:43.733+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:44.956 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:44 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:44.705+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:44.957 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:44 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:44.705+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:44.957 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:44 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:44.885+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:44.957 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:44 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:44.885+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:44.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:44 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:44.704+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:44.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:44 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:44.683+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:44.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:44 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:44.683+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:44.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:44 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:44.683+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:45.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:44.679+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:45.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:44.679+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:45.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:44.679+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:45.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:44.819+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:45.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:44.819+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:45.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:44.819+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:45.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:44 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:44.956+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:45.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:44 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:44.956+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:45.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:45.709+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:45.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:45.709+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:45.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:45.644+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:45.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:45.644+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:45.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:45 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:45.644+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:46.006 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:45.930+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:02.728117+0000 front 2024-09-19T09:09:02.728058+0000 (oldest deadline 2024-09-19T09:09:26.827888+0000) 2024-09-19T09:09:46.006 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5[46802]: 2024-09-19T09:09:45.930+0000 7f693284a640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.529062+0000 front 2024-09-19T09:09:11.529186+0000 (oldest deadline 2024-09-19T09:09:36.229007+0000) 2024-09-19T09:09:46.006 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:45.723+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:46.007 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:45 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:45.723+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:46.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:45 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:45.706+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:46.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:45 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:45.706+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:46.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:45 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:45.706+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:46.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:45 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:45.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:46.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:45 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:45.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:46.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:45 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:45.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:46.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:46 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:46.005+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:46.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:46 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:46.005+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:46.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:46 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:46.735+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:46.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:46 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:46.735+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:46.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:46 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:46.673+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:46.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:46 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:46.673+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:46.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:46 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:46.673+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:46.969 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:46 smithi064 podman[69562]: 2024-09-19 09:09:46.67620974 +0000 UTC m=+5.618650606 container died 96574175536ba7b7b22681e32c33da2af095b4d453a92fb93dab15b18199009f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:09:46.970 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:46 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:46.715+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:46.970 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:46 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:46.715+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:47.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:46 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:46.675+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:47.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:46 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:46.675+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:47.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:46 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:46.676+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:47.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:46 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:46.867+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:47.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:46 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:46.867+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:47.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:46 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:46.867+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:47.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:46 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:46.984+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:47.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:46 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:46.984+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:47.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:47 smithi064 podman[69562]: 2024-09-19 09:09:47.060630926 +0000 UTC m=+6.003071796 container cleanup 96574175536ba7b7b22681e32c33da2af095b4d453a92fb93dab15b18199009f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:09:47.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:47 smithi064 bash[69562]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:09:47.356 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:47 smithi064 podman[69578]: 2024-09-19 09:09:47.203383231 +0000 UTC m=+0.527214364 container remove 96574175536ba7b7b22681e32c33da2af095b4d453a92fb93dab15b18199009f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:09:47.856 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:47 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:47.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:47.857 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:47 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:47.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:47.857 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:47 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:47.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:47.857 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:47 smithi064 podman[69666]: 2024-09-19 09:09:47.59579776 +0000 UTC m=+0.104768679 container create 737c1bea37a09f02170c053582ae9c39b11a5b5f35660bcb5226cdcc21bdf4d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:09:47.857 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:47 smithi064 podman[69666]: 2024-09-19 09:09:47.50673518 +0000 UTC m=+0.015706112 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:09:47.857 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:47 smithi064 podman[69666]: 2024-09-19 09:09:47.832015832 +0000 UTC m=+0.340986764 container init 737c1bea37a09f02170c053582ae9c39b11a5b5f35660bcb5226cdcc21bdf4d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T09:09:47.857 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:47 smithi064 podman[69666]: 2024-09-19 09:09:47.835463673 +0000 UTC m=+0.344434596 container start 737c1bea37a09f02170c053582ae9c39b11a5b5f35660bcb5226cdcc21bdf4d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T09:09:47.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:47 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:47.702+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:47.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:47 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:47.702+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:47.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:47 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:47.641+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:47.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:47 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:47.641+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:47.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:47 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:47.641+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:48.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:47 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:47.706+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:48.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:47 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:47.706+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:48.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:47 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:47.706+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:48.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:47 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:47.842+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:48.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:47 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:47.842+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:48.050 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:47 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:47.842+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:48.317 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:47 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:47.952+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:48.317 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:47 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:47.952+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:48.318 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:47 smithi064 podman[69666]: 2024-09-19 09:09:47.915132031 +0000 UTC m=+0.424102951 container attach 737c1bea37a09f02170c053582ae9c39b11a5b5f35660bcb5226cdcc21bdf4d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T09:09:48.318 INFO:journalctl@ceph.osd.5.smithi064.stdout:Sep 19 09:09:48 smithi064 podman[69666]: 2024-09-19 09:09:48.029671819 +0000 UTC m=+0.538642738 container died 737c1bea37a09f02170c053582ae9c39b11a5b5f35660bcb5226cdcc21bdf4d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:09:48.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:09:48.635 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:09:48.636 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:09:48.636 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T09:09:48.636 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.6 2024-09-19T09:09:48.856 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:48 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:48.722+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:48.856 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:48 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:48.722+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:48.856 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:48 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:48.722+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:48.946 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:48.795+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:48.946 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:48.795+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:48.946 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:48.795+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:48.946 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:48 smithi001 systemd[1]: Stopping Ceph osd.6 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:48.947 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:48.733+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:48.947 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:48.733+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:48.947 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:48.733+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:48.947 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:48.945+0000 7f1f762a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:09:48.947 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:48.945+0000 7f1f762a2640 -1 osd.6 83 *** Got signal Terminated *** 2024-09-19T09:09:48.947 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:48.945+0000 7f1f762a2640 -1 osd.6 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:09:48.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:48 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:48.656+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:48.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:48 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:48.656+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:48.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:48 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:48.680+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:48.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:48 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:48.680+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:48.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:48 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:48.680+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:49.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:48 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:48.938+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:49.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:48 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:48.938+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:49.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:49 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:49.662+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:49.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:49 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:49.662+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:49.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:49 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:49.722+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:49.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:49 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:49.722+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:49.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:49 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:49.722+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:49.977 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:49 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:49.724+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:49.977 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:49 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:49.724+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:49.977 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:49 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:49.724+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:50.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:49 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:49.772+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:50.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:49 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:49.772+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:50.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:49 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:49.772+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:50.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:49 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:49.764+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:50.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:49 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:49.764+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:50.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:49 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:49.764+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:50.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:49 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:49.976+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:50.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:49 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:49.976+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:50.715 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:50 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:50.713+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:50.715 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:50 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:50.713+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:50.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:50 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:50.695+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:50.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:50 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:50.695+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:50.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:50 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:50.719+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:50.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:50 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:50.719+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:50.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:50 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:50.719+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:50.976 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:50 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:50.713+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:51.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:50.771+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:51.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:50.771+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:51.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:50.771+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:51.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:50.758+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:51.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:50.758+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:51.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:50 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:50.758+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:51.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:50 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:50.976+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:51.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:50 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:50.976+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:51.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:51 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:51.713+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:51.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:51 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:51.713+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:51.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:51 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:51.713+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:09:51.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:51 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:51.704+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:51.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:51 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:51.704+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:51.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:51 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:51.704+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:51.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:51 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:51.704+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:09:52.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:51 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:51.785+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:52.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:51 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:51.785+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:52.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:51 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:51.785+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:52.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:51 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:51.795+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:52.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:51 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:51.795+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:52.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:51 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:51.795+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:52.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:51 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:51.739+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:52.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:51 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:51.739+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:52.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:51 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:51.739+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:52.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:51 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:51.958+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:52.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:51 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:51.958+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:53.008 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:52 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:52.933+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:53.008 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:52 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:52.933+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:53.008 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:52 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:52.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:53.008 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:52 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:52.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:53.008 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:52 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:52.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:53.009 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:52 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:52.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:09:53.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:52.797+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:53.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:52.797+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:53.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:52.797+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:53.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:52.797+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.152779+0000 front 2024-09-19T09:09:27.152798+0000 (oldest deadline 2024-09-19T09:09:51.852931+0000) 2024-09-19T09:09:53.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:52.798+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:53.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:52.798+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:53.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:52 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:52.798+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:53.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:52.760+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:53.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:52.760+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:53.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:52.760+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:09:53.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:52.745+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:53.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:52.745+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:53.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:52.745+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:53.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:52.745+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:09:54.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:53 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:53.904+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:54.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:53 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:53.904+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:54.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:53 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:53.748+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:54.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:53 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:53.748+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:54.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:53 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:53.748+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:54.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:53 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:53.748+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:09:54.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:53 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:53.769+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:54.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:53 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:53.769+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:54.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:53 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:53.769+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:09:54.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:53 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:53.775+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:54.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:53 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:53.775+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:54.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:53 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:53.775+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:54.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:53 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:53.775+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:09:54.299 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:53.838+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.449309+0000 front 2024-09-19T09:09:04.448914+0000 (oldest deadline 2024-09-19T09:09:30.849338+0000) 2024-09-19T09:09:54.299 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:53.838+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.950626+0000 front 2024-09-19T09:09:11.950708+0000 (oldest deadline 2024-09-19T09:09:34.850459+0000) 2024-09-19T09:09:54.299 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:53.838+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.751662+0000 front 2024-09-19T09:09:20.751867+0000 (oldest deadline 2024-09-19T09:09:43.651802+0000) 2024-09-19T09:09:54.299 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6[58578]: 2024-09-19T09:09:53.838+0000 7f1f6e89f640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.152779+0000 front 2024-09-19T09:09:27.152798+0000 (oldest deadline 2024-09-19T09:09:51.852931+0000) 2024-09-19T09:09:54.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:53.811+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:54.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:53.811+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:54.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:53.811+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:54.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:53 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:53.811+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:09:54.746 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:54 smithi001 podman[98997]: 2024-09-19 09:09:54.358911191 +0000 UTC m=+5.520274077 container died c7fddde2e61ae7fa197280793efd5adbea8a74cc373866ace6c8da4030f0cb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:09:55.048 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:54 smithi001 podman[98997]: 2024-09-19 09:09:54.946244043 +0000 UTC m=+6.107606928 container cleanup c7fddde2e61ae7fa197280793efd5adbea8a74cc373866ace6c8da4030f0cb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:09:55.049 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:54 smithi001 bash[98997]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6 2024-09-19T09:09:55.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:54 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:54.775+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:55.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:54 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:54.775+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:55.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:54 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:54.775+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:55.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:54 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:54.775+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:09:55.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:54 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:54.947+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:55.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:54 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:54.947+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:55.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:54 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:54.947+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:09:55.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:54 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:54.762+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:55.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:54 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:54.762+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:55.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:54 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:54.762+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:55.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:54 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:54.762+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:09:55.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:54.791+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:55.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:54.791+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:55.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:54.791+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:09:55.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:54.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:55.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:54.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:55.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:54.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:55.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:54 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:54.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:09:55.549 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:55 smithi001 podman[99014]: 2024-09-19 09:09:55.239536584 +0000 UTC m=+0.875884495 container remove c7fddde2e61ae7fa197280793efd5adbea8a74cc373866ace6c8da4030f0cb9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:09:55.851 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:55 smithi001 podman[99102]: 2024-09-19 09:09:55.485628683 +0000 UTC m=+0.016590137 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:09:55.851 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:55 smithi001 podman[99102]: 2024-09-19 09:09:55.590225918 +0000 UTC m=+0.121187361 container create faad7428f11753849a258a21d6a73f4abb78f3a7cf374e8a8ffc4edb1c8238ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:09:55.851 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:55 smithi001 podman[99102]: 2024-09-19 09:09:55.851007192 +0000 UTC m=+0.381968644 container init faad7428f11753849a258a21d6a73f4abb78f3a7cf374e8a8ffc4edb1c8238ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:09:55.851 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:55 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:55.818+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:55.851 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:55 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:55.818+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:55.851 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:55 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:55.818+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:55.851 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:55 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:55.818+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:09:56.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:55.937+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:56.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:55.938+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:56.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:55.938+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:09:56.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:55.775+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:56.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:55.775+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:56.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:55.775+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:56.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:55 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:55.775+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:09:56.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:55 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:55.748+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:56.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:55 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:55.748+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:56.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:55 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:55.748+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:09:56.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:55 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:55.770+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:56.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:55 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:55.770+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:56.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:55 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:55.770+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:56.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:55 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:55.770+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:09:56.299 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:55 smithi001 podman[99102]: 2024-09-19 09:09:55.854890778 +0000 UTC m=+0.385852222 container start faad7428f11753849a258a21d6a73f4abb78f3a7cf374e8a8ffc4edb1c8238ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:09:56.299 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:55 smithi001 podman[99102]: 2024-09-19 09:09:55.934265341 +0000 UTC m=+0.465226795 container attach faad7428f11753849a258a21d6a73f4abb78f3a7cf374e8a8ffc4edb1c8238ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:09:56.299 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:09:56 smithi001 podman[99102]: 2024-09-19 09:09:56.048965772 +0000 UTC m=+0.579927216 container died faad7428f11753849a258a21d6a73f4abb78f3a7cf374e8a8ffc4edb1c8238ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:09:56.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T09:09:56.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:09:56.685 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T09:09:56.685 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T09:09:56.686 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.7 2024-09-19T09:09:56.980 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:56 smithi022 systemd[1]: Stopping Ceph osd.7 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:09:56.980 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:56.796+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:56.980 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:56.796+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:56.980 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:56.796+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:09:56.980 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:56.979+0000 7f1d59163640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:09:56.980 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:56.979+0000 7f1d59163640 -1 osd.7 83 *** Got signal Terminated *** 2024-09-19T09:09:56.980 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:56.764+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:56.981 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:56.764+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:56.981 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:56.764+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:56.981 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:56.764+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:09:57.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:56 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:56.819+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:57.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:56 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:56.819+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:57.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:56 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:56.819+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:57.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:56 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:56.819+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:09:57.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:56.962+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:57.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:56.962+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:57.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:56.962+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:09:57.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:56.806+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:57.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:56.806+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:57.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:56.806+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:57.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:56 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:56.806+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:09:58.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:57 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:57.771+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:58.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:57 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:57.771+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:58.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:57 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:57.771+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:58.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:57 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:57.771+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:09:58.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:57 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:57.939+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:58.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:57 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:57.939+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:58.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:57 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:57.939+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:09:58.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:57 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:57.806+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:58.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:57 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:57.806+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:58.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:57 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:57.806+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:58.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:57 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:57.806+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:09:58.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:57.741+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:58.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:57.741+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:58.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:57.741+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:58.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:57.741+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:09:58.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:56 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:56.979+0000 7f1d59163640 -1 osd.7 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:09:58.210 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:57.789+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:58.210 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:57.789+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:58.210 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:57.789+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:09:58.802 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:58 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:58.711+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:58.802 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:58 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:58.711+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:58.802 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:58 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:58.711+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:58.802 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:58 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:58.711+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:09:59.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:58 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:58.758+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:09:59.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:58 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:58.758+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:09:59.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:58 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:58.758+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:09:59.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:58 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:58.758+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:09:59.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:58 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:58.903+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:09:59.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:58 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:58.903+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:09:59.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:58 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:58.903+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:09:59.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:58 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:58.822+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:09:59.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:58 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:58.822+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:09:59.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:58 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:58.822+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:09:59.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:58 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:58.822+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:09:59.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:58 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:58.801+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:09:59.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:58 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:58.801+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:09:59.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:58 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:58.801+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:09:59.819 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:59 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:59.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:09:59.819 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:59 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:59.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:09:59.819 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:59 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:59.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:09:59.819 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:09:59 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:09:59.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:00.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:59 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:59.719+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:00.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:59 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:59.719+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:00.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:59 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:59.719+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:00.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:09:59 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:09:59.719+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:00.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:59 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:59.856+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:00.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:59 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:59.856+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:00.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:09:59 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:09:59.856+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:00.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:59 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:59.854+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:00.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:59 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:59.854+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:00.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:59 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:59.854+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:00.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:09:59 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:09:59.854+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:00.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:59 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:59.818+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:10:00.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:59 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:59.818+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:10:00.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:09:59 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:09:59.818+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:10:01.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:00 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:00.765+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:01.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:00 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:00.765+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:01.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:00 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:00.765+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:01.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:00 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:00.765+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:01.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:00 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:00.765+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:01.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:00 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:00.866+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:01.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:00 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:00.866+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:01.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:00 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:00.866+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:01.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:00 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:00.866+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:01.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:00 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:00.820+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:01.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:00 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:00.820+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:01.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:00 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:00.820+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:01.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:00 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:00.820+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:01.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:00 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:10:00.801+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:10:01.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:00 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:10:00.801+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:10:01.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:00 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:10:00.801+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:10:01.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:00 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:00.727+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:01.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:00 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:00.727+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:01.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:00 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:00.727+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:01.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:00 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:00.727+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:01.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:10:01.834+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:10.460768+0000 front 2024-09-19T09:09:10.460742+0000 (oldest deadline 2024-09-19T09:09:40.461769+0000) 2024-09-19T09:10:01.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:10:01.834+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.462253+0000 front 2024-09-19T09:09:20.462236+0000 (oldest deadline 2024-09-19T09:09:45.162418+0000) 2024-09-19T09:10:01.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:10:01.834+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:25.163115+0000 front 2024-09-19T09:09:25.163129+0000 (oldest deadline 2024-09-19T09:09:51.063043+0000) 2024-09-19T09:10:01.959 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7[53047]: 2024-09-19T09:10:01.834+0000 7f1d51760640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:35.163894+0000 front 2024-09-19T09:09:35.163912+0000 (oldest deadline 2024-09-19T09:10:01.064030+0000) 2024-09-19T09:10:01.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:01.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:01.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:01.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:01.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:01.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:01.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:01 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:01.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:02.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:01 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:01.745+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:02.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:01 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:01.745+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:02.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:01 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:01.745+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:02.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:01 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:01.745+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:02.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:01 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:01.745+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:02.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:01 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:01.881+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:02.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:01 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:01.881+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:02.107 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:01 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:01.881+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:02.107 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:01 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:01.881+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:02.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:01 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:01.785+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:02.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:01 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:01.785+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:02.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:01 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:01.785+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:02.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:01 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:01.785+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:02.709 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:02 smithi022 podman[69097]: 2024-09-19 09:10:02.443202818 +0000 UTC m=+5.558641592 container died 46a4a53d0d49aee611ed640adef1b7fda414abeb1d179b65cc612830e2596082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:02.965 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:02 smithi022 podman[69097]: 2024-09-19 09:10:02.963166486 +0000 UTC m=+6.078605249 container cleanup 46a4a53d0d49aee611ed640adef1b7fda414abeb1d179b65cc612830e2596082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:10:02.965 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:02 smithi022 bash[69097]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7 2024-09-19T09:10:02.966 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:02 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:02.713+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:02.966 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:02 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:02.713+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:02.966 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:02 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:02.713+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:02.966 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:02 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:02.713+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:03.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:02 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:02.707+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:03.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:02 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:02.707+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:03.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:02 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:02.707+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:03.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:02 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:02.707+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:03.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:02 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:02.707+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:03.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:02 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:02.850+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:03.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:02 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:02.850+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:03.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:02 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:02.850+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:03.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:02 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:02.850+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:03.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:02 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:02.813+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:03.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:02 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:02.813+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:03.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:02 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:02.813+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:03.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:02 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:02.813+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:03.459 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:03 smithi022 podman[69127]: 2024-09-19 09:10:03.197644333 +0000 UTC m=+0.746212511 container remove 46a4a53d0d49aee611ed640adef1b7fda414abeb1d179b65cc612830e2596082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:03.925 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:03 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:03.683+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:03.925 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:03 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:03.683+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:03.925 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:03 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:03.683+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:03.925 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:03 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:03.683+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:03.926 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:03 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:03.683+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:03.926 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:03 smithi022 podman[69217]: 2024-09-19 09:10:03.525241682 +0000 UTC m=+0.016316258 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:10:03.926 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:03 smithi022 podman[69217]: 2024-09-19 09:10:03.640101047 +0000 UTC m=+0.131175659 container create 58aa5cd1910142fd6a36d295812f4a8e1551d3b472e544de35fb5adc3ff3f3c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:03.926 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:03 smithi022 podman[69217]: 2024-09-19 09:10:03.850631633 +0000 UTC m=+0.341706200 container init 58aa5cd1910142fd6a36d295812f4a8e1551d3b472e544de35fb5adc3ff3f3c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:03.926 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:03 smithi022 podman[69217]: 2024-09-19 09:10:03.853763534 +0000 UTC m=+0.344838100 container start 58aa5cd1910142fd6a36d295812f4a8e1551d3b472e544de35fb5adc3ff3f3c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:10:03.926 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:03 smithi022 podman[69217]: 2024-09-19 09:10:03.925537945 +0000 UTC m=+0.416612514 container attach 58aa5cd1910142fd6a36d295812f4a8e1551d3b472e544de35fb5adc3ff3f3c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:10:04.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:03 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:03.687+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:04.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:03 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:03.687+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:04.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:03 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:03.687+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:04.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:03 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:03.687+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:04.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:03 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:03.687+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:04.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:03 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:03.858+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:04.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:03 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:03.858+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:04.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:03 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:03.858+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:04.107 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:03 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:03.858+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:04.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:03 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:03.855+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:04.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:03 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:03.855+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:04.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:03 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:03.855+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:04.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:03 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:03.855+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:04.209 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:10:04 smithi022 podman[69217]: 2024-09-19 09:10:04.046173957 +0000 UTC m=+0.537248524 container died 58aa5cd1910142fd6a36d295812f4a8e1551d3b472e544de35fb5adc3ff3f3c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:10:04.912 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:04 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:04.690+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:04.913 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:04 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:04.690+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:04.913 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:04 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:04.690+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:04.913 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:04 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:04.690+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:04.913 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:04 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:04.690+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:04.943 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T09:10:04.985 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:04.986 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T09:10:04.986 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T09:10:04.986 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.8 2024-09-19T09:10:05.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:04.710+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:05.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:04.710+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:05.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:04.710+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:05.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:04.710+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:05.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:04 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:04.710+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:05.296 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:04.881+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:05.296 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:04.881+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:05.296 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:04.881+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:05.296 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:04.881+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:05.296 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:04.881+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:05.297 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:04.898+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:05.297 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:04.898+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:05.297 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:04.898+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:05.297 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:04 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:04.898+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:05.297 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:05 smithi064 systemd[1]: Stopping Ceph osd.8 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:05.297 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:05.295+0000 7fb0a50d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:05.297 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:05.295+0000 7fb0a50d3640 -1 osd.8 83 *** Got signal Terminated *** 2024-09-19T09:10:05.297 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:05.295+0000 7fb0a50d3640 -1 osd.8 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:10:05.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:05 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:05.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:05.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:05 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:05.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:05.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:05 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:05.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:05.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:05 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:05.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:05.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:05 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:05.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:06.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:05.697+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:06.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:05.697+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:06.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:05.697+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:06.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:05.697+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:06.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:05 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:05.697+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:06.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:05.937+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:06.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:05.937+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:06.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:05.937+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:06.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:05.937+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:06.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:05.927+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:06.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:05.927+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:06.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:05.927+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:06.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:05.927+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:06.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:05 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:05.927+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:06.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:06 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:06.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:06.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:06 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:06.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:06.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:06 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:06.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:06.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:06 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:06.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:06.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:06 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:06.693+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:07.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:06 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:06.689+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:07.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:06 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:06.689+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:07.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:06 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:06.689+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:07.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:06 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:06.689+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:07.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:06 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:06.689+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:07.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:06.904+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:07.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:06.904+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:07.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:06.904+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:07.357 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:06.904+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:07.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:06.912+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:07.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:06.912+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:07.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:06.912+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:07.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:06.912+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:07.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:06 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:06.912+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:07.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:07 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:07.707+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:07.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:07 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:07.707+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:07.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:07 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:07.707+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:07.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:07 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:07.707+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:07.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:07 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:07.707+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:08.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:07.712+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:08.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:07.712+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:08.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:07.712+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:08.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:07.712+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:08.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:07.712+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:08.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:07 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:07.712+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:08.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:07.900+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:08.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:07.900+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:08.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:07.900+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:08.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:07.900+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:08.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:07.913+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:08.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:07.913+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:08.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:07.913+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:08.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:07.913+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:08.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:07 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:07.913+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:08.969 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:08 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:08.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:08.969 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:08 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:08.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:08.969 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:08 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:08.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:08.969 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:08 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:08.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:08.969 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:08 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:08.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:08.969 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:08 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:08.710+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:09.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:08.715+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:09.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:08.715+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:09.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:08.715+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:09.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:08.715+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:09.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:08.715+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:09.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:08 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:08.715+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:09.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:08.931+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:09.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:08.931+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:09.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:08.931+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:09.357 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:08.931+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:09.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:08.934+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:09.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:08.934+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:09.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:08.934+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:09.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:08.934+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:09.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:08.934+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:09.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:08 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:08.934+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:09.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:09.681+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:09.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:09.681+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:09.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:09.681+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:09.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:09.681+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:09.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:09.681+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:09.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:09 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:09.681+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:10.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:09 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:09.757+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:10.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:09 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:09.757+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:10.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:09 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:09.757+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:10.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:09 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:09.757+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:10.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:09 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:09.757+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:10.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:09 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:09.757+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:10.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:09.926+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.435892+0000 front 2024-09-19T09:09:13.436007+0000 (oldest deadline 2024-09-19T09:09:38.735905+0000) 2024-09-19T09:10:10.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:09.926+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:18.736229+0000 front 2024-09-19T09:09:18.736326+0000 (oldest deadline 2024-09-19T09:09:43.436357+0000) 2024-09-19T09:10:10.356 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:09.926+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.637719+0000 front 2024-09-19T09:09:28.637867+0000 (oldest deadline 2024-09-19T09:09:54.537620+0000) 2024-09-19T09:10:10.357 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8[53756]: 2024-09-19T09:10:09.926+0000 7fb0a16d8640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:34.538302+0000 front 2024-09-19T09:09:34.538343+0000 (oldest deadline 2024-09-19T09:10:00.338917+0000) 2024-09-19T09:10:10.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:09.892+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:10.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:09.892+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:10.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:09.892+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:10.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:09.892+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:10.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:09.892+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:10.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:09.892+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:10.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:10.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:10.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:10.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:10.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:10.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:10.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:10.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:10.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:10.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:10.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:10 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:10.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:11.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:10 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:10.789+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:11.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:10 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:10.789+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:11.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:10 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:10.789+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:11.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:10 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:10.789+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:11.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:10 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:10.789+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:11.049 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:10 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:10.789+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:11.106 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:10 smithi064 podman[69781]: 2024-09-19 09:10:10.830945534 +0000 UTC m=+5.640865179 container died 0d240d6a09a1c93658729d5d1df96210d708da80784645e54358f7cfffcc82d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T09:10:11.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:10.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:11.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:10.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:11.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:10.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:11.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:10.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:11.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:10.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:11.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:10 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:10.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:11.529 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:11 smithi064 podman[69781]: 2024-09-19 09:10:11.178677797 +0000 UTC m=+5.988597429 container cleanup 0d240d6a09a1c93658729d5d1df96210d708da80784645e54358f7cfffcc82d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:10:11.530 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:11 smithi064 bash[69781]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8 2024-09-19T09:10:11.856 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:11 smithi064 podman[69797]: 2024-09-19 09:10:11.529969452 +0000 UTC m=+0.694630371 container remove 0d240d6a09a1c93658729d5d1df96210d708da80784645e54358f7cfffcc82d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:10:11.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:11.689+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:11.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:11.689+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:11.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:11.689+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:11.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:11.689+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:11.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:11.689+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:11.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:11 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:11.689+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:12.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:11 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:11.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:12.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:11 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:11.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:12.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:11 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:11.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:12.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:11 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:11.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:12.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:11 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:11.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:12.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:11 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:11.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:12.350 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:11 smithi064 podman[69886]: 2024-09-19 09:10:11.848151385 +0000 UTC m=+0.015601056 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:10:12.350 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:12 smithi064 podman[69886]: 2024-09-19 09:10:12.005951349 +0000 UTC m=+0.173401012 container create 37a6ccea2690c212fd40738bf031bf56b30f2c7775701a82ef61ef2f8376fabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:10:12.350 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:12 smithi064 podman[69886]: 2024-09-19 09:10:12.349979919 +0000 UTC m=+0.517429581 container init 37a6ccea2690c212fd40738bf031bf56b30f2c7775701a82ef61ef2f8376fabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:10:12.350 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:11.904+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:12.350 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:11.904+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:12.350 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:11.904+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:12.350 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:11.904+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:12.350 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:11.904+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:12.351 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:11 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:11.904+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:12.606 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:12 smithi064 podman[69886]: 2024-09-19 09:10:12.353678243 +0000 UTC m=+0.521127907 container start 37a6ccea2690c212fd40738bf031bf56b30f2c7775701a82ef61ef2f8376fabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:10:12.606 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:12 smithi064 podman[69886]: 2024-09-19 09:10:12.433241285 +0000 UTC m=+0.600690968 container attach 37a6ccea2690c212fd40738bf031bf56b30f2c7775701a82ef61ef2f8376fabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T09:10:12.606 INFO:journalctl@ceph.osd.8.smithi064.stdout:Sep 19 09:10:12 smithi064 podman[69886]: 2024-09-19 09:10:12.543093893 +0000 UTC m=+0.710543557 container died 37a6ccea2690c212fd40738bf031bf56b30f2c7775701a82ef61ef2f8376fabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:10:12.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:12 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:12.670+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:12.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:12 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:12.670+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:12.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:12 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:12.670+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:12.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:12 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:12.670+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:12.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:12 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:12.670+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:12.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:12 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:12.670+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:13.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:12 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:12.919+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:13.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:12 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:12.919+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:13.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:12 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:12.919+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:13.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:12 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:12.919+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:13.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:12 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:12.919+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:13.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:12 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:12.919+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:13.151 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T09:10:13.189 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:13.189 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T09:10:13.190 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T09:10:13.190 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.9 2024-09-19T09:10:13.218 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:12.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:13.218 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:12.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:13.218 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:12.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:13.219 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:12.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:13.219 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:12.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:13.219 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:12 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:12.826+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:13.491 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 systemd[1]: Stopping Ceph osd.9 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:13.798 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.490+0000 7f0a84337640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:13.799 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.490+0000 7f0a84337640 -1 osd.9 83 *** Got signal Terminated *** 2024-09-19T09:10:13.799 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.490+0000 7f0a84337640 -1 osd.9 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:10:13.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:13.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:13.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:13.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:13.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:13.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:13.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:13.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:13.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:13.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:13.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:13 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:13.657+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:14.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:13 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:13.909+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:14.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:13 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:13.909+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:14.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:13 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:13.909+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:14.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:13 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:13.909+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:14.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:13 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:13.909+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:14.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:13 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:13.909+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:14.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.817+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:14.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.817+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:14.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.817+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:14.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.817+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:14.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.817+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:14.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:13 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:13.817+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:14.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:14.695+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:14.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:14.695+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:14.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:14.695+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:14.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:14.695+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:14.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:14.695+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:14.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:14 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:14.695+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:15.298 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:14 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:14.857+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:15.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:14 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:14.857+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:15.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:14 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:14.857+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:15.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:14 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:14.857+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:15.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:14 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:14.857+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:15.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:14 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:14.857+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:15.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:14 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:14.901+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:15.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:14 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:14.901+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:15.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:14 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:14.901+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:15.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:14 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:14.901+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:15.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:14 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:14.901+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:15.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:14 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:14.901+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:15.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:15 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:15.696+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:15.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:15 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:15.696+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:15.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:15 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:15.696+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:15.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:15 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:15.696+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:15.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:15 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:15.696+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:15.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:15 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:15.696+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:16.298 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:15.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:16.298 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:15.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:16.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:15.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:16.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:15.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:16.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:15.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:16.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:15 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:15.859+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:16.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:15 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:15.861+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:16.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:15 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:15.861+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:16.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:15 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:15.861+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:16.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:15 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:15.861+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:16.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:15 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:15.861+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:16.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:15 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:15.861+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:17.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:16 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:16.725+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:17.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:16 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:16.725+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:17.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:16 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:16.725+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:17.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:16 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:16.725+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:17.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:16 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:16.725+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:17.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:16 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:16.725+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:17.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:16 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:16.725+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:17.298 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:16 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:16.850+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:17.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:16 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:16.850+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:17.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:16 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:16.850+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:17.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:16 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:16.850+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:17.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:16 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:16.850+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:17.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:16 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:16.850+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:17.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:16 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:16.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:17.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:16 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:16.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:17.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:16 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:16.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:17.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:16 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:16.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:17.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:16 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:16.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:17.357 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:16 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:16.869+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:18.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:17.844+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:18.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:17.844+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:18.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:17.844+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:18.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:17.844+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:18.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:17.844+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:18.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:17 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:17.844+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:18.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:17.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:18.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:17.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:18.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:17.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:18.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:17.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:18.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:17.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:18.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:17.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:18.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:17 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:17.733+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:18.298 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:17 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:17.831+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:04.938897+0000 front 2024-09-19T09:09:04.938947+0000 (oldest deadline 2024-09-19T09:09:27.239010+0000) 2024-09-19T09:10:18.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:17 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:17.831+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:11.940118+0000 front 2024-09-19T09:09:11.940000+0000 (oldest deadline 2024-09-19T09:09:37.239895+0000) 2024-09-19T09:10:18.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:17 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:17.831+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:21.241292+0000 front 2024-09-19T09:09:21.241119+0000 (oldest deadline 2024-09-19T09:09:44.741298+0000) 2024-09-19T09:10:18.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:17 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:17.831+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.242562+0000 front 2024-09-19T09:09:28.242491+0000 (oldest deadline 2024-09-19T09:09:52.942697+0000) 2024-09-19T09:10:18.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:17 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:17.831+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.043850+0000 front 2024-09-19T09:09:37.043828+0000 (oldest deadline 2024-09-19T09:10:00.444409+0000) 2024-09-19T09:10:18.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:17 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9[65566]: 2024-09-19T09:10:17.831+0000 7f0a7c934640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:42.745610+0000 front 2024-09-19T09:09:42.745584+0000 (oldest deadline 2024-09-19T09:10:07.445454+0000) 2024-09-19T09:10:18.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:18 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:18.691+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:18.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:18 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:18.691+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:18.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:18 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:18.691+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:18.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:18 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:18.691+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:18.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:18 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:18.691+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:18.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:18 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:18.691+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:18.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:18 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:18.691+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:19.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:18 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:18.824+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:19.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:18 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:18.824+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:19.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:18 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:18.824+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:19.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:18 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:18.824+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:19.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:18 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:18.824+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:19.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:18 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:18.824+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:19.299 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:18 smithi001 podman[99220]: 2024-09-19 09:10:18.996613355 +0000 UTC m=+5.609254696 container died b28d4f365577deaa1e4bb38950b451a961d36ec3d414b481463fde619203473c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:10:19.733 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:19 smithi001 podman[99220]: 2024-09-19 09:10:19.481734057 +0000 UTC m=+6.094375397 container cleanup b28d4f365577deaa1e4bb38950b451a961d36ec3d414b481463fde619203473c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:10:19.733 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:19 smithi001 bash[99220]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9 2024-09-19T09:10:19.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:19 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:19.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:19.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:19 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:19.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:19.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:19 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:19.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:19.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:19 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:19.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:19.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:19 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:19.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:19.959 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:19 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:19.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:19.960 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:19 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:19.662+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:20.048 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:19 smithi001 podman[99234]: 2024-09-19 09:10:19.732978917 +0000 UTC m=+0.735266329 container remove b28d4f365577deaa1e4bb38950b451a961d36ec3d414b481463fde619203473c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:10:20.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:19 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:19.827+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:20.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:19 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:19.827+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:20.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:19 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:19.827+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:20.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:19 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:19.827+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:20.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:19 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:19.827+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:20.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:19 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:19.827+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:20.377 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:20 smithi001 podman[99326]: 2024-09-19 09:10:19.958912027 +0000 UTC m=+0.016440761 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:10:20.378 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:20 smithi001 podman[99326]: 2024-09-19 09:10:20.058769205 +0000 UTC m=+0.116297930 container create aecb22d54290d7f80ef13eacb36c9663ef88f05197474cec8af94c3ec8bcafae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:10:20.378 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:20 smithi001 podman[99326]: 2024-09-19 09:10:20.29476816 +0000 UTC m=+0.352296886 container init aecb22d54290d7f80ef13eacb36c9663ef88f05197474cec8af94c3ec8bcafae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:10:20.378 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:20 smithi001 podman[99326]: 2024-09-19 09:10:20.298272533 +0000 UTC m=+0.355801257 container start aecb22d54290d7f80ef13eacb36c9663ef88f05197474cec8af94c3ec8bcafae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:20.378 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:20 smithi001 podman[99326]: 2024-09-19 09:10:20.377774487 +0000 UTC m=+0.435303220 container attach aecb22d54290d7f80ef13eacb36c9663ef88f05197474cec8af94c3ec8bcafae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:10:20.781 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:10:20 smithi001 podman[99326]: 2024-09-19 09:10:20.493117114 +0000 UTC m=+0.550645840 container died aecb22d54290d7f80ef13eacb36c9663ef88f05197474cec8af94c3ec8bcafae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T09:10:21.073 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T09:10:21.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:20 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:20.787+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:21.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:20 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:20.787+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:21.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:20 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:20.787+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:21.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:20 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:20.787+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:21.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:20 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:20.787+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:21.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:20 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:20.787+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:21.156 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:21.156 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T09:10:21.157 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T09:10:21.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.10 2024-09-19T09:10:21.183 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:20 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:20.709+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:21.184 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:20 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:20.709+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:21.184 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:20 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:20.709+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:21.184 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:20 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:20.709+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:21.184 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:20 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:20.709+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:21.184 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:20 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:20.709+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:21.184 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:20 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:20.709+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:21.456 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 systemd[1]: Stopping Ceph osd.10 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:21.709 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.455+0000 7fa9efa13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:21.709 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.455+0000 7fa9efa13640 -1 osd.10 83 *** Got signal Terminated *** 2024-09-19T09:10:21.709 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.455+0000 7fa9efa13640 -1 osd.10 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:10:21.710 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.694+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:21.710 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.694+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:21.710 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.694+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:21.710 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.694+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:21.710 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.694+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:21.710 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.694+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:21.710 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:21 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:21.694+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:22.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:21 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:21.792+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:22.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:21 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:21.792+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:22.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:21 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:21.792+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:22.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:21 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:21.792+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:22.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:21 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:21.792+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:22.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:21 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:21.792+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:23.007 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:22 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:22.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:23.008 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:22 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:22.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:23.008 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:22 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:22.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:23.008 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:22 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:22.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:23.008 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:22 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:22.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:23.008 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:22 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:22.747+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:23.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:22 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:22.714+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:23.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:22 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:22.714+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:23.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:22 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:22.714+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:23.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:22 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:22.714+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:23.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:22 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:22.714+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:23.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:22 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:22.714+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:23.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:22 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:22.714+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:24.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:23 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:23.700+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:24.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:23 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:23.700+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:24.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:23 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:23.700+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:24.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:23 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:23.700+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:24.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:23 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:23.700+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:24.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:23 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:23.700+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:24.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:23 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:23.700+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:24.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:23 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:23.762+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:24.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:23 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:23.762+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:24.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:23 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:23.762+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:24.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:23 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:23.762+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:24.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:23 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:23.762+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:24.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:23 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:23.762+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:24.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:23 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:23.762+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:25.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:24 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:24.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:25.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:24 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:24.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:25.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:24 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:24.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:25.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:24 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:24.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:25.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:24 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:24.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:25.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:24 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:24.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:25.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:24 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:24.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:25.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:24 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:24.799+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:25.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:24 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:24.799+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:25.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:24 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:24.799+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:25.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:24 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:24.799+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:25.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:24 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:24.799+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:25.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:24 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:24.799+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:25.210 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:24 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:24.799+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:26.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:25 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:25.701+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:26.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:25 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:25.701+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:26.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:25 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:25.701+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:26.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:25 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:25.701+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:26.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:25 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:25.701+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:26.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:25 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:25.701+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:26.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:25 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:25.701+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:26.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:25 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:25.841+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:03.073048+0000 front 2024-09-19T09:09:03.073134+0000 (oldest deadline 2024-09-19T09:09:28.372965+0000) 2024-09-19T09:10:26.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:25 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:25.841+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:13.375916+0000 front 2024-09-19T09:09:13.375854+0000 (oldest deadline 2024-09-19T09:09:38.075944+0000) 2024-09-19T09:10:26.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:25 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:25.841+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.977094+0000 front 2024-09-19T09:09:20.977336+0000 (oldest deadline 2024-09-19T09:09:44.477103+0000) 2024-09-19T09:10:26.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:25 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:25.841+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:27.978253+0000 front 2024-09-19T09:09:27.978137+0000 (oldest deadline 2024-09-19T09:09:51.477862+0000) 2024-09-19T09:10:26.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:25 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:25.841+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:36.778734+0000 front 2024-09-19T09:09:36.778717+0000 (oldest deadline 2024-09-19T09:10:03.179560+0000) 2024-09-19T09:10:26.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:25 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:25.841+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:46.080688+0000 front 2024-09-19T09:09:46.080754+0000 (oldest deadline 2024-09-19T09:10:08.380585+0000) 2024-09-19T09:10:26.209 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:25 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10[60063]: 2024-09-19T09:10:25.841+0000 7fa9ec018640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T09:09:53.681722+0000 front 2024-09-19T09:09:53.681616+0000 (oldest deadline 2024-09-19T09:10:15.981456+0000) 2024-09-19T09:10:27.098 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:26 smithi022 podman[69320]: 2024-09-19 09:10:26.845929492 +0000 UTC m=+5.487311226 container died 4cc56287e6d8ecee2b87554faa148cdf60762428cc6662efd3eb3c3350fb7bbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:10:27.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:26 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:26.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:27.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:26 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:26.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:27.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:26 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:26.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:27.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:26 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:26.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:27.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:26 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:26.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:27.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:26 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:26.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:27.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:26 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:26.737+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:27.456 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:27 smithi022 podman[69320]: 2024-09-19 09:10:27.196935242 +0000 UTC m=+5.838316974 container cleanup 4cc56287e6d8ecee2b87554faa148cdf60762428cc6662efd3eb3c3350fb7bbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:10:27.456 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:27 smithi022 bash[69320]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10 2024-09-19T09:10:27.709 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:27 smithi022 podman[69335]: 2024-09-19 09:10:27.456323156 +0000 UTC m=+0.605153138 container remove 4cc56287e6d8ecee2b87554faa148cdf60762428cc6662efd3eb3c3350fb7bbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T09:10:28.042 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:27 smithi022 podman[69425]: 2024-09-19 09:10:27.678959962 +0000 UTC m=+0.015880167 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:10:28.042 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:27 smithi022 podman[69425]: 2024-09-19 09:10:27.807184272 +0000 UTC m=+0.144104459 container create 7f9d61a714e8ad6e9ccc7f5f8208359221e986968e8f34fd2097b865bc3c168e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:10:28.043 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:28 smithi022 podman[69425]: 2024-09-19 09:10:28.042931405 +0000 UTC m=+0.379851607 container init 7f9d61a714e8ad6e9ccc7f5f8208359221e986968e8f34fd2097b865bc3c168e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:10:28.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:27 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:27.727+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:28.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:27 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:27.727+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:28.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:27 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:27.727+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:28.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:27 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:27.727+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:28.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:27 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:27.727+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:28.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:27 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:27.727+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:28.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:27 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:27.727+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:28.459 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:28 smithi022 podman[69425]: 2024-09-19 09:10:28.046754177 +0000 UTC m=+0.383674372 container start 7f9d61a714e8ad6e9ccc7f5f8208359221e986968e8f34fd2097b865bc3c168e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:10:28.459 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:28 smithi022 podman[69425]: 2024-09-19 09:10:28.134554384 +0000 UTC m=+0.471474585 container attach 7f9d61a714e8ad6e9ccc7f5f8208359221e986968e8f34fd2097b865bc3c168e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:10:28.459 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:10:28 smithi022 podman[69425]: 2024-09-19 09:10:28.23693539 +0000 UTC m=+0.573855593 container died 7f9d61a714e8ad6e9ccc7f5f8208359221e986968e8f34fd2097b865bc3c168e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:10:28.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T09:10:28.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:28.953 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T09:10:28.954 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T09:10:28.954 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.11 2024-09-19T09:10:28.999 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:28.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:28.999 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:28.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:28.999 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:28.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:28.999 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:28.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:28.999 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:28.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:28.999 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:28.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:29.000 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:28 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:28.746+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:29.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:28 smithi064 systemd[1]: Stopping Ceph osd.11 for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:29.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.238+0000 7fceb03f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:29.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.238+0000 7fceb03f7640 -1 osd.11 83 *** Got signal Terminated *** 2024-09-19T09:10:29.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.238+0000 7fceb03f7640 -1 osd.11 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:10:30.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:30.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:30.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:30.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:30.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:30.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:30.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:29 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:29.767+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:31.109 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:30.736+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:31.109 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:30.736+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:31.109 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:30.736+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:31.109 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:30.736+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:31.109 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:30.736+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:31.109 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:30.736+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:31.109 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:30 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:30.736+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:32.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:31.691+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:32.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:31.691+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:32.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:31.691+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:32.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:31.691+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:32.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:31.691+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:32.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:31.691+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:32.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:31.691+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:32.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:31 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:31.691+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6820 osd.8 since back 2024-09-19T09:10:09.295356+0000 front 2024-09-19T09:10:09.295375+0000 (oldest deadline 2024-09-19T09:10:31.595411+0000) 2024-09-19T09:10:33.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:32.730+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:33.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:32.730+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:33.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:32.730+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:33.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:32.730+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:33.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:32.730+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:33.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:32.730+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:33.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:32.730+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:33.107 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:32 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:32.730+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6820 osd.8 since back 2024-09-19T09:10:09.295356+0000 front 2024-09-19T09:10:09.295375+0000 (oldest deadline 2024-09-19T09:10:31.595411+0000) 2024-09-19T09:10:34.106 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:33.702+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:09:05.985288+0000 front 2024-09-19T09:09:05.985148+0000 (oldest deadline 2024-09-19T09:09:28.284981+0000) 2024-09-19T09:10:34.155 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:33.702+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:09:12.187160+0000 front 2024-09-19T09:09:12.187283+0000 (oldest deadline 2024-09-19T09:09:36.887162+0000) 2024-09-19T09:10:34.155 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:33.702+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-09-19T09:09:20.888480+0000 front 2024-09-19T09:09:20.888515+0000 (oldest deadline 2024-09-19T09:09:46.788667+0000) 2024-09-19T09:10:34.156 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:33.702+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:09:28.990365+0000 front 2024-09-19T09:09:28.990272+0000 (oldest deadline 2024-09-19T09:09:51.890100+0000) 2024-09-19T09:10:34.156 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:33.702+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6812 osd.4 since back 2024-09-19T09:09:37.091723+0000 front 2024-09-19T09:09:37.091828+0000 (oldest deadline 2024-09-19T09:10:04.692194+0000) 2024-09-19T09:10:34.156 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:33.702+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6812 osd.5 since back 2024-09-19T09:09:44.692624+0000 front 2024-09-19T09:09:44.692708+0000 (oldest deadline 2024-09-19T09:10:08.192696+0000) 2024-09-19T09:10:34.156 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:33.702+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.22:6820 osd.7 since back 2024-09-19T09:09:58.793946+0000 front 2024-09-19T09:09:58.793966+0000 (oldest deadline 2024-09-19T09:10:23.493907+0000) 2024-09-19T09:10:34.156 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:33 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11[60768]: 2024-09-19T09:10:33.702+0000 7fceac9fc640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.64:6820 osd.8 since back 2024-09-19T09:10:09.295356+0000 front 2024-09-19T09:10:09.295375+0000 (oldest deadline 2024-09-19T09:10:31.595411+0000) 2024-09-19T09:10:34.856 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:34 smithi064 podman[70004]: 2024-09-19 09:10:34.605274236 +0000 UTC m=+5.456390642 container died 433c17062e1c71738c3e9e45b649c02a9b4f22e7293dbd5c3b4b9a82e0a7e61d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T09:10:35.323 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:35 smithi064 podman[70004]: 2024-09-19 09:10:35.072143289 +0000 UTC m=+5.923259692 container cleanup 433c17062e1c71738c3e9e45b649c02a9b4f22e7293dbd5c3b4b9a82e0a7e61d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:35.323 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:35 smithi064 bash[70004]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11 2024-09-19T09:10:35.607 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:35 smithi064 podman[70019]: 2024-09-19 09:10:35.323047433 +0000 UTC m=+0.716228441 container remove 433c17062e1c71738c3e9e45b649c02a9b4f22e7293dbd5c3b4b9a82e0a7e61d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:35.875 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:35 smithi064 podman[70108]: 2024-09-19 09:10:35.615413775 +0000 UTC m=+0.089912932 container create 41a3ca77ca7e69dbad9b3be3ddb1f87970f889b1003a91e78ad26cc3bd07419d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:10:35.876 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:35 smithi064 podman[70108]: 2024-09-19 09:10:35.541133828 +0000 UTC m=+0.015632933 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:10:35.876 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:35 smithi064 podman[70108]: 2024-09-19 09:10:35.817680678 +0000 UTC m=+0.292179783 container init 41a3ca77ca7e69dbad9b3be3ddb1f87970f889b1003a91e78ad26cc3bd07419d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:10:35.876 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:35 smithi064 podman[70108]: 2024-09-19 09:10:35.820836499 +0000 UTC m=+0.295335595 container start 41a3ca77ca7e69dbad9b3be3ddb1f87970f889b1003a91e78ad26cc3bd07419d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:10:35.876 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:35 smithi064 podman[70108]: 2024-09-19 09:10:35.875872067 +0000 UTC m=+0.350371183 container attach 41a3ca77ca7e69dbad9b3be3ddb1f87970f889b1003a91e78ad26cc3bd07419d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:36.356 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:36 smithi064 podman[70108]: 2024-09-19 09:10:36.008095393 +0000 UTC m=+0.482594500 container died 41a3ca77ca7e69dbad9b3be3ddb1f87970f889b1003a91e78ad26cc3bd07419d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T09:10:36.704 INFO:journalctl@ceph.osd.11.smithi064.stdout:Sep 19 09:10:36 smithi064 podman[70131]: 2024-09-19 09:10:36.679182657 +0000 UTC m=+0.665237826 container remove 41a3ca77ca7e69dbad9b3be3ddb1f87970f889b1003a91e78ad26cc3bd07419d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:10:36.710 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T09:10:36.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:36.751 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T09:10:36.751 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T09:10:36.751 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.a 2024-09-19T09:10:37.052 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:10:36 smithi001 systemd[1]: Stopping Ceph mds.a for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:37.548 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:10:37 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a[72657]: 2024-09-19T09:10:37.057+0000 7f9ef2d64640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:37.549 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:10:37 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a[72657]: 2024-09-19T09:10:37.057+0000 7f9ef2d64640 -1 mds.a *** got signal Terminated *** 2024-09-19T09:10:38.298 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:10:38 smithi001 podman[99429]: 2024-09-19 09:10:38.03143575 +0000 UTC m=+1.079209173 container died a08cf576aab4baafa882319dc2391d44237c09a9820e293fd4ef6056a203ea6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:10:38.768 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:10:38 smithi001 podman[99429]: 2024-09-19 09:10:38.532850493 +0000 UTC m=+1.580623914 container cleanup a08cf576aab4baafa882319dc2391d44237c09a9820e293fd4ef6056a203ea6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:10:38.768 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:10:38 smithi001 bash[99429]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-a 2024-09-19T09:10:38.959 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T09:10:38.997 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:38.998 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T09:10:38.998 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T09:10:38.998 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.d 2024-09-19T09:10:39.354 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:10:39 smithi001 systemd[1]: Stopping Ceph mds.d for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:39.799 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:10:39 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-d[71464]: 2024-09-19T09:10:39.353+0000 7fa796b05640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:39.799 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:10:39 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-d[71464]: 2024-09-19T09:10:39.353+0000 7fa796b05640 -1 mds.d *** got signal Terminated *** 2024-09-19T09:10:43.272 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:10:42 smithi001 podman[99561]: 2024-09-19 09:10:42.983388937 +0000 UTC m=+3.748890487 container died c077c2b11d19394f2ff80c2e5b878da0d5eda2fc6649a42f4a238cb0af4fd674 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:10:43.548 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:10:43 smithi001 podman[99561]: 2024-09-19 09:10:43.453751893 +0000 UTC m=+4.219253442 container cleanup c077c2b11d19394f2ff80c2e5b878da0d5eda2fc6649a42f4a238cb0af4fd674 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-d, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T09:10:43.549 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:10:43 smithi001 bash[99561]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-d 2024-09-19T09:10:43.953 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T09:10:43.988 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:43.988 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T09:10:43.988 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T09:10:43.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.g 2024-09-19T09:10:44.549 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:10:44 smithi001 systemd[1]: Stopping Ceph mds.g for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:44.549 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:10:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g[72244]: 2024-09-19T09:10:44.307+0000 7fc04cb1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:44.549 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:10:44 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g[72244]: 2024-09-19T09:10:44.307+0000 7fc04cb1b640 -1 mds.g *** got signal Terminated *** 2024-09-19T09:10:47.548 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:10:47 smithi001 podman[99681]: 2024-09-19 09:10:47.279492778 +0000 UTC m=+3.066006325 container died 3e67f9be480ec45af4df68133fd20c0a09241ea57196a0b511e8b637bc759bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:10:47.917 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:10:47 smithi001 podman[99681]: 2024-09-19 09:10:47.632444256 +0000 UTC m=+3.418957804 container cleanup 3e67f9be480ec45af4df68133fd20c0a09241ea57196a0b511e8b637bc759bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:10:47.917 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:10:47 smithi001 bash[99681]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-g 2024-09-19T09:10:48.063 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T09:10:48.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:48.102 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T09:10:48.102 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T09:10:48.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.j 2024-09-19T09:10:48.548 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:10:48 smithi001 systemd[1]: Stopping Ceph mds.j for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:48.549 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:10:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j[71053]: 2024-09-19T09:10:48.428+0000 7f64eb330640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:48.549 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:10:48 smithi001 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j[71053]: 2024-09-19T09:10:48.428+0000 7f64eb330640 -1 mds.j *** got signal Terminated *** 2024-09-19T09:10:51.870 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:10:51 smithi001 podman[99802]: 2024-09-19 09:10:51.607661246 +0000 UTC m=+3.280393496 container died d466a458bcb380604fd958ac1363df39f9732bb03750632267e9941ab52d4d85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:10:52.221 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:10:52 smithi001 podman[99802]: 2024-09-19 09:10:52.044924847 +0000 UTC m=+3.717657092 container cleanup d466a458bcb380604fd958ac1363df39f9732bb03750632267e9941ab52d4d85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:10:52.221 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:10:52 smithi001 bash[99802]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j 2024-09-19T09:10:52.474 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:10:52 smithi001 podman[99815]: 2024-09-19 09:10:52.221050457 +0000 UTC m=+0.610706493 container remove d466a458bcb380604fd958ac1363df39f9732bb03750632267e9941ab52d4d85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:10:52.478 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T09:10:52.512 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:52.512 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T09:10:52.512 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T09:10:52.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.b 2024-09-19T09:10:52.805 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:10:52 smithi022 systemd[1]: Stopping Ceph mds.b for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:53.209 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:10:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: 2024-09-19T09:10:52.804+0000 7f42ccd0e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:53.209 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:10:52 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b[65441]: 2024-09-19T09:10:52.804+0000 7f42ccd0e640 -1 mds.b *** got signal Terminated *** 2024-09-19T09:10:57.096 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:10:56 smithi022 podman[69539]: 2024-09-19 09:10:56.812717194 +0000 UTC m=+4.101067814 container died 55ef0bebea888133b7ae444e1f4bae15b32cec62ddc59af57b6f5a06bba7344a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:10:57.459 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:10:57 smithi022 podman[69539]: 2024-09-19 09:10:57.196022839 +0000 UTC m=+4.484373445 container cleanup 55ef0bebea888133b7ae444e1f4bae15b32cec62ddc59af57b6f5a06bba7344a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:10:57.459 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:10:57 smithi022 bash[69539]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-b 2024-09-19T09:10:57.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T09:10:57.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:10:57.674 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T09:10:57.674 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T09:10:57.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.e 2024-09-19T09:10:58.209 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:10:57 smithi022 systemd[1]: Stopping Ceph mds.e for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:10:58.209 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:10:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e[64839]: 2024-09-19T09:10:57.982+0000 7ff7e4f90640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:10:58.209 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:10:57 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e[64839]: 2024-09-19T09:10:57.982+0000 7ff7e4f90640 -1 mds.e *** got signal Terminated *** 2024-09-19T09:11:01.959 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:11:01 smithi022 podman[69661]: 2024-09-19 09:11:01.646903073 +0000 UTC m=+3.755271434 container died e57a036e09acb3c5dd3a2db343ee2df3aacf4bf9edfa760106df7a6012d72193 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:11:02.460 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:11:02 smithi022 podman[69661]: 2024-09-19 09:11:02.136414177 +0000 UTC m=+4.244782532 container cleanup e57a036e09acb3c5dd3a2db343ee2df3aacf4bf9edfa760106df7a6012d72193 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:11:02.460 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:11:02 smithi022 bash[69661]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e 2024-09-19T09:11:02.460 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:11:02 smithi022 podman[69685]: 2024-09-19 09:11:02.375353717 +0000 UTC m=+0.722219873 container remove e57a036e09acb3c5dd3a2db343ee2df3aacf4bf9edfa760106df7a6012d72193 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T09:11:02.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T09:11:02.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:11:02.547 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T09:11:02.547 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T09:11:02.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.h 2024-09-19T09:11:02.870 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:02 smithi022 systemd[1]: Stopping Ceph mds.h for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:11:03.209 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:02 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h[65139]: 2024-09-19T09:11:02.868+0000 7f59476d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:11:03.209 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:02 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h[65139]: 2024-09-19T09:11:02.868+0000 7f59476d3640 -1 mds.h *** got signal Terminated *** 2024-09-19T09:11:05.920 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:05 smithi022 podman[69796]: 2024-09-19 09:11:05.635307349 +0000 UTC m=+2.863249876 container died 58faa7fcb97e92c79b14be2855c2096ca31f810acc93d0bd1d5a7b398f6a0c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:11:06.187 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:05 smithi022 podman[69796]: 2024-09-19 09:11:05.986266701 +0000 UTC m=+3.214209227 container cleanup 58faa7fcb97e92c79b14be2855c2096ca31f810acc93d0bd1d5a7b398f6a0c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:11:06.187 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:05 smithi022 bash[69796]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h 2024-09-19T09:11:06.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T09:11:06.440 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:06 smithi022 podman[69808]: 2024-09-19 09:11:06.18737055 +0000 UTC m=+0.539920236 container remove 58faa7fcb97e92c79b14be2855c2096ca31f810acc93d0bd1d5a7b398f6a0c8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:11:06.440 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:06 smithi022 systemd[1]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-19T09:11:06.440 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:06 smithi022 systemd[1]: Stopped Ceph mds.h for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:11:06.440 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:11:06 smithi022 systemd[1]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.h.service: Consumed 9.094s CPU time. 2024-09-19T09:11:06.452 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:11:06.453 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T09:11:06.453 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T09:11:06.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.k 2024-09-19T09:11:06.709 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:11:06 smithi022 systemd[1]: Stopping Ceph mds.k for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:11:07.209 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:11:06 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k[64522]: 2024-09-19T09:11:06.805+0000 7f7d6b907640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:11:07.209 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:11:06 smithi022 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k[64522]: 2024-09-19T09:11:06.805+0000 7f7d6b907640 -1 mds.k *** got signal Terminated *** 2024-09-19T09:11:08.657 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:11:08 smithi022 podman[69917]: 2024-09-19 09:11:08.375103762 +0000 UTC m=+1.700793151 container died 1678cd433e7b96f27ba41422740e6c0c2863c617f164c7711d50be87e18edca1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:11:08.959 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:11:08 smithi022 podman[69917]: 2024-09-19 09:11:08.873131494 +0000 UTC m=+2.198820880 container cleanup 1678cd433e7b96f27ba41422740e6c0c2863c617f164c7711d50be87e18edca1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:11:08.959 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:11:08 smithi022 bash[69917]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-k 2024-09-19T09:11:09.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T09:11:09.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:11:09.236 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T09:11:09.236 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T09:11:09.236 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.c 2024-09-19T09:11:09.547 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:11:09 smithi064 systemd[1]: Stopping Ceph mds.c for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:11:09.856 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:11:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c[65619]: 2024-09-19T09:11:09.546+0000 7f22f5fd0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:11:09.856 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:11:09 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c[65619]: 2024-09-19T09:11:09.546+0000 7f22f5fd0640 -1 mds.c *** got signal Terminated *** 2024-09-19T09:11:13.856 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:11:13 smithi064 podman[70224]: 2024-09-19 09:11:13.560986257 +0000 UTC m=+4.119490677 container died 740a25227230edab9d9287d1aa2a20e4673f664531986c73bc079b38b925749d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:11:14.247 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:11:14 smithi064 podman[70224]: 2024-09-19 09:11:14.029442959 +0000 UTC m=+4.587947378 container cleanup 740a25227230edab9d9287d1aa2a20e4673f664531986c73bc079b38b925749d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:11:14.247 INFO:journalctl@ceph.mds.c.smithi064.stdout:Sep 19 09:11:14 smithi064 bash[70224]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-c 2024-09-19T09:11:14.383 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T09:11:14.418 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:11:14.418 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T09:11:14.418 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T09:11:14.419 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.f 2024-09-19T09:11:14.606 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:14 smithi064 systemd[1]: Stopping Ceph mds.f for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:11:15.106 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:14 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f[65317]: 2024-09-19T09:11:14.732+0000 7feb3f92d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:11:15.106 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:14 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f[65317]: 2024-09-19T09:11:14.732+0000 7feb3f92d640 -1 mds.f *** got signal Terminated *** 2024-09-19T09:11:17.908 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:17 smithi064 podman[70347]: 2024-09-19 09:11:17.655084872 +0000 UTC m=+3.017284614 container died b1c4be031aae36902077c5bece291294e40671690af81a75fb183d05f6844cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:11:18.159 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:17 smithi064 podman[70347]: 2024-09-19 09:11:17.982913007 +0000 UTC m=+3.345112748 container cleanup b1c4be031aae36902077c5bece291294e40671690af81a75fb183d05f6844cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:11:18.159 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:17 smithi064 bash[70347]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f 2024-09-19T09:11:18.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T09:11:18.431 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:18 smithi064 podman[70362]: 2024-09-19 09:11:18.159123259 +0000 UTC m=+0.506029235 container remove b1c4be031aae36902077c5bece291294e40671690af81a75fb183d05f6844cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:11:18.431 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:18 smithi064 systemd[1]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.f.service: Deactivated successfully. 2024-09-19T09:11:18.431 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:18 smithi064 systemd[1]: Stopped Ceph mds.f for 98b2a8e0-7664-11ef-bceb-c7b262605968. 2024-09-19T09:11:18.431 INFO:journalctl@ceph.mds.f.smithi064.stdout:Sep 19 09:11:18 smithi064 systemd[1]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.f.service: Consumed 2.964s CPU time. 2024-09-19T09:11:18.442 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:11:18.442 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T09:11:18.442 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T09:11:18.442 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.i 2024-09-19T09:11:18.770 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:11:18 smithi064 systemd[1]: Stopping Ceph mds.i for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:11:19.106 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:11:18 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i[65919]: 2024-09-19T09:11:18.769+0000 7f0632beb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:11:19.106 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:11:18 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i[65919]: 2024-09-19T09:11:18.769+0000 7f0632beb640 -1 mds.i *** got signal Terminated *** 2024-09-19T09:11:21.986 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:11:21 smithi064 podman[70468]: 2024-09-19 09:11:21.647108381 +0000 UTC m=+2.979519170 container died a9713fa7becab5bff28f73af253b27bb95a3f323056e35340234891802e63e9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:11:21.986 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:11:21 smithi064 podman[70468]: 2024-09-19 09:11:21.986549236 +0000 UTC m=+3.318960016 container cleanup a9713fa7becab5bff28f73af253b27bb95a3f323056e35340234891802e63e9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T09:11:22.312 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:11:21 smithi064 bash[70468]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i 2024-09-19T09:11:22.570 INFO:journalctl@ceph.mds.i.smithi064.stdout:Sep 19 09:11:22 smithi064 podman[70481]: 2024-09-19 09:11:22.31281481 +0000 UTC m=+0.665566418 container remove a9713fa7becab5bff28f73af253b27bb95a3f323056e35340234891802e63e9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:11:22.574 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T09:11:22.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:11:22.605 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T09:11:22.605 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T09:11:22.606 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.l 2024-09-19T09:11:22.856 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:11:22 smithi064 systemd[1]: Stopping Ceph mds.l for 98b2a8e0-7664-11ef-bceb-c7b262605968... 2024-09-19T09:11:23.356 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:11:22 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l[65017]: 2024-09-19T09:11:22.940+0000 7f7f00b46640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:11:23.356 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:11:22 smithi064 ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l[65017]: 2024-09-19T09:11:22.940+0000 7f7f00b46640 -1 mds.l *** got signal Terminated *** 2024-09-19T09:11:26.106 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:11:25 smithi064 podman[70589]: 2024-09-19 09:11:25.830292785 +0000 UTC m=+3.008181295 container died 913a9f622878eee818079139c6722498ba6a93deb1e2251e82c9cefe9e620aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:11:26.458 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:11:26 smithi064 podman[70589]: 2024-09-19 09:11:26.265331945 +0000 UTC m=+3.443220457 container cleanup 913a9f622878eee818079139c6722498ba6a93deb1e2251e82c9cefe9e620aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:11:26.458 INFO:journalctl@ceph.mds.l.smithi064.stdout:Sep 19 09:11:26 smithi064 bash[70589]: ceph-98b2a8e0-7664-11ef-bceb-c7b262605968-mds-l 2024-09-19T09:11:26.678 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98b2a8e0-7664-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T09:11:26.709 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:11:26.710 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T09:11:26.710 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:11:26.923 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T09:11:29.463 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:11:29.670 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T09:11:32.107 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:11:32.312 INFO:teuthology.orchestra.run.smithi064.stdout:Deleting cluster with fsid: 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T09:11:34.803 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:11:34.838 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:11:34.872 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:11:34.899 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:11:34.902 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi001/crash 2024-09-19T09:11:34.903 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:11:34.932 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:11:34.932 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:11:34.934 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi022/crash 2024-09-19T09:11:34.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:11:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:11:34.983 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:11:34.985 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi064/crash 2024-09-19T09:11:34.986 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:11:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:tar: /var/lib/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:11:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:11:35.020 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:11:35.021 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:11:35.063 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:11:35.063 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:11:35.106 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:11:35.109 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:11:35.130 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:11:35.130 INFO:teuthology.orchestra.run.smithi001.stderr:: No such file or directory 2024-09-19T09:11:35.132 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T09:11:35.132 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:11:35.132 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:11:35.132 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T09:11:35.132 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:11:35.136 INFO:teuthology.orchestra.run.smithi064.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:11:35.136 INFO:teuthology.orchestra.run.smithi064.stderr:: No such file or directory 2024-09-19T09:11:35.136 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:11:35.136 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T09:11:35.136 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T09:11:35.136 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:11:35.136 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.c.log: -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T09:11:35.137 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:11:35.137 INFO:teuthology.orchestra.run.smithi064.stderr: 82.4% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:11:35.137 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:11:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T09:11:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T09:11:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.5% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:11:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T09:11:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:11:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:11:35.138 INFO:teuthology.orchestra.run.smithi001.stderr: 94.6% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T09:11:35.139 INFO:teuthology.orchestra.run.smithi001.stderr: 94.6% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T09:11:35.140 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:11:35.140 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T09:11:35.140 INFO:teuthology.orchestra.run.smithi064.stderr: 90.3% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:11:35.140 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T09:11:35.140 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.l.log: 86.3% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:11:35.140 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T09:11:35.140 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.7% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T09:11:35.141 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory 2024-09-19T09:11:35.141 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T09:11:35.141 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:11:35.141 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T09:11:35.141 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:11:35.141 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log: 94.5% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr: 90.3% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:11:35.145 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.y.log: /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.4% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:11:35.146 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T09:11:35.146 INFO:teuthology.orchestra.run.smithi001.stderr: 90.9% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:11:35.146 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T09:11:35.146 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T09:11:35.148 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log: 86.3% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:11:35.148 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T09:11:35.148 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T09:11:35.148 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.c.log: 90.9% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:11:35.151 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T09:11:35.151 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T09:11:35.151 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T09:11:35.151 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:11:35.151 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.j.log: 86.4% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:11:35.151 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:11:35.151 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.5% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T09:11:35.152 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:11:35.153 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.h.log: 92.2% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T09:11:35.153 INFO:teuthology.orchestra.run.smithi022.stderr: 90.9% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:11:35.153 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T09:11:35.158 INFO:teuthology.orchestra.run.smithi001.stderr: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:11:35.159 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:11:35.167 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T09:11:35.168 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:11:35.183 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:11:35.374 INFO:teuthology.orchestra.run.smithi001.stderr: 90.0% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T09:11:35.459 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T09:11:35.496 INFO:teuthology.orchestra.run.smithi022.stderr: 91.7% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T09:11:35.513 INFO:teuthology.orchestra.run.smithi022.stderr: 95.0% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T09:11:35.728 INFO:teuthology.orchestra.run.smithi064.stderr: 95.3% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T09:11:35.747 INFO:teuthology.orchestra.run.smithi001.stderr: 90.5% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T09:11:36.375 INFO:teuthology.orchestra.run.smithi001.stderr: 93.8% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T09:11:36.812 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T09:11:36.885 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:11:36.897 INFO:teuthology.orchestra.run.smithi001.stderr: 93.8% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:11:36.913 INFO:teuthology.orchestra.run.smithi022.stderr: 93.6% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:11:36.924 INFO:teuthology.orchestra.run.smithi001.stderr: 93.8% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T09:11:36.937 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T09:11:37.046 INFO:teuthology.orchestra.run.smithi001.stderr: 93.7% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:11:37.047 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-19T09:11:37.048 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m1.928s 2024-09-19T09:11:37.048 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m7.333s 2024-09-19T09:11:37.048 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m0.257s 2024-09-19T09:11:37.241 INFO:teuthology.orchestra.run.smithi064.stderr: 93.8% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:11:37.731 INFO:teuthology.orchestra.run.smithi064.stderr: 94.1% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T09:11:37.754 INFO:teuthology.orchestra.run.smithi064.stderr: 93.8% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:11:37.923 INFO:teuthology.orchestra.run.smithi064.stderr: 95.3% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T09:11:37.948 INFO:teuthology.orchestra.run.smithi022.stderr: 94.0% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T09:11:38.438 INFO:teuthology.orchestra.run.smithi022.stderr: 93.9% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T09:11:40.732 INFO:teuthology.orchestra.run.smithi064.stderr: 93.7% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T09:11:40.733 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-09-19T09:11:40.733 INFO:teuthology.orchestra.run.smithi064.stderr:real 0m5.610s 2024-09-19T09:11:40.734 INFO:teuthology.orchestra.run.smithi064.stderr:user 0m17.889s 2024-09-19T09:11:40.734 INFO:teuthology.orchestra.run.smithi064.stderr:sys 0m0.528s 2024-09-19T09:12:11.285 INFO:teuthology.orchestra.run.smithi022.stderr: 93.3% -- replaced with /var/log/ceph/98b2a8e0-7664-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T09:12:11.286 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-09-19T09:12:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m36.162s 2024-09-19T09:12:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m46.758s 2024-09-19T09:12:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m1.341s 2024-09-19T09:12:11.287 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:12:11.287 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi001/log 2024-09-19T09:12:11.288 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:12:12.394 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi022/log 2024-09-19T09:12:12.395 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:12:18.730 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi064/log 2024-09-19T09:12:18.730 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:12:20.750 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:12:20.751 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 --force 2024-09-19T09:12:20.966 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T09:12:21.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 --force 2024-09-19T09:12:21.447 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T09:12:21.747 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98b2a8e0-7664-11ef-bceb-c7b262605968 --force 2024-09-19T09:12:21.944 INFO:teuthology.orchestra.run.smithi064.stdout:Deleting cluster with fsid: 98b2a8e0-7664-11ef-bceb-c7b262605968 2024-09-19T09:12:22.214 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:12:22.214 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:12:22.232 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:12:22.250 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:12:22.265 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:12:22.266 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:12:22.280 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:12:22.280 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:12:22.283 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:12:22.293 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:12:22.394 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:12:22.404 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:12:22.405 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:12:22.407 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:12:22.410 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:12:22.421 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:12:22.423 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:12:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:12:22.425 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:12:22.425 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-19T09:12:22.425 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +1542us[+1566us] +/- 51ms 2024-09-19T09:12:22.425 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -2861us[-2837us] +/- 51ms 2024-09-19T09:12:22.425 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +1879us[+1902us] +/- 74ms 2024-09-19T09:12:22.425 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:12:22.428 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:12:22.428 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-09-19T09:12:22.428 INFO:teuthology.orchestra.run.smithi064.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +1514us[+1542us] +/- 51ms 2024-09-19T09:12:22.428 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 -2881us[-2881us] +/- 51ms 2024-09-19T09:12:22.428 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +1866us[+1866us] +/- 74ms 2024-09-19T09:12:22.428 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:12:22.429 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:12:22.429 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-19T09:12:22.429 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +1504us[+1487us] +/- 51ms 2024-09-19T09:12:22.430 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -2892us[-2892us] +/- 51ms 2024-09-19T09:12:22.430 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +1839us[+1822us] +/- 74ms 2024-09-19T09:12:22.430 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:12:22.430 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:12:22.441 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:12:22.441 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:12:22.451 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:12:22.546 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:12:22.620 DEBUG:teuthology.orchestra.run.smithi064:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:12:22.688 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:12:22.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:12:22.718 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:12:22.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:12:22.750 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:12:22.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:12:22.777 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:12:22.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:12:22.799 INFO:teuthology.task.internal:Duration was 1505.644398 seconds 2024-09-19T09:12:22.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:12:22.809 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:12:22.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:12:22.812 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:12:22.814 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:12:22.853 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:12:22.855 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:12:22.856 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:12:23.255 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:12:23.255 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:12:23.255 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:12:23.277 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-09-19T09:12:23.277 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:12:23.309 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2024-09-19T09:12:23.309 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:12:23.333 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:12:23.334 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:12:23.336 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:12:23.351 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:12:23.399 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:12:23.400 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:12:23.404 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:12:23.418 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:12:24.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:12:24.252 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:12:24.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:12:24.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:12:24.307 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:12:24.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:12:24.345 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:12:24.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:12:24.350 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:12:24.368 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-09-19T09:12:24.375 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-09-19T09:12:24.398 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2024-09-19T09:12:24.423 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:12:24.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:12:24.441 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:12:24.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:12:24.458 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:12:24.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:12:24.478 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:12:24.490 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:12:24.491 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi001 2024-09-19T09:12:24.491 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:12:24.548 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi022 2024-09-19T09:12:24.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:12:24.589 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911880/remote/smithi064 2024-09-19T09:12:24.589 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:12:24.626 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:12:24.626 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:12:24.629 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:12:24.631 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:12:24.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:12:24.689 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:12:24.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:12:24.700 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:12:24.700 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:12:24.705 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:12:24.708 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:12:24.719 INFO:teuthology.orchestra.run.smithi001.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:12 /home/ubuntu/cephtest 2024-09-19T09:12:24.723 INFO:teuthology.orchestra.run.smithi022.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:12 /home/ubuntu/cephtest 2024-09-19T09:12:24.731 INFO:teuthology.orchestra.run.smithi064.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:12 /home/ubuntu/cephtest 2024-09-19T09:12:24.732 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:12:24.744 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:12:24.772 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1505.6443979740143 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T09:12:24.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:12:24.874 INFO:teuthology.run:pass